 Born at Claxby Rectory, Alford, Lincolnshire, Parker was the son of the Reverend Richard Parker and of Elizabeth Coffin.His sister was the mental health worker Dame Ellen Pinsent.He was educated at Westminster School, Eton College (where he was a King's Scholar and Newcastle medallist), and King's College, Cambridge.