 Emily was born on 9 August 1833 at Westmill, Hertfordshire, where her father was rector at that time.Her father, Henry Pepys (this branch of the family pronounced the name "peppis", not "peeps", 1783–1860), was created the Anglican Bishop of Sodor and Man in 1840 and translated only a year later to Worcester.He played a minor political role as a Liberal in the House of Lords.