 He was educated at Eton College and later Exeter College, Oxford.When the last Lord Baltimore died in Naples in 1771 at the age of 39, the thirteen-year-old Henry became heir to all of Frederick's estates, including those in Britain, as the eldest son of the deceased peer.However, Harford was not entitled to ascend to the peerage or inherit his father's title as, like his sister Frances, he was born out of wedlock and was therefore illegitimate.