 On the death of his half brother, the 2nd Duke, in 1735, he inherited the family estates including Buckingham House which was sold to George III in 1762 and Normanby Hall which latter remained the family residence until 1963.Thereafter the family's home was Sutton Park, York.The fourth Baronet served as High Sheriff of Lincolnshire in 1817 and the fifth Baronet in 1872.