 When he entered his upon his inheritance he became one of the richest land owners in Derbyshire with an income of £10000 a year.His principal home was the traditional family seat of Calke Abbey but he also took houses in the home counties to allow easy visits to London.In 1792 Sir Henry married his mistress, a lady's maid called Ann or Nanny Hawkins.