 Lady Alice, Dowager Countess of Derby was already living at Harefield Place, although she became concerned that Lord Castlehaven, the second husband of her eldest daughter, Lady Anne Stanley, would attempt to claim her estate in the event of her death.She had Haydon Hall built in 1630, although Lord Castlehaven was tried and executed the following year.After Lady Alice died in 1636, her eldest daughter reverted to her first married name, Lady Chandos, and became owner of the house.