 First, under the London banker James Colebrooke (who bought the estate from the Digges family) fine vistas were created stretching to the river and then, under Thomas Heron (who acquired the estate from Colebrooke's son Robert), Capability Brown made further recommendations for change, some of which were implemented.Chilham Castle was purchased by James Wildman in 1794 and in 1816 was inherited by his son James Beckford Wildman, who sold it in 1861, because of falling income after emancipation of the slaves on the family estates in the West Indies.Plans of Chilham showing some of the substantial changes made to the building by David Brandon for Charles Hardy in 1862 and by Sir Herbert Baker for mining magnate Sir Edmund and Lady Mary Davis in the early nineteen twenties are conserved in the Victoria & Albert Museum.