 Demolition in the 17th century removed furnishings and granite blocks.In the 18th century, the tower was made part of a Gothic mansion house by William Kent for new owner Henry Pelham.The tower is a Grade I listed building.