 In 1618 it was again described as ruinous.The castle was acquired by the Ingram family in 1622, and stone from the site was used by them in the building of nearby Sheriff Hutton House.The castle remained in the Ingram family until the early twentieth century, by which time the ruins were being used as a farmyard.