 The castle was founded by the De Lisle family in the 12th century, and then passed to Sir William de Aldeburgh, following his marriage to Elizabeth de Lisle, heiress of Harewood, who was granted a licence to crenellate in 1366.The rectangular tower house on a steep slope is visible for miles around.The main block of two storeys is flanked by four angle towers, one being a plain entrance tower; the chapel is situated over the portcullis chamber.