 A plan of the castle, dated 1723 is thought to have been created when a new house was built for the steward.However it seems that around this time much of the remaining curtain wall was demolished, with garden terraces created.The castle continued to operate as the administrative centre for Blackburnshire until 1822 when the town hall in Church Street was built.