 Others have countered that the passage more likely refers to Lancaster Castle however.It is thought that there was a castle at Clitheroe in 1102, as Robert de Lacy granted lands formerly the property of Orme le Engleis, within the baillie and below, to Ralph le Rous.A charter from 1122 also mentions the castle's chapel.