 The castle was built during the Anarchy, a prolonged period of unrest and civil war between opposing factions led by King Stephen and the Empress Matilda.The Anarchy ended with the consensual accession of Matilda's son Henry II in 1154.Shortly afterwards, in 1155, Ashley Castle was slighted, along with other castles built by Henry of Blois.