 The blue lias rubble foundations are the only visible structural remains of the castle which stood on the conical motte surrounded by a ditch approximately in circumference.The castle was destroyed in the 15th century, which may have been as a penalty for the local Lord Audley's involvement in the Second Cornish Uprising of 1497 led by Perkin Warbeck.Some of the stone was used in the building of Stowey Court in the village.