 The castle was originally a motte and bailey with a moat.The first castle was built of timber by the St. Valery family after the Norman conquest of England.In the Middle Ages the castle was rebuilt in stone when it belonged to the Bohuns, the Earls of Hereford.