 On 17 September 1700 the Society mandated that "a lease for five lives was granted to Whitchurch Phippen of the site or ruins of the Great House at Clifton heretofore burnt down and since called the Old Castle, late in the holding of Mary Hodges".The new manor house was built in the early 18th century and extensively altered and extended in the mid-18th and 19th centuries.The terrace contains Roman remains, parts of a column, which are believed to have been brought back from the Mediterranean by a former resident in the eighteenth century.