 The original tower house (58 feet high) was enlarged and extended in the 16th and early 17th centuries.In 1572 it was attacked by men from Blackness Castle on the southern shore of the Firth of Forth and it was occupied in 1651 by Oliver Cromwell's army after the Battle of Inverkeithing.It remained a Stewart residence until it was sold in the late seventeenth century to David Drummond of Invermay.