 A medieval tower house which once stood on the site was, in 1415, held by Sir John Heron.This was destroyed by a Scottish army in 1496 commanded by James IV of Scotland and Perkin Warbeck.James IV returned on 24 August 1513 on his way to besiege Norham Castle, and held a council or parliament at "Twesil" or "Twesilhaugh."