 With the Scottish Reformation under way, Inchaffray had been turned into a secular lordship for a member of the Drummond family in 1556.James VI visited James Drummond at Inchaffray on 5 October 1601.The property later passed to the Earls of Kinnoull.