 The core of the house was built c. 1671 by Deacon Thomas Knowlton, who purchased the land on which it originally stood on South Main Street in that year.It was subsequently altered in the middle of the 18th century, acquiring its present Georgian styling.In the 1770s the house was owned by noted Loyalist John Calef.