 The property was sold by Watson's heirs to James Duncan, Sr., and it either he or his son Samuel who built the brick Federal style house known as Buttonwoods that now stands on the property.The old Saltonstall house was demolished around this time.Sometime in the early-to-mid 19th century a second house was built on the property, which was generally occupied by the farmer who managed the land.