 By the start of the Civil War, the estate no longer existed as it had during the Hite family era.There was a succession of owners before the Brumback family purchased the property in 1907.The Brumbacks operated an inn there in the 1920s, but sold it to Francis Welles Hunnewell of Wellesley, Massachusetts in 1929.