 In 1832, this first house was destroyed by a fire, said to be an act of arson committed by disgruntled tenant farmers.After the fire, Morgan Lewis and his wife, Gertrude Livingston, a sister of Chancellor Robert R. Livingston, immediately replaced the structure with a Greek Revival mansion with 25 rooms.The house was inherited in 1844 by Morgan Lewis's daughter Margaret and her husband Maturin Livingston; and in 1847 by the couple's son Maturin Livingston Jr. (1816–1888).