 It was built between 1824 and 1836.Pruyn was rent collection agent for Stephen Van Rensselaer and, after Stephen's death, William Van Rensselaer who had inherited the "East Manor" in Rensselaer County.From 1839 to 1844 Pruyn resided at the Patroon Agent's House and Office at Rensselaer and was a central figure in the Anti-Rent War at Rensselaerswyck.