 The original building was replaced by another in 1837.In 1866, when the state designated it the Garrison Union Free School District, it moved to donated land slightly further north along the present Route 9D.By the early 20th century the school's enrollment had grown as the New York Central Railroad had made Garrison more accessible to New York City and wealthy families had moved to the area to build houses taking in the scenery of the river and surrounding Hudson Highlands.