 The complex is surrounded by a low brick wall, donated in 1917 by a group of prominent citizens from New York.Such a wall had been part of the original design when the church was completed, but was ultimately rejected by the vestry as being too expensive; it was replaced with a wooden post fence.Stylistically, the church has been described as belonging to the Late Georgian school of architecture, with Palladian tendencies; one source has called it "a sophisticated essay in the Georgian style", and states that it "recalls the more refined dissenter chapels of 18th-century England".