 Brown, who had given the Brown Square park to the city, had planned to build a much longer row, but suffered financial reverses and was unable to build more than the pair.Sometime before 1849 the building was adapted for use as a boarding house.In 1922 it was turned into a hotel, named in honor of abolitionist William Lloyd Garrison, a statue of whom graces the square.