 Originally a dwelling, the ground floor was converted to commercial use around 1845 by William Allinson, a druggist, local historian, and leading Quaker abolitionist.He used the building as a center of anti-slavery activity.John Greenleaf Whittier denounced slavery from the doorstep, and local tradition holds that fugitive slaves hid in tunnels under the building in their passage on the Underground Railroad.