 The facility was not exclusively used for Colonial prisoners, and at least some British soldiers were held there too.The building housed the South Carolina convention to ratify the United States Constitution in 1788, and was the site of many of the events in George Washington's week-long stay in Charleston.He was greeted by a crowd on the balcony.