William J. Simmons was born a slave in Charleston, South Carolina, to Edward and Esther Simmons on June 29, 1849.While William was young, his Mother fled slavery with her three children, William and his two sisters Emeline and Anna.