 He became fluent in both English and French.By 1860, Cailloux was a well-respected member of the 10,000 "free men of color" community in New Orleans.At the time, New Orleans was the largest city in the South, and the sixth-largest city in the United States, with a population of about 100,000.