 Columbia was the largest town in the area during the 19th century and remains one of the area's oldest continuously operating municipalities.Columbia received its first cotton textile mill in 1891 and its first electric plant in 1892.A branch of the Henry County Courthouse was located here from 1889 until Columbia became part of Houston County in 1903.