 During the 1830s prior to Indian removal, the US Army under command of Major John Payne built a fort here that was used to intern Cherokees until relocation to Oklahoma.Their forced exile became known as the Trail of Tears.By the 1860s, Fort Payne and the surrounding area were still sparsely settled.