 Since he and his wife, Elizabeth, wanted a place to call their own and were not very fond of Bellefonte, they moved to Scottsboro around 1850–53.The town was called Scottsville, Scott's Mill, or Sage Town until 1868.In 1853, the newly formed Memphis and Charleston Railroad (a stretch of railroad that starts at Memphis, TN, and ends in Charleston, SC) decided to build a station at Scottsboro and did so in 1857.