 However, the city fell to the Union again shortly before the Battle of Atlanta.The North Georgia Conference of the Methodist Episcopal Church, South, purchased a small farm on the east side of South Columbia Drive in 1873 and relocated from Norcross, Georgia.By the start of the 20th century, 125 boys and girls lived at the "Decatur Orphans' Home" (as it was then known).