 His father was Nathan George Evans, a Confederate general, and after his father died in 1868, he went to live in Edgefield with his uncle Martin Witherspoon Gary.After completing his secondary education in Cokesbury, he enrolled at Union College in Schenectady, New York.His uncle's death in 1881 forced him to withdraw from college due to financial constraints, but he would later graduate in 1883.