 Considered a scalawag by his white Columbus neighbors, he worked with the Freedmens Bureau and alongside African American leaders such as Henry McNeal Turner.His actions quickly created several enemies across the South.Ashburn lived amongst the African American population and garnered attention from the Ku Klux Klan, which established their Columbus chapter on March 21, 1868 after a visit from Nathan Bedford Forrest.