 Samuel Wragg Ferguson was born in Charleston, South Carolina, on November 3, 1834, to James, a planter, and Abby Ann (née Barker) Ferguson.Educated at a private school in Charleston, he entered the United States Military Academy in 1852 and graduated in 1857.Before graduation, he joined Colonel Albert Sidney Johnson's Utah Expedition.