 He was the son of Henry Evander and Laura (Clark) Stoughton.Stoughton was educated in Bellows Falls, Vermont, graduated from Norwich University in 1861, and delayed plans to study law so he could enlist in the Army.He was commissioned adjutant of the 4th Vermont Infantry on August 1, 1861 with the rank of Captain, and mustered into military service on September 21.