 Payne was educated at the Phillips Academy in Andover, Massachusetts, where he graduated in 1859.He attended Yale University, where he was a member of Delta Kappa Epsilon.In 1861, at the outbreak of the American Civil War of 1861-1865, Payne enlisted in the Union Army.