 He was descended from the puritan colonist, William Phelps.He studied at Auburn Academy and Auburn High School.In 1844, Phelps was appointed as a promising student from Cayuga County, New York to attend the New York State Normal School.