 Appleton was born in Brookfield, Massachusetts, the son of a minister, the Reverend Joseph Appleton, who died when he was nine.He attended schools in New Ipswich, New Hampshire, Francestown, New Hampshire, and Tyngsborough, Massachusetts.At fifteen years of age he started work at a country store in Temple, New Hampshire.