 As a youth Stanford was apprenticed to a stonemason.Stanford came to Victoria in 1852, probably as a ship's boy, and for a time worked on the gold diggings at Bendigo.In 1854 he was found guilty on a charge of horse-stealing and was sentenced to ten years imprisonment at HM Prison Pentridge, near Melbourne.