 Gregory was born in Bow, London, the only son of a John James Gregory, a wool merchant, and his wife Jane, "née" Lewis.Gregory was educated at Stepney Grammar School and at 15 became a clerk at wool sales in London.He later took evening classes at the "Birkbeck Literary and Scientific Institution" (now Birkbeck, University of London).