 Duncan was born in the hamlet of Bishop Burton, Yorkshire, England, the illegitimate son of Maria Duncan, a teenaged servant.He was raised by his mother's parents, William and Elizabeth Duncan.In the 1841 census he is recorded as living with his father and his sister Mary Duncan on Lairgate in Beverley.