 He was born in Annapolis Royal, Nova Scotia, the son of Stephen D. Ryerson, and was educated there and in Yarmouth.He went to sea at the age of seventeen, later becoming a ship owner.In 1843, he married Abby Shaw.