 He was the eldest son of Roger Gaskell, a sailcloth manufacturer, from his marriage to his cousin Anne Hunter.He was baptised at the Paradise Street Unitarian Chapel in Liverpool.He was the cousin of the Unitarian minister William Gaskell, (husband of the novelist Mrs Gaskell), and was from a Unitarian family himself.