 Gilbert's mother was the former Anne Mary Bye Morris (1812–1888), the daughter of Thomas Morris, an apothecary.Gilbert's parents were distant and stern, and he did not have a particularly close relationship with either of them.They quarrelled increasingly, and following the break-up of their marriage in 1876, his relationships with them, especially his mother, became even more strained.