 In March 1860, he married Elizabeth Hoghton.The newly-married couple moved to their own house in Carlton Road, Maida Vale, but Elizabeth died of complications of a miscarriage in December of that same year.Pember remarried in October 1862 to Alice Mary Grieve.