 Handley was named after his godfathers Augustus Handley, a minister at Fordington, and Carr John Glyn (father of General John P. C. Glyn).His brothers George Evans Moule and Arthur Evans Moule were missionaries in China, and another brother, Charles Walter Moule, was president of Corpus Christi.Two more brothers, Horatio Mosley Moule and artist Henry Joseph Moule are chiefly remembered as friends of novelist Thomas Hardy, who was well known to the Moule family.