 His maternal grandfather, Ralph Randolph Wormeley, born in Virginia to loyalist parents, was raised in London and joined the Royal Navy, rising to the rank of admiral, while his grandmother, Caroline Preble, was from a venerable Boston family.His mother was therefore born and raised in London and returned to the United States in 1848.He spent much of his childhood in the affluent village of Chestnut Hill.