 His parents met while they were traveling separately in the Himalayas.His maternal grandfather was William Thomas Waggoner and his maternal great-grandfather was Daniel Waggoner.Wharton became a polo player.