 Wharton then married Elizabeth Fishbourne and had three children with her.Wharton owned a country home called "Twickenham" near Abington Meeting in Montgomery County.The Wharton family was involved in various areas of business and public service, including shipbuilding for the Continental Navy.