 Wharton was born in Chester County in the Province of Pennsylvania, in 1735.He was born into one of Philadelphia's most prominent early Quaker families.He was known as "Junior" to distinguish him from a cousin of the same name.