 Wharton's mother, Hannah Rodman Fisher, came from a long line of Quaker families from Rhode Island and Massachusetts.During the Revolution years, the Narragansett Bay area became a battleground between the British and the Americans allied with the French, and the Newport economy suffered.After the war, Hannah Rodman married Samuel R Fisher of Philadelphia and raised her family there.