 His is also thought to have been a patron of John Higton, given his depiction of "Dogs at Ampthill Park" in 1810.On returning to Britain, Fitzpatrick embarked on an affair with Anne Fitzroy, wife of Prime Minister Augustus Fitzroy, 3rd Duke of Grafton, (and daughter of Henry Liddell, 1st Baron Ravensworth).This resulted in the Prime Minister having an affair with a courtesan, the birth of a child, the duchess's divorce and her marriage to FitzPatrick in 1769.