 Most of the media were aware of the relationship but did not report on it.Mathews also told Whitlam, who tolerated the relationship on the proviso there was no "pillow talk".When Gorton stepped down as prime minister in March 1971, Gotto stayed in his service when he became Minister for Defence, but resigned from the public service in 1972.