Though many in his own party have said there is no evidence for such fraud, his claims reportedly are based on a conversation with "very famous golfer Bernhard Langer," the New York Times reported Wednesday.