It is very difficult for a member of the public to see a business man spending £50,000 to meet David Cameron at a private dinner and not feel there is something going on that is not in their interests.