and of course this caused a terrible scandal at the time , only no-one ever really said anything because we were so popular and everyone wanted to come to our parties , even hearst and he hated parties .