 However, Holley's New England Unitarian beliefs were too liberal for the tastes of many in Kentucky.Many called Holley an infidel and charged that he was a drinker and a gambler.He was criticized for spending time at the horse races and for furnishing his home with nude classical statues.