there had been times , though rare , when he had refused to grant a boon to one of the villagers simply because it pleased him to refuse , because it gave him a perverse sense of power to know that he held the fate of the supplicant in his hands .