it was rumored even now that the kings punishment of the earls of chester and leicester , his only remaining prisoners and two of the most powerful men in england , would be severe enough to ensure that their influence would become drastically curtailed .