Weld's caustic apostasy handed his enemies a persuasive argument against his fitness for the job--that he's undiplomatic.
His enemies had an argument against his ability to work, that he was too overweight.