de nogaret curled his lip showing his displeasure at having had to make his way to the popes residence virtually alone , with only the help of one of the kings guards as he struggled to mount and dismount his ride .