robert , earl of leicester , was a decade older than hugh , a greying , slender man who kept mostly to his own suite of comfortable rooms in the fortress and conferred primarily with the half dozen knights hed been permitted to retain as his personal servants .