 He was the son of William de Brus, 3rd Lord of Annandale and Christina or Beatrice de Teyden.Robert had the same name as both his uncle and his grandfather.His uncle died before becoming Lord of Annandale, so William became 3rd Lord of Annandale.