 His paternal grandmother was Alice, Countess of Namur.Baldwin V had fought a war with his uncle, Henry IV of Luxembourg, to establish Namur as independent from Luxembourg in 1190 and in 1194, the Holy Roman Emperor Henry VI declared Namur to be a margraviate.Baldwin's will left Namur to Philip, but as a fief of Hainault.