 His father Han Xiu was an important official early during the middle of Emperor Xuanzong's reign and briefly served as chancellor in 733.He had at least five older brothers — Han Hao (), Han Qia (), Han Hong (), Han Huan (), and Han Hong (韓汯, note different character than his other brother) — and at least three younger brothers — among whom were Han Hun () and Han Hui ().Han Huang himself was said to be firm and studious in his youth.