 Gao Anagong was from Shanwu Commandery (善無, roughly modern Xinzhou, Shanxi).His father Gao Shigui (高市貴) was a follower of Gao Huan, the paramount general of Eastern Wei, the predecessor state of Northern Qi, and whose sons eventually became emperors of Northern Qi.Gao Anagong served in the military and was known for his bravery and abilities in archery and horseriding.