 Xu Mian's grandfather Xu Zhangzong (徐長宗) was an officer under Emperor Wu of Liu Song, and his father Xu Rong (徐融) was a commandery governor.However, the Xu family was not rich.When he was young, Xu Mian became known for studiousness, and he was retained by Southern Qi's prime minister Wang Jian to serve as an assistant.