 Pankov's mother hailed from Herzegovina.His father, Miloš Pankov, was originally from Tovariševo and played as a playmaker for Proleter Zrenjanin in Yugoslavia's third tier.At one point he was a teammate with Darko Kovačević.