 Kjeldbjerg started playing football lower-league clubs Holstebro Boldklub and Viborg FF, before moving to Danish top-flight team Silkeborg IF.In August 1993, he moved abroad in England.He was bought by Chelsea in the FA Premier League, in a transfer deal worth £485,000.