 Diamé was born in the Paris suburb of Créteil and he was selected to attend the Clairefontaine academy between 2000 and 2003.Diamé began his professional career in 2003 with RC Lens, but left four years later after facing health problems.After a full recovery, he signed for lowly Spanish side CD Linares in 30 July 2007, and moved to Rayo Vallecano the following year, helping the Madrid-based team to a mid-table position in the Segunda División, after being promoted in the 2007–08 season.