 Ndou began 2005 with a 12 rounds unanimous points loss to Junior Witter at the Staples Center, Los Angeles, USA for the Commonwealth Light Welterweight Title.Over the next 18 months following the loss to Witter, Ndou defended his IBF Pan Pacific Light Welterweight Title on four occasions to rise to the world IBF #1 Light Welterweight ranking at the start of 2007.On 4 February 2007 in Sydney, Ndou fought in the Australian Fight of the Year and defeated Naoufel Ben Rabah in an IBF World Light Welterweight Title Eliminator for the right to meet current title holder Ricky Hatton, after Hatton had won the title against Juan Urango in Las Vegas, USA two weeks earlier.