 Since 2004 Schifferer was no longer able to achieve top rankings in World Cup races, but mainly finished in the middle of the bunch instead.In the 2005–06 season his best result was a 9th position in Val Gardena.During his career he won a total of eight World Cup meetings, seven in downhill and one on the Super G.

On 13 December 2006 Schifferer announced his retirement from the sport.