 However, the stepsize formula_73 needs to be chosen carefully to solve the expected risk minimization problem, as detailed above.By choosing a decaying step size formula_74 one can prove the convergence of the average iterate formula_75.This setting is a special case of stochastic optimization, a well known problem in optimization.