 In practice, one can perform multiple stochastic gradient passes (also called cycles or epochs) over the data.The algorithm thus obtained is
called incremental gradient method and corresponds to an iteration
The main difference with the stochastic gradient method is that here a sequence formula_77 is chosen to decide which training point is visited in the formula_54-th step.Such a sequence can be stochastic or deterministic.