 Some authors use a slightly different convention and write the quintuple (st, at, rt+1, st+1, at+1), depending to which time step the reward is formally assigned.The rest of the article uses the former convention.A SARSA agent interacts with the environment and updates the policy based on actions taken, hence this is known as an "on-policy learning algorithm".