 This sparsity of activation can be achieved by formulating the penalty terms in different ways.formula_31

be the average activation of the hidden unit formula_32 (averaged over the formula_33 training examples).Note that the notation formula_34 makes explicit what the input affecting the activation was, i.e.