 In particular,

formula_11

Where formula_12 is the self-information, or formula_13.Pointwise mutual information can be normalized between [-1,+1] resulting in -1 (in the limit) for never occurring together, 0 for independence, and +1 for complete co-occurrence.formula_14

Where formula_15 is the joint self-information, which is estimated as formula_16.