 The general expression for interaction information on variable set formula_67 in terms of the marginal entropies is given by Hu Kuo Ting (1962), Jakulin & Bratko (2003).which is an alternating (inclusion-exclusion) sum over all subsets formula_69, where formula_70.Note
that this is the information-theoretic analog to the Kirkwood approximation.