The idea of relative entropy as discrimination information led Kullback to propose the Principle of Minimum Discrimination Information (MDI): given new facts, a new distribution f should be chosen which is as hard to discriminate from the original distribution f 0 as possible; so that the new data produces as small an information gain D KL ( f ∥ ∥ f 0 ) as possible.