Suppose that we have two multivariate normal distributions, with means μ μ 0 , μ μ 1 and with (non-singular) covariance matrices Σ Σ 0 , Σ Σ 1 . If the two distributions have the same dimension, k, then the relative entropy between the distributions is as follows: