 It follows that
For a stationary process, where formula_41 does not depend on time "t", this differential equation can be solved.First,
where formula_45 denotes the exponential of the matrix formula_46.As a result,

If the Markov chain is irreducible, "i.e."