On the basis of the hypothesis that a text that makes sense will produce a high coherence score, we applied different levels of ‘disorder’ to a range of texts to determine whether the method could detect these modifications.