 However, in each statistic, the expected agreement is calculated slightly differently.Scott's pi makes the assumption that annotators have the same distribution of responses, which makes Cohen's kappa slightly more informative.Scott's pi is extended to more than two annotators by Fleiss' kappa.