Scott's Pi

Scott's Pi is a statistic for measuring inter-rater reliability for nominal data in communication studies.