Computing inter-rater reliability and its variance in the presence of high agreement

Pi (π) and kappa (κ) statistics are widely used in the areas of psychiatry and psychological testing to compute the extent of agreement between raters on nominally scaled data. It is a fact that these coefficients occasionally yield unexpected results in situations known as the paradoxes of kappa. T...

Full description

Bibliographic Details

Published in:	British journal of mathematical & statistical psychology Vol. 61; no. 1; pp. 29 - 48
Main Author:	Gwet, Kilem Li
Format:	Journal Article
Language:	English
Published:	Oxford, UK Blackwell Publishing Ltd 01.05.2008 British Psychological Society
Subjects:	Analysis of Variance Humans Monte Carlo Method Monte Carlo simulation Observer Variation Probability Psychiatry Psychological tests Psychological Tests - statistics & numerical data Psychology Psychometrics - statistics & numerical data Reproducibility of Results Statistical analysis
ISSN:	0007-1102, 2044-8317
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!