Interrater agreement and interrater reliability: Key concepts, approaches, and applications

Evaluations of interrater agreement and interrater reliability can be applied to a number of different contexts and are frequently encountered in social and administrative pharmacy research. The objectives of this study were to highlight key differences between interrater agreement and interrater re...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Research in social and administrative pharmacy Ročník 9; číslo 3; s. 330 - 338
Hlavní autoři: Gisev, Natasa, Bell, J. Simon, Chen, Timothy F.
Médium: Journal Article
Jazyk:angličtina
Vydáno: United States Elsevier Inc 01.05.2013
Témata:
Data Interpretation, Statistical
Health services research
Humans
Observer Variation
Pharmacy Administration
Reproducibility of Results
Research design
Research Design - statistics & numerical data
Research design
Reproducibility of results
Observer variation
Health services research
ISSN:1551-7411, 1934-8150, 1934-8150
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Evaluations of interrater agreement and interrater reliability can be applied to a number of different contexts and are frequently encountered in social and administrative pharmacy research. The objectives of this study were to highlight key differences between interrater agreement and interrater reliability; describe the key concepts and approaches to evaluating interrater agreement and interrater reliability; and provide examples of their applications to research in the field of social and administrative pharmacy. This is a descriptive review of interrater agreement and interrater reliability indices. It outlines the practical applications and interpretation of these indices in social and administrative pharmacy research. Interrater agreement indices assess the extent to which the responses of 2 or more independent raters are concordant. Interrater reliability indices assess the extent to which raters consistently distinguish between different responses. A number of indices exist, and some common examples include Kappa, the Kendall coefficient of concordance, Bland-Altman plots, and the intraclass correlation coefficient. Guidance on the selection of an appropriate index is provided. In conclusion, selection of an appropriate index to evaluate interrater agreement or interrater reliability is dependent on a number of factors including the context in which the study is being undertaken, the type of variable under consideration, and the number of raters making assessments.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
ObjectType-Review-3
content type line 23
ISSN:1551-7411
1934-8150
1934-8150
DOI:10.1016/j.sapharm.2012.04.004