Intercoder Reliability for Use in Qualitative Research and Evaluation

Intercoder reliability can increase trustworthiness, accuracy, rigor, collaboration, and power sharing in qualitative research. Though not every qualitative design can utilize intercoder reliability, this article highlights how positivist qualitative research, community-based participatory research,...

Full description

Saved in:
Bibliographic Details
Published in:Measurement and evaluation in counseling and development Vol. 57; no. 2; pp. 136 - 146
Main Authors: Coleman, Monica L., Ragan, Moira, Dari, Tahani
Format: Journal Article
Language:English
Published: Alexandria Taylor & Francis Ltd 02.04.2024
Subjects:
Collaboration
Community based action research
Community research
Cooperative learning
Counseling
Counselor Training
Counselors
Credibility
Education
Evaluation
Evaluation research
Evaluators
Kappa statistic
Participatory research
Power-sharing
Qualitative research
Reliability
Teams
Trainees
ISSN:0748-1756, 1947-6302
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Intercoder reliability can increase trustworthiness, accuracy, rigor, collaboration, and power sharing in qualitative research. Though not every qualitative design can utilize intercoder reliability, this article highlights how positivist qualitative research, community-based participatory research, and participatory evaluation all strengthen when intercoder reliability is sought among coding teams. Basic calculations for intercoder reliability can be completed manually or with software, making it an accessible metric to inform counseling research and evaluation, benefitting counselor education and practice. Interpreting metrics like percent agreement or kappa statistic largely depends on data context and potential impact of the study, which warrants researchers and evaluators to assess and understand the consequences of their work. Using ICR with clinical data such as interviews and other qualitative sources can be utilized to teach trainees the method in counseling research and evaluation and help make visible the important contributions of qualitative research using collaborative teams in counselor education.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0748-1756
1947-6302
DOI:10.1080/07481756.2024.2303715