Reliability in Coding Open-Ended Data: Lessons Learned from HIV Behavioral Research

Analysis of text from open-ended interviews has become an important research tool in numerous fields, including business, education, and health research. Coding is an essential part of such analysis, but questions of quality control in the coding process have generally received little attention. Thi...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Field methods Ročník 16; číslo 3; s. 307 - 331
Hlavní autori: Hruschka, Daniel J., Schwartz, Deborah, St.John, Daphne Cobb, Picone-Decaro, Erin, Jenkins, Richard A., Carey, James W.
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: Thousand Oaks, CA Sage Publications 01.08.2004
SAGE PUBLICATIONS, INC
Predmet:
Acquired Immune Deficiency Syndrome
AIDS
Coding
Data analysis
Disease control
Health education
Health research
Health services
HIV
Human immunodeficiency virus
Interviews
Mental health
Methodological Problems
Methodology
Methodology (Data Analysis)
Qualitative analysis
Quality
Quality control
Reliability
Research methodology
Research methods
Research Tools
United States of America
Zimbabwe
intercoder agreement
data
qualitative
interrater agreement
open-ended
reliability
ISSN:1525-822X, 1552-3969
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:Analysis of text from open-ended interviews has become an important research tool in numerous fields, including business, education, and health research. Coding is an essential part of such analysis, but questions of quality control in the coding process have generally received little attention. This article examines the text coding process applied to three HIV-related studies conducted with the Centers for Disease Control and Prevention considering populations in the United States and Zimbabwe. Based on experience coding data from these studies, we conclude that (1) a team of coders will initially produce very different codings, but (2) it is possible, through a process of codebook revision and recoding, to establish strong levels of intercoder reliability (e.g., most codes with kappa 0.8). Furthermore, steps can be taken to improve initially poor intercoder reliability and to reduce the number of iterations required to generate stronger intercoder reliability.
Bibliografia:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ObjectType-Article-2
ObjectType-Feature-1
content type line 23
ISSN:1525-822X
1552-3969
DOI:10.1177/1525822X04266540