Events Data as Bismarck's Sausages? Intercoder Reliability, Coders' Selection, and Data Quality

Precise measurement is difficult but essential in the generation of high-quality data, and it is therefore remarkable that often so little attention is paid to intercoder reliability. It is commonly recognized that poor validity leads to systematic errors and biased inference. In contrast, low relia...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:International interactions Ročník 37; číslo 3; s. 340 - 361
Hlavní autoři: Ruggeri, Andrea, Gizelis, Theodora-Ismene, Dorussen, Han
Médium: Journal Article
Jazyk:angličtina
Vydáno: Abingdon Taylor & Francis Group 01.07.2011
Taylor & Francis Ltd
Témata:
Bias
coders
Coding
Data analysis
Data collection
Data Quality
Error
Errors
events data
Governance
Inference
Measurement
Peace keeping
Peacekeeping
Peacekeeping forces
Political science research
Reliability
Test validity and reliability
United Nations
Validity
ISSN:0305-0629, 1547-7444
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Precise measurement is difficult but essential in the generation of high-quality data, and it is therefore remarkable that often so little attention is paid to intercoder reliability. It is commonly recognized that poor validity leads to systematic errors and biased inference. In contrast, low reliability is generally assumed to be a lesser concern, leading only to random errors and inefficiency. We evaluate the intercoder reliability of our recently collected data on governance events in UN peacekeeping and show how poor coding and low intercoder reliability can produce systematic errors and even biased inference. We also show how intercoder reliability checks are useful to improve data quality. Continuous testing for intercoder reliability ex post enables researchers to create better data and ultimately improves the quality of their analyses.
Bibliografie:SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 14
ObjectType-Article-2
content type line 23
ObjectType-Article-1
ObjectType-Feature-2
ISSN:0305-0629
1547-7444
DOI:10.1080/03050629.2011.596028