Search Results - Measures of inter-coder agreement

A Bayesian index of association: comparison with other measures and performance by Oleinik, Anton

“…The article discusses a Bayesian measure of association, B-index, and compares it with the other existing measures of agreement, association, and similarity…”
Get full text

Assessment of prelinguistic vocalizations in real time: a comparison with phonetic transcription and assessment of inter-coder-reliability by Willadsen, Elisabeth, Persson, Christina, Patrick, Kathryn, Lohmander, Anette, Oller, D. Kimbrough

“… A second study also examined inter-coder reliability for canonical babbling, canonical babbling ratio and presence of oral stops in syllable inventory of infants with cleft palate, by means of NLRT…”
Get full text

Inter-Coder Agreement in One-to-Many Classification: Fuzzy Kappa by Kirilenko, Andrei P., Stepchenkova, Svetlana

“…), this requirement seems overly restrictive. The restriction could be lifted, provided that there is a measure to calculate the inter-coder agreement in the one-to-many protocol…”
Get full text

Reliability in software engineering qualitative research through Inter-Coder Agreement by González-Prieto, Ángel, Perez, Jorge, Diaz, Jessica, López-Fernández, Daniel

“… on. This paper aims to establish a novel theoretical framework that enables a methodological approach for conducting this validity analysis through Inter-Coder Agreement (ICA…”
Get full text

DevOps Research-Based Teaching Using Qualitative Research and Inter-Coder Agreement by Perez, Jorge E., Gonzalez-Prieto, Angel, Diaz, Jessica, Lopez-Fernandez, Daniel, Garcia-Martin, Javier, Yague, Agustin

“…DevOps is becoming a main competency required by the software industry. However, academic institutions have been slow to provide DevOps training in software…”
Get full text

Stability and reproducibility of semi-quantitative risk assessment methods within the occupational health and safety scope by Carvalho, F, Melo, R B

“… This paper reports a study about risk assessments' reliability, namely both inter-coder (reproducibility) and intra-coder (stability) reliability of the semi-quantitative approach…”
Get more information

Applying the behaviour change technique (BCT) taxonomy v1: a study of coder training by Wood, Caroline E, Richardson, Michelle, Johnston, Marie, Abraham, Charles, Francis, Jill, Hardeman, Wendy, Michie, Susan

“… The following measures were taken before and after training: (i) inter-coder agreement, (ii) trainee agreement with expert consensus, (iii…”
Get full text

Evaluation of Cohen's kappa and other measures of inter-rater agreement for genre analysis and other nominal data by Rau, Gerald, Shih, Yu-Shan

“…Cohen's kappa (κ) is often recommended for nominal data as a measure of inter-rater (inter-coder…”
Get full text

Navigating the Digital Transformation Landscape in Indonesia: A Qualitative Sectoral Analysis by Haryanti, Tining, Rakhmawati, Nur Aini, Subriadi, Apol Pribadi

“…This study explores the factors influencing digital transformation (DX) in Indonesia through a qualitative analysis of various sectors, focusing on C-level…”
Get full text

Detection of Opinion Communities with the Help of Chance-Corrected Measures of Agreement by Oleinik, Anton

“…This paper discusses the feasibility and benefits of incorporating coefficients of inter-coder agreement (Krippendorff’s α…”
Get full text

Inter-Coder Agreement for Nominal Scales: A Model-based Approach by Schuster, Dirk

“…Inter-coder agreement measures, like Cohen's kappa, correct the relative frequency of agreement between coders to account for agreement which simply occurs by chance…”
Get full text

Assessing the inter-coder reliability of the Body Type Dictionary (BTD) by Cariola, Laura A.

“…) based on Fisher and Cleveland’s (1956, 1958) manual body boundary scoring scheme. The results indicated an acceptable inter-coder agreement with barrier and penetration imagery in the sub-sample (N = 53…”
Get full text

Methods of diagnosis and rehabilitation of dysphagia in patients with spinal cord injury: a systematic review by ZUPO, Roberta, POGGI, Beatrice, CAGGIANO, Nicole, VARRONE, Giulio, CASTELLANA, Fabio, NATOLI, Silvia, SARDONE, Rodolfo, NARDONE, Antonio, PAVESE, Chiara

“…Latest epidemiological metrics put a global prevalence of 20.6 million people suffering from spinal cord injury (SCI), leading to a burden of functional…”
Get full text

Conversational agents in healthcare: a systematic review by Laranjo, Liliana, Dunn, Adam G, Tong, Huong Ly, Kocaballi, Ahmet Baki, Chen, Jessica, Bashir, Rabia, Surian, Didi, Gallego, Blanca, Magrabi, Farah, Lau, Annie Y S, Coiera, Enrico

“…; and reported evaluation measures resulting from user interaction with the system. Studies were screened by independent reviewers and Cohen's kappa measured inter-coder agreement…”
Get more information

When coders are reliable: The application of three measures to assess inter-rater reliability/agreement with doctor–patient communication data coded with the VR-CoDES by Fletcher, Ian, Mazzi, Mariangela, Nuebling, Matthias

“…To investigate whether different measures of inter-rater reliability will compute similar estimates with nominal data commonly encountered in communication studies…”
Get full text

Individuals with lumbar spinal stenosis seek education and care focused on self-management—results of focus groups among participants enrolled in a randomized controlled trial by Lynch, Andrew D., Bove, Allyn M., Ammendolia, Carlo, Schneider, Michael

“…The effectiveness of treatments for chronic, degenerative conditions of the lumbar spine can be influenced by patient perceptions and expectations regarding…”
Get full text

Sentiment Analysis of Suicide Notes: A Shared Task by Pestian, John P., Matykiewicz, Pawel, Linn-Gust, Michelle, South, Brett, Uzuner, Ozlem, Wiebe, Jan, Cohen, K. Bretonnel, Hurdle, John, Brew, Christopher

“… The number of participants was larger than in any previous biomedical challenge task. We describe the data production process and the evaluation measures, and give a preliminary analysis of the results…”
Get full text

Illuminating collaboration in emergency health care situations: paramedic-physician collaboration and 3D telepresence technology by Sonnenwald, Diane H, Soderholm, Hanna Maurin, Welch, Gregory F, Cairns, Bruce A, Manning, James E, Fuchs, Henry

“… of 0.82 using Cohen's kappa inter-coder reliability measure was reached. After coding was completed themes and relationships among codes were synthesised using topic memos. Results…”
Get full text

An Inquiry Into the Use of Intercoder Reliability Measures in Qualitative Research by Wilson-Lopez, Amy, Minichiello, Angela, Green, Theresa

“…In this theory paper, we set out to consider, as a matter of methodological interest, the use of quantitative measures of inter-coder reliability (e.g…”
Get full text

An empirical look at the Defense Mechanism Test (DMT): Reliability and construct validity by EKEHAMMAR, BO, ZUBER, IRENA, KONSTENIUS, MARJA-LIISA

“… Thus, based on data from 39 female students, we first examined DMT inter‐coder reliability by analyzing the agreement among trained judges in their coding of the same DMT protocols…”
Get full text