Reliability of Identification of Behavior Change Techniques in Intervention Descriptions

Purpose The aim of this paper is to assess the frequency of identification as well as the inter-coder and test–retest reliability of identification of behavior change techniques (BCTs) in written intervention descriptions. Methods Forty trained coders applied the “Behavior Change Technique Taxonomy...

Full description

Saved in:
Bibliographic Details
Published in:Annals of behavioral medicine Vol. 49; no. 6; pp. 885 - 900
Main Authors: Abraham, Charles, Wood, Caroline E, Johnston, Marie, Francis, Jill, Hardeman, Wendy, Richardson, Michelle, Michie, Susan
Format: Journal Article
Language:English
Published: New York Springer US 01.12.2015
Oxford University Press
Subjects:
Behavior modification
Behavior Therapy - methods
Cognitive therapy
Family Medicine
General Practice
Health Behavior
Health Psychology
Humans
Intervention
Medicine
Medicine & Public Health
Original Article
Reliability
Reproducibility of Results
Taxonomy
Intervention
Behavior change
Test–retest reliability
Behavior change technique
Taxonomy
Inter-coder reliability
ISSN:0883-6612, 1532-4796, 1532-4796
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Purpose The aim of this paper is to assess the frequency of identification as well as the inter-coder and test–retest reliability of identification of behavior change techniques (BCTs) in written intervention descriptions. Methods Forty trained coders applied the “Behavior Change Technique Taxonomy version 1” (BCTTv1) to 40 intervention descriptions published in protocols and repeated this 1 month later. Results Eighty of 93 defined BCTs were identified by at least one trained coder, and 22 BCTs were identified in 16 (40 %) or more of 40 descriptions. Good inter-coder reliability was observed across 80 BCTs identified in the protocols: 66 (80 %) achieved mean prevalence and bias-adjusted kappa (PABAK) scores of 0.70 or greater, and 59 (74 %) achieved mean scores of 0.80 or greater. There was good within-coder agreement between baseline and 1 month, demonstrating good test–retest reliability. Conclusions BCTTv1 can be used by trained coders to identify BCTs in intervention descriptions reliably. However, some frequently occurring BCT definitions require further clarification.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
ObjectType-Undefined-3
ISSN:0883-6612
1532-4796
1532-4796
DOI:10.1007/s12160-015-9727-y