Interventions to optimise the outputs of national clinical audits to improve the quality of health care: a multi-method study including RCT

Background: National clinical audit programmes aim to improve patient care by reviewing performance against explicit standards and directing action towards areas not meeting those standards. Their impact can be improved by (1) optimising feedback content and format, (2) strengthening audit cycles an...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Health and social care delivery research Jg. 10; H. 15; S. 1 - 284
Hauptverfasser: Willis, Thomas A, Wright-Hughes, Alexandra, Weller, Ana, Alderson, Sarah L, Wilson, Stephanie, Walwyn, Rebecca, Wood, Su, Lorencatto, Fabiana, Farrin, Amanda, Hartley, Suzanne, Francis, Jillian, Seymour, Valentine, Brehaut, Jamie, Colquhoun, Heather, Grimshaw, Jeremy, Ivers, Noah, Feltbower, Richard, Keen, Justin, Brown, Benjamin C, Presseau, Justin, Gale, Chris P, Stanworth, Simon J, Foy, Robbie
Format: Journal Article
Sprache:Englisch
Veröffentlicht: NIHR Journals Library 01.06.2022
Schlagworte:
behavioural sciences
clinical audit
factorial
implementation
quality improvement
randomised controlled trial
user-computer interface
ISSN:2755-0060, 2755-0079
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract Background: National clinical audit programmes aim to improve patient care by reviewing performance against explicit standards and directing action towards areas not meeting those standards. Their impact can be improved by (1) optimising feedback content and format, (2) strengthening audit cycles and (3) embedding randomised trials evaluating different ways of delivering feedback. Objectives: The objectives were to (1) develop and evaluate the effects of modifications to feedback on recipient responses, (2) identify ways of strengthening feedback cycles for two national audits and (3) explore opportunities, costs and benefits of national audit participation in a programme of trials. Design: An online fractional factorial screening experiment (objective 1) and qualitative interviews (objectives 2 and 3). Setting and participants: Participants were clinicians and managers involved in five national clinical audits – the National Comparative Audit of Blood Transfusions, the Paediatric Intensive Care Audit Network, the Myocardial Ischaemia National Audit Project, the Trauma Audit & Research Network and the National Diabetes Audit – (objective 1); and clinicians, members of the public and researchers (objectives 2 and 3). Interventions: We selected and developed six online feedback modifications through three rounds of user testing. We randomised participants to one of 32 combinations of the following recommended specific actions: comparators reinforcing desired behaviour change; multimodal feedback; minimised extraneous cognitive load for feedback recipients; short, actionable messages followed by optional detail; and incorporating ‘the patient voice’ (objective 1). Main outcome measures: The outcomes were intended actions, including enactment of audit standards (primary outcome), comprehension, user experience and engagement (objective 1). Results: For objective 1, the primary analysis included 638 randomised participants, of whom 566 completed the outcome questionnaire. No modification independently increased intended enactment of audit standards. Minimised cognitive load improved comprehension (+0.1; p = 0.014) and plans to bring audit findings to colleagues’ attention (+0.13, on a –3 to +3 scale; p = 0.016). We observed important cumulative synergistic and antagonistic interactions between modifications, participant role and national audit. The analysis in objective 2 included 19 interviews assessing the Trauma Audit Research Network and the National Diabetes Audit. The identified ways of strengthening audit cycles included making performance data easier to understand and guiding action planning. The analysis in objective 3 identified four conditions for effective collaboration from 31 interviews: compromise – recognising capacity and constraints; logistics – enabling data sharing, audit quality and funding; leadership – engaging local stakeholders; and relationships – agreeing shared priorities and needs. The perceived benefits of collaboration outweighed the risks. Limitations: The online experiment assessed intended enactment as a predictor of actual clinical behaviour. Interviews and surveys were subject to social desirability bias. Conclusions: National audit impacts may be enhanced by strengthening all aspects of feedback cycles, particularly effective feedback, and considering how different ways of reinforcing feedback act together. Future work: Embedded randomised trials evaluating different ways of delivering feedback within national clinical audits are acceptable and may offer efficient, evidence-based and cumulative improvements in outcomes. Trial registration: This trial is registered as ISRCTN41584028. Funding details: This project was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme and will be published in full in Health and Social Care Delivery Research; Vol. 10, No. 15. See the NIHR Journals Library website for further project information.
AbstractList Background: National clinical audit programmes aim to improve patient care by reviewing performance against explicit standards and directing action towards areas not meeting those standards. Their impact can be improved by (1) optimising feedback content and format, (2) strengthening audit cycles and (3) embedding randomised trials evaluating different ways of delivering feedback. Objectives: The objectives were to (1) develop and evaluate the effects of modifications to feedback on recipient responses, (2) identify ways of strengthening feedback cycles for two national audits and (3) explore opportunities, costs and benefits of national audit participation in a programme of trials. Design: An online fractional factorial screening experiment (objective 1) and qualitative interviews (objectives 2 and 3). Setting and participants: Participants were clinicians and managers involved in five national clinical audits – the National Comparative Audit of Blood Transfusions, the Paediatric Intensive Care Audit Network, the Myocardial Ischaemia National Audit Project, the Trauma Audit & Research Network and the National Diabetes Audit – (objective 1); and clinicians, members of the public and researchers (objectives 2 and 3). Interventions: We selected and developed six online feedback modifications through three rounds of user testing. We randomised participants to one of 32 combinations of the following recommended specific actions: comparators reinforcing desired behaviour change; multimodal feedback; minimised extraneous cognitive load for feedback recipients; short, actionable messages followed by optional detail; and incorporating ‘the patient voice’ (objective 1). Main outcome measures: The outcomes were intended actions, including enactment of audit standards (primary outcome), comprehension, user experience and engagement (objective 1). Results: For objective 1, the primary analysis included 638 randomised participants, of whom 566 completed the outcome questionnaire. No modification independently increased intended enactment of audit standards. Minimised cognitive load improved comprehension (+0.1; p = 0.014) and plans to bring audit findings to colleagues’ attention (+0.13, on a –3 to +3 scale; p = 0.016). We observed important cumulative synergistic and antagonistic interactions between modifications, participant role and national audit. The analysis in objective 2 included 19 interviews assessing the Trauma Audit Research Network and the National Diabetes Audit. The identified ways of strengthening audit cycles included making performance data easier to understand and guiding action planning. The analysis in objective 3 identified four conditions for effective collaboration from 31 interviews: compromise – recognising capacity and constraints; logistics – enabling data sharing, audit quality and funding; leadership – engaging local stakeholders; and relationships – agreeing shared priorities and needs. The perceived benefits of collaboration outweighed the risks. Limitations: The online experiment assessed intended enactment as a predictor of actual clinical behaviour. Interviews and surveys were subject to social desirability bias. Conclusions: National audit impacts may be enhanced by strengthening all aspects of feedback cycles, particularly effective feedback, and considering how different ways of reinforcing feedback act together. Future work: Embedded randomised trials evaluating different ways of delivering feedback within national clinical audits are acceptable and may offer efficient, evidence-based and cumulative improvements in outcomes. Trial registration: This trial is registered as ISRCTN41584028. Funding details: This project was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme and will be published in full in Health and Social Care Delivery Research; Vol. 10, No. 15. See the NIHR Journals Library website for further project information.
Author Grimshaw, Jeremy
Feltbower, Richard
Willis, Thomas A
Brehaut, Jamie
Keen, Justin
Presseau, Justin
Hartley, Suzanne
Weller, Ana
Wilson, Stephanie
Lorencatto, Fabiana
Alderson, Sarah L
Foy, Robbie
Farrin, Amanda
Ivers, Noah
Gale, Chris P
Colquhoun, Heather
Stanworth, Simon J
Wood, Su
Wright-Hughes, Alexandra
Walwyn, Rebecca
Francis, Jillian
Seymour, Valentine
Brown, Benjamin C
Author_xml – sequence: 1
  givenname: Thomas A
  orcidid: 0000-0002-0252-9923
  surname: Willis
  fullname: Willis, Thomas A
  organization: Leeds Institute of Health Sciences, University of Leeds, Leeds, UK
– sequence: 2
  givenname: Alexandra
  orcidid: 0000-0001-8839-6756
  surname: Wright-Hughes
  fullname: Wright-Hughes, Alexandra
  organization: Leeds Institute of Clinical Trials Research, University of Leeds, Leeds, UK
– sequence: 3
  givenname: Ana
  orcidid: 0000-0001-6915-6095
  surname: Weller
  fullname: Weller, Ana
  organization: Centre for Human-Computer Interaction Design, City, University of London, London, UK
– sequence: 4
  givenname: Sarah L
  orcidid: 0000-0002-5418-0495
  surname: Alderson
  fullname: Alderson, Sarah L
  organization: Leeds Institute of Health Sciences, University of Leeds, Leeds, UK
– sequence: 5
  givenname: Stephanie
  orcidid: 0000-0001-6445-654X
  surname: Wilson
  fullname: Wilson, Stephanie
  organization: Centre for Human-Computer Interaction Design, City, University of London, London, UK
– sequence: 6
  givenname: Rebecca
  orcidid: 0000-0001-9120-1438
  surname: Walwyn
  fullname: Walwyn, Rebecca
  organization: Leeds Institute of Clinical Trials Research, University of Leeds, Leeds, UK
– sequence: 7
  givenname: Su
  orcidid: 0000-0003-3747-3672
  surname: Wood
  fullname: Wood, Su
  organization: Leeds Institute of Health Sciences, University of Leeds, Leeds, UK
– sequence: 8
  givenname: Fabiana
  orcidid: 0000-0003-4418-7957
  surname: Lorencatto
  fullname: Lorencatto, Fabiana
  organization: Centre for Behaviour Change, University College London, London, UK
– sequence: 9
  givenname: Amanda
  orcidid: 0000-0002-2876-0584
  surname: Farrin
  fullname: Farrin, Amanda
  organization: Leeds Institute of Clinical Trials Research, University of Leeds, Leeds, UK
– sequence: 10
  givenname: Suzanne
  orcidid: 0000-0003-2346-9461
  surname: Hartley
  fullname: Hartley, Suzanne
  organization: Leeds Institute of Clinical Trials Research, University of Leeds, Leeds, UK
– sequence: 11
  givenname: Jillian
  orcidid: 0000-0001-5784-8895
  surname: Francis
  fullname: Francis, Jillian
  organization: School of Health Sciences, City, University of London, London, UK
– sequence: 12
  givenname: Valentine
  orcidid: 0000-0001-8264-3875
  surname: Seymour
  fullname: Seymour, Valentine
  organization: School of Health Sciences, City, University of London, London, UK
– sequence: 13
  givenname: Jamie
  orcidid: 0000-0002-4213-1143
  surname: Brehaut
  fullname: Brehaut, Jamie
  organization: Ottawa Hospital Research Institute, Ottawa, ON, Canada
– sequence: 14
  givenname: Heather
  orcidid: 0000-0002-6226-2511
  surname: Colquhoun
  fullname: Colquhoun, Heather
  organization: Department of Occupational Science and Occupational Therapy, University of Toronto, Toronto, ON, Canada
– sequence: 15
  givenname: Jeremy
  orcidid: 0000-0001-8015-8243
  surname: Grimshaw
  fullname: Grimshaw, Jeremy
  organization: Ottawa Hospital Research Institute, Ottawa, ON, Canada
– sequence: 16
  givenname: Noah
  orcidid: 0000-0003-2500-2435
  surname: Ivers
  fullname: Ivers, Noah
  organization: Women’s College Hospital, Toronto, ON, Canada
– sequence: 17
  givenname: Richard
  orcidid: 0000-0002-1728-9408
  surname: Feltbower
  fullname: Feltbower, Richard
  organization: Leeds Institute for Data Analytics, University of Leeds, Leeds, UK
– sequence: 18
  givenname: Justin
  orcidid: 0000-0003-2753-8276
  surname: Keen
  fullname: Keen, Justin
  organization: Leeds Institute of Health Sciences, University of Leeds, Leeds, UK
– sequence: 19
  givenname: Benjamin C
  orcidid: 0000-0001-9975-4782
  surname: Brown
  fullname: Brown, Benjamin C
  organization: Centre for Health Informatics, University of Manchester, Manchester, UK, Centre for Primary Care, University of Manchester, Manchester, UK
– sequence: 20
  givenname: Justin
  orcidid: 0000-0002-2132-0703
  surname: Presseau
  fullname: Presseau, Justin
  organization: Ottawa Hospital Research Institute, Ottawa, ON, Canada, School of Epidemiology and Public Health, University of Ottawa, Ottawa, ON, Canada
– sequence: 21
  givenname: Chris P
  orcidid: 0000-0003-4732-382X
  surname: Gale
  fullname: Gale, Chris P
  organization: Leeds Institute for Data Analytics, University of Leeds, Leeds, UK, Leeds Institute of Cardiovascular and Metabolic Medicine, University of Leeds, Leeds, UK, Department of Cardiology, Leeds Teaching Hospitals NHS Trust, Leeds, UK
– sequence: 22
  givenname: Simon J
  orcidid: 0000-0002-7414-4950
  surname: Stanworth
  fullname: Stanworth, Simon J
  organization: Transfusion Medicine, NHS Blood and Transplant (NHSBT), Oxford, UK, Department of Haematology, Oxford University Hospitals NHS Foundation Trust, Oxford, UK, Radcliffe Department of Medicine, University of Oxford, Oxford, UK, NIHR Oxford Biomedical Research Centre, Oxford, UK
– sequence: 23
  givenname: Robbie
  orcidid: 0000-0003-0605-7713
  surname: Foy
  fullname: Foy, Robbie
  organization: Leeds Institute of Health Sciences, University of Leeds, Leeds, UK
BookMark eNo9kctKAzEYhYNUUKvgI2TpZjS3mUzcafFSKIhSN26GTC42MpPUJFPoM_jS9qJd_Yef832bcwZGPngDwCVG15RidPN6f_-BMWFH4JTwsiwQ4mJ0yBU6ARcpuRaxWnCECD0FP1OfTVwZn13wCeYAwzK73iUD88LAMOTlkBMMFnq5rcgOqs55pzZBDtrlHeP6ZQyrPfI9yM7l9RZZGNnlBVQymlsoYT902RW9yYugYcqDXkPnVbex-E_4Npmfg2Mru2Qu_u4YvD8-zCfPxezlaTq5mxUKU8qKilYtK1kpia5taVRd28rWvG0JaauyMkQZJgjhGmsqGONcYs4Zk5zaSlDc0jGY7r06yK9mGV0v47oJ0jW7R4ifjYzZqc40Uoi2xLzWxHKm6lYojonQ2mrBK1Hqjetq71IxpBSNPfgwarabNP-b0F89FoHY
Cites_doi 10.1186/1748-5908-3-36
10.1186/s13012-017-0605-9
10.1186/s13012-019-0887-1
10.1109/RE.2005.34
10.1017/S026646231000108X
10.1186/1748-5908-1-4
10.1016/j.athoracsur.2015.04.012
10.1186/s13012-017-0615-7
10.1080/10629360600810434
10.1177/1084822317700883
10.1136/bmjqs-2018-008355
10.1001/jama.286.23.2988
10.7326/M15-2248
10.1186/1472-6947-13-S2-S7
10.1377/hlthaff.26.2.w107
10.1186/1472-6963-5-50
10.1186/s13012-016-0479-2
10.3310/hta8060
10.1136/bmjqs-2015-004795
10.1016/j.ijmedinf.2016.07.010
10.1007/978-1-4612-5887-2
10.1186/s43058-022-00275-5
10.1007/s12529-008-9023-3
10.1186/s43058-020-00019-3
10.1136/bmjqs-2015-004197
10.1186/1748-5908-7-50
10.1016/j.socscimed.2004.08.072
10.1111/j.1365-2923.2010.03849.x
10.1111/j.1365-2923.2009.03580.x
10.1080/10447318.2015.1064648
10.1056/NEJMsb1900856
10.1080/00224545.1994.9922999
10.1136/bmj.i4079
10.1186/s13012-014-0092-1
10.1136/qhc.0100152
10.1186/s13012-014-0168-y
10.1002/14651858.CD000259.pub3
10.1007/s12160-014-9609-8
10.3310/hta19990
10.1037/0033-2909.119.2.254
10.1080/10447318.2015.1064654
10.1136/bmjqs-2019-009948
10.1177/13558196211044321
10.1080/08870440903194015
10.1136/bmj.317.7162.858
10.1177/1355819613498859
10.1186/s43058-020-00089-3
10.3310/hta2030
10.1136/bmjopen-2015-010276
10.1186/s13012-019-0951-x
10.1136/bmj.a1961
10.1111/1468-0009.00206
10.1080/01421590600622665
10.1038/sj.bdj.4810565
10.1186/s13012-019-0883-5
10.1371/journal.pone.0055067
10.1186/1748-5908-9-14
10.1186/s13012-017-0646-0
10.1136/bmj.39317.641296.AD
10.1111/1475-6773.12508
10.1016/j.amepre.2007.01.022
10.1145/2470654.2481287
10.1371/journal.pone.0067611
10.1080/14719037.2010.488861
10.1186/1748-5908-1-28
10.1136/bmj.i2021
10.1109/BELIV.2018.8634027
10.1002/sim.3643
10.1186/1748-5908-6-42
10.1186/s13012-017-0614-8
10.1136/bmj.i2976
10.1097/ACM.0000000000000809
10.1177/0962280206074463
10.1177/1049732320921835
10.1371/journal.pone.0206676
10.1191/1478088706qp063oa
10.1136/bmjopen-2017-019993
10.1111/jcom.12007
10.1093/biomet/63.3.581
10.1136/bmj.328.7435.343
10.3310/pgfar08040
10.1186/1748-5908-4-50
10.1186/1748-5908-5-51
10.1016/S0895-4356(02)00403-1
10.1093/ehjqcco/qcz052
10.1186/s13012-019-0853-y
10.3310/hsdr03250
10.1097/00005650-198608000-00001
10.1108/14777261311321770
10.1097/MLR.0b013e3181893f6b
10.1136/bmjqs-2017-006954
10.1136/bmj.m213
10.1023/B:AHSE.0000038172.97337.d5
10.1186/s13012-022-01208-5
10.1177/1355819613499903
10.1002/14651858.CD005470.pub3
10.1136/bmj.a1655
10.1136/bmjqs-2019-009588
10.1016/S0140-6736(16)31256-9
10.1186/1748-5908-3-8
10.1371/journal.pmed.1003045
10.1016/s1070-3241(01)27051-5
10.1136/bmj.d3514
10.1186/s13012-018-0727-8
10.1001/jama.2016.10766
10.1007/s11606-014-2913-y
10.1007/s11606-020-05865-4
ContentType Journal Article
DBID AAYXX
CITATION
DOA
DOI 10.3310/QBBZ1124
DatabaseName CrossRef
DOAJ
DatabaseTitle CrossRef
DatabaseTitleList
Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ Directory of Open Access Journals
  url: https://www.doaj.org/
  sourceTypes: Open Website
DeliveryMethod fulltext_linktorsrc
Discipline Public Health
EISSN 2755-0079
EndPage 284
ExternalDocumentID oai_doaj_org_article_a99b5178d2f74c8b9c7129ddfd97695d
10_3310_QBBZ1124
GroupedDBID AAYXX
ALMA_UNASSIGNED_HOLDINGS
CITATION
GROUPED_DOAJ
ID FETCH-LOGICAL-c1334-636b4545a2d8f5ec88f6f87bb22b656e2ce49227d1d394477a17744a73f6931b3
IEDL.DBID DOA
ISSN 2755-0060
IngestDate Fri Oct 03 12:36:49 EDT 2025
Sat Nov 29 06:04:27 EST 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 15
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c1334-636b4545a2d8f5ec88f6f87bb22b656e2ce49227d1d394477a17744a73f6931b3
ORCID 0000-0001-8839-6756
0000-0003-2346-9461
0000-0003-2500-2435
0000-0002-7414-4950
0000-0001-9975-4782
0000-0002-2876-0584
0000-0003-4732-382X
0000-0002-5418-0495
0000-0002-0252-9923
0000-0001-5784-8895
0000-0001-8264-3875
0000-0001-9120-1438
0000-0001-6915-6095
0000-0003-4418-7957
0000-0003-2753-8276
0000-0002-4213-1143
0000-0001-8015-8243
0000-0003-3747-3672
0000-0001-6445-654X
0000-0002-6226-2511
0000-0002-1728-9408
0000-0002-2132-0703
0000-0003-0605-7713
OpenAccessLink https://doaj.org/article/a99b5178d2f74c8b9c7129ddfd97695d
PageCount 284
ParticipantIDs doaj_primary_oai_doaj_org_article_a99b5178d2f74c8b9c7129ddfd97695d
crossref_primary_10_3310_QBBZ1124
PublicationCentury 2000
PublicationDate 2022-6-00
2022-06-01
PublicationDateYYYYMMDD 2022-06-01
PublicationDate_xml – month: 06
  year: 2022
  text: 2022-6-00
PublicationDecade 2020
PublicationTitle Health and social care delivery research
PublicationYear 2022
Publisher NIHR Journals Library
Publisher_xml – name: NIHR Journals Library
References Gould (key20220624155138097_ref1-bib25) 2014; 9
Kortteisto (key20220624155138097_ref1-bib83) 2010; 5
Brown (key20220624155138097_ref1-bib73) 2016; 94
key20220624155138097_ref1-bib1
Godin (key20220624155138097_ref1-bib42) 2008; 3
Eccles (key20220624155138097_ref1-bib81) 2006; 1
Collins (key20220624155138097_ref1-bib91) 2007; 32
Archer-Kath (key20220624155138097_ref1-bib52) 1994; 134
Eccles (key20220624155138097_ref1-bib71) 2009; 16
Collins (key20220624155138097_ref1-bib34) 2018
National Institute for Health and Care Excellence (key20220624155138097_ref1-bib133)
Foy (key20220624155138097_ref1-bib106) 2020; 8
The International Organisation for Standardisation (key20220624155138097_ref1-bib87) 2018
Walwyn (key20220624155138097_ref1-bib115)
Francis (key20220624155138097_ref1-bib118) 2010; 25
Vindrola-Padros (key20220624155138097_ref1-bib103) 2020; 30
Reiter (key20220624155138097_ref1-bib65) 2004; 9
Braun (key20220624155138097_ref1-bib123) 2006; 3
Foy (key20220624155138097_ref1-bib48) 2002; 55
Borsci (key20220624155138097_ref1-bib89) 2015; 31
Ivers (key20220624155138097_ref1-bib11) 2012; 6
Etheredge (key20220624155138097_ref1-bib124) 2007; 26
TARN (key20220624155138097_ref1-bib32) 2021
Gude (key20220624155138097_ref1-bib96) 2017; 26
Lawton (key20220624155138097_ref1-bib56) 2016; 11
Lavis (key20220624155138097_ref1-bib59) 2010; 26
Gould (key20220624155138097_ref1-bib26) 2018; 13
Mitchell (key20220624155138097_ref1-bib46) 2005; 55
National Institute for Health and Care Excellence (key20220624155138097_ref1-bib134)
Trevena (key20220624155138097_ref1-bib82) 2013; 13
Colquhoun (key20220624155138097_ref1-bib72) 2017; 12
Stetler (key20220624155138097_ref1-bib121) 2008; 3
Rubin (key20220624155138097_ref1-bib39) 2008
McCleary (key20220624155138097_ref1-bib112) 2020; 1
Soper (key20220624155138097_ref1-bib128) 2015; 3
Foy (key20220624155138097_ref1-bib4) 2016; 6
Dickinson (key20220624155138097_ref1-bib114) 2010; 12
Presseau (key20220624155138097_ref1-bib45) 2019; 14
PICANet (key20220624155138097_ref1-bib31) 2021
Guthrie (key20220624155138097_ref1-bib3) 2011; 342
Ferlie (key20220624155138097_ref1-bib55) 2001; 79
Bonetti (key20220624155138097_ref1-bib70) 2003; 195
Wright-Hughes (key20220624155138097_ref1-bib76) 2022; 17
National Institute for Health and Care Excellence (key20220624155138097_ref1-bib135)
Ross (key20220624155138097_ref1-bib105) 2016; 25
Opiyo (key20220624155138097_ref1-bib58) 2013; 8
Baker (key20220624155138097_ref1-bib57) 2015; 4
Wu (key20220624155138097_ref1-bib79) 2011
Ivers (key20220624155138097_ref1-bib28) 2016; 388
Ivanovic (key20220624155138097_ref1-bib67) 2015; 100
Overeem (key20220624155138097_ref1-bib66) 2010; 44
Lilford (key20220624155138097_ref1-bib75) 2007; 335
Box (key20220624155138097_ref1-bib77) 1978
Gray-Burrows (key20220624155138097_ref1-bib126) 2018; 27
The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG) (key20220624155138097_ref1-bib22) 2006; 1
Hysong (key20220624155138097_ref1-bib61) 2009; 47
Grol (key20220624155138097_ref1-bib47) 1998; 317
Hoomans (key20220624155138097_ref1-bib15) 2014; 9
Presseau (key20220624155138097_ref1-bib84) 2014; 48
Tierney (key20220624155138097_ref1-bib51) 1986; 24
Atkins (key20220624155138097_ref1-bib122) 2017; 12
Perry (key20220624155138097_ref1-bib8) 2016; 353
Oakes (key20220624155138097_ref1-bib109) 2020; 29
Ivers (key20220624155138097_ref1-bib20) 2014; 29
Guthrie (key20220624155138097_ref1-bib18) 2016; 354
Gale (key20220624155138097_ref1-bib101) 2019; 14
Horwitz (key20220624155138097_ref1-bib110) 2019; 381
Martin (key20220624155138097_ref1-bib113) 2013; 27
Wilkinson (key20220624155138097_ref1-bib29) 2020; 6
Lewis (key20220624155138097_ref1-bib88)
Carver (key20220624155138097_ref1-bib49) 1981
Hall (key20220624155138097_ref1-bib6) 2016; 316
Brown (key20220624155138097_ref1-bib27) 2019; 14
Lewis (key20220624155138097_ref1-bib90) 2015; 31
Willis (key20220624155138097_ref1-bib97) 2022; 3
Roos-Blom (key20220624155138097_ref1-bib43) 2019; 28
Grimshaw (key20220624155138097_ref1-bib111) 2019; 28
Rycroft-Malone (key20220624155138097_ref1-bib119) 2013; 18
Eccles (key20220624155138097_ref1-bib36) 2009; 16
Hibbard (key20220624155138097_ref1-bib54) 2001; 27
Murphy (key20220624155138097_ref1-bib85) 2013; 63
Kluger (key20220624155138097_ref1-bib62) 2010; 44
Seddon (key20220624155138097_ref1-bib2) 2001; 10
Michie (key20220624155138097_ref1-bib44) 2004; 328
key20220624155138097_ref1-bib117
Balsamiq Studios (key20220624155138097_ref1-bib41) 2019
Grimshaw (key20220624155138097_ref1-bib17) 2012; 7
Ivers (key20220624155138097_ref1-bib21) 2014; 9
Zeitlin (key20220624155138097_ref1-bib7) 2016; 354
Alderson (key20220624155138097_ref1-bib108) 2021; 27
NHS Digital (key20220624155138097_ref1-bib30) 2020
The Ottawa Hospital Research Institute (key20220624155138097_ref1-bib116) 2020
Michie (key20220624155138097_ref1-bib99) 2011; 6
Cantillon (key20220624155138097_ref1-bib63) 2008; 337
key20220624155138097_ref1-bib68
Damschroder (key20220624155138097_ref1-bib100) 2009; 4
Foy (key20220624155138097_ref1-bib12) 2020; 368
Veloski (key20220624155138097_ref1-bib50) 2006; 28
Mason (key20220624155138097_ref1-bib14) 2001; 286
Willis (key20220624155138097_ref1-bib129) 2020; 17
van Buuren (key20220624155138097_ref1-bib93) 2006; 76
Foy (key20220624155138097_ref1-bib13) 2005; 5
Cooksey (key20220624155138097_ref1-bib10) 2006
Craig (key20220624155138097_ref1-bib23) 2008; 337
Wu (key20220624155138097_ref1-bib5) 2013; 8
Colquhoun (key20220624155138097_ref1-bib74) 2017; 29
Maiden (key20220624155138097_ref1-bib40) 2005; 1
Hartley (key20220624155138097_ref1-bib24) 2017; 12
Kluger (key20220624155138097_ref1-bib98) 1996; 119
NHS Digital (key20220624155138097_ref1-bib104) 2020
Chakraborty (key20220624155138097_ref1-bib78) 2009; 28
Gutacker (key20220624155138097_ref1-bib9) 2017; 52
Elling (key20220624155138097_ref1-bib86)
National Institute for Health and Care Excellence (key20220624155138097_ref1-bib131)
Francis (key20220624155138097_ref1-bib80) 2004
van Buuren (key20220624155138097_ref1-bib92) 2007; 16
Gude (key20220624155138097_ref1-bib95) 2018; 13
Taylor (key20220624155138097_ref1-bib102) 2018; 8
Gould (key20220624155138097_ref1-bib125) 2020; 35
Michie (key20220624155138097_ref1-bib69) 2015; 19
Brehaut (key20220624155138097_ref1-bib19) 2016; 164
Bonetti (key20220624155138097_ref1-bib35) 2005; 60
Nielsen (key20220624155138097_ref1-bib60) 2006
Ivers (key20220624155138097_ref1-bib107) 2017; 12
Murphy (key20220624155138097_ref1-bib37) 1998; 2
Khan (key20220624155138097_ref1-bib127) 2020; 1
Elshehaly (key20220624155138097_ref1-bib130) 2018; 1
Gude (key20220624155138097_ref1-bib53) 2019; 14
Sargeant (key20220624155138097_ref1-bib64) 2015; 90
Rubin (key20220624155138097_ref1-bib94) 1976; 63
NHS (key20220624155138097_ref1-bib33) 2021
National Institute for Health and Care Excellence (key20220624155138097_ref1-bib132)
Grimshaw (key20220624155138097_ref1-bib16) 2004; 8
Sharp (key20220624155138097_ref1-bib38) 2019
Soper (key20220624155138097_ref1-bib120) 2013; 18
References_xml – volume: 3
  start-page: 36
  year: 2008
  ident: key20220624155138097_ref1-bib42
  article-title: Healthcare professionals’ intentions and behaviours: a systematic review of studies based on social cognitive theories
  publication-title: Implement Sci
  doi: 10.1186/1748-5908-3-36
– volume: 12
  start-page: 77
  year: 2017
  ident: key20220624155138097_ref1-bib122
  article-title: A guide to using the Theoretical Domains Framework of behaviour change to investigate implementation problems
  publication-title: Implement Sci
  doi: 10.1186/s13012-017-0605-9
– volume-title: Unstable Angina and NSTEMI: Early Management
  ident: key20220624155138097_ref1-bib132
– volume: 14
  start-page: 39
  year: 2019
  ident: key20220624155138097_ref1-bib53
  article-title: Clinical performance comparators in audit and feedback: a review of theory and evidence
  publication-title: Implement Sci
  doi: 10.1186/s13012-019-0887-1
– volume: 1
  start-page: 105
  year: 2005
  ident: key20220624155138097_ref1-bib40
  article-title: Integrating creativity into requirements processes: experiences with an air traffic management system
  publication-title: 13th IEEE International Conference on Requirements Engineering (RE'05)
  doi: 10.1109/RE.2005.34
– volume: 26
  start-page: 405
  year: 2010
  ident: key20220624155138097_ref1-bib59
  article-title: Supporting the use of health technology assessments in policy making about health systems
  publication-title: Int J Technol Assess Health Care
  doi: 10.1017/S026646231000108X
– volume-title: Quality Outcomes Framework (QOF)
  year: 2020
  ident: key20220624155138097_ref1-bib104
– volume: 1
  start-page: 4
  year: 2006
  ident: key20220624155138097_ref1-bib22
  article-title: Designing theoretically-informed implementation interventions
  publication-title: Implement Sci
  doi: 10.1186/1748-5908-1-4
– volume: 100
  start-page: 1188
  year: 2015
  ident: key20220624155138097_ref1-bib67
  article-title: Using surgeon-specific outcome reports and positive deviance for continuous quality improvement
  publication-title: Ann Thorac Surg
  doi: 10.1016/j.athoracsur.2015.04.012
– volume-title: Diabetes – Type 2: Scenario: Management – Adults
  ident: key20220624155138097_ref1-bib131
– volume-title: Progressive Disclosure
  year: 2006
  ident: key20220624155138097_ref1-bib60
– volume: 12
  start-page: 86
  year: 2017
  ident: key20220624155138097_ref1-bib107
  article-title: Testing feedback message framing and comparators to address prescribing of high-risk medications in nursing homes: protocol for a pragmatic, factorial, cluster-randomized trial
  publication-title: Implement Sci
  doi: 10.1186/s13012-017-0615-7
– volume: 76
  start-page: 1049
  year: 2006
  ident: key20220624155138097_ref1-bib93
  article-title: Fully conditional specification in multivariate imputation
  publication-title: J Stat Comput Simul
  doi: 10.1080/10629360600810434
– volume: 29
  start-page: 148
  year: 2017
  ident: key20220624155138097_ref1-bib74
  article-title: Applying user-centered design to develop an audit and feedback intervention for the home care sector
  publication-title: Home Health Care Manag Pract
  doi: 10.1177/1084822317700883
– volume: 28
  start-page: 416
  year: 2019
  ident: key20220624155138097_ref1-bib111
  article-title: Reinvigorating stagnant science: implementation laboratories and a meta-laboratory to efficiently advance the science of audit and feedback
  publication-title: BMJ Qual Saf
  doi: 10.1136/bmjqs-2018-008355
– volume: 286
  start-page: 2988
  year: 2001
  ident: key20220624155138097_ref1-bib14
  article-title: When is it cost-effective to change the behavior of health professionals?
  publication-title: JAMA
  doi: 10.1001/jama.286.23.2988
– volume: 164
  start-page: 435
  year: 2016
  ident: key20220624155138097_ref1-bib19
  article-title: Practice feedback interventions: 15 suggestions for optimizing effectiveness
  publication-title: Ann Intern Med
  doi: 10.7326/M15-2248
– volume: 13
  start-page: S7
  year: 2013
  ident: key20220624155138097_ref1-bib82
  article-title: Presenting quantitative information about decision outcomes: a risk communication primer for patient decision aid developers
  publication-title: BMC Med Inform Decis Mak
  doi: 10.1186/1472-6947-13-S2-S7
– volume: 26
  start-page: w107
  year: 2007
  ident: key20220624155138097_ref1-bib124
  article-title: A rapid-learning health system: what would a rapid-learning health system look like, and how might we get there?
  publication-title: Health Aff
  doi: 10.1377/hlthaff.26.2.w107
– volume-title: Balsamiq Desktop. 4.0.7
  year: 2019
  ident: key20220624155138097_ref1-bib41
– volume: 5
  start-page: 50
  year: 2005
  ident: key20220624155138097_ref1-bib13
  article-title: What do we know about how to do audit and feedback? Pitfalls in applying evidence from a systematic review
  publication-title: BMC Health Serv Res
  doi: 10.1186/1472-6963-5-50
– volume: 11
  start-page: 113
  year: 2016
  ident: key20220624155138097_ref1-bib56
  article-title: Using the Theoretical Domains Framework (TDF) to understand adherence to multiple evidence-based indicators in primary care: a qualitative study
  publication-title: Implement Sci
  doi: 10.1186/s13012-016-0479-2
– volume: 8
  issue: 6
  year: 2004
  ident: key20220624155138097_ref1-bib16
  article-title: Effectiveness and efficiency of guideline dissemination and implementation strategies
  publication-title: Health Technol Assess
  doi: 10.3310/hta8060
– volume-title: Experiments: Planning, Analysis, and Optimization
  year: 2011
  ident: key20220624155138097_ref1-bib79
– volume-title: Website Evaluation Questionnaire: Development of a Research-Based Tool for Evaluating Informational Websites
  ident: key20220624155138097_ref1-bib86
– volume: 26
  start-page: 279
  year: 2017
  ident: key20220624155138097_ref1-bib96
  article-title: How does audit and feedback influence intentions of health professionals to improve practice? A laboratory experiment and field study in cardiac rehabilitation
  publication-title: BMJ Qual Saf
  doi: 10.1136/bmjqs-2015-004795
– volume: 94
  start-page: 191
  year: 2016
  ident: key20220624155138097_ref1-bib73
  article-title: Interface design recommendations for computerised clinical audit and feedback: hybrid usability evidence from a research-led system
  publication-title: Int J Med Inform
  doi: 10.1016/j.ijmedinf.2016.07.010
– volume-title: Attention and Self-Regulation: A Control-Theory Approach to Human Behavior
  year: 1981
  ident: key20220624155138097_ref1-bib49
  doi: 10.1007/978-1-4612-5887-2
– volume-title: The Trauma Audit & Research Network
  year: 2021
  ident: key20220624155138097_ref1-bib32
– volume: 3
  start-page: 32
  year: 2022
  ident: key20220624155138097_ref1-bib97
  article-title: Opportunities to improve the impact of two national clinical audit programmes: a theory-guided analysis
  publication-title: Implementation Sci Comm
  doi: 10.1186/s43058-022-00275-5
– volume: 16
  start-page: 377
  year: 2009
  ident: key20220624155138097_ref1-bib71
  article-title: Improving professional practice in the disclosure of a diagnosis of dementia: a modeling experiment to evaluate a theory-based intervention
  publication-title: Int J Behav Med
  doi: 10.1007/s12529-008-9023-3
– volume: 1
  start-page: 33
  year: 2020
  ident: key20220624155138097_ref1-bib112
  article-title: A multiple-behaviour investigation of goal prioritisation in physicians receiving audit and feedback to address high-risk prescribing in nursing homes
  publication-title: Implement Sci Commun
  doi: 10.1186/s43058-020-00019-3
– ident: key20220624155138097_ref1-bib1
– volume: 25
  start-page: 441
  year: 2016
  ident: key20220624155138097_ref1-bib105
  article-title: Physician and other healthcare personnel responses to hospital stroke quality of care performance feedback: a qualitative study
  publication-title: BMJ Qual Saf
  doi: 10.1136/bmjqs-2015-004197
– volume: 7
  start-page: 50
  year: 2012
  ident: key20220624155138097_ref1-bib17
  article-title: Knowledge translation of research findings
  publication-title: Implement Sci
  doi: 10.1186/1748-5908-7-50
– volume: 60
  start-page: 2135
  year: 2005
  ident: key20220624155138097_ref1-bib35
  article-title: Guiding the design and selection of interventions to influence the implementation of evidence-based practice: an experimental simulation of a complex intervention trial
  publication-title: Soc Sci Med
  doi: 10.1016/j.socscimed.2004.08.072
– volume: 44
  start-page: 1166
  year: 2010
  ident: key20220624155138097_ref1-bib62
  article-title: Feedback, the various tasks of the doctor, and the feedforward alternative
  publication-title: Med Educ
  doi: 10.1111/j.1365-2923.2010.03849.x
– volume-title: Trauma
  ident: key20220624155138097_ref1-bib133
– volume: 44
  start-page: 140
  year: 2010
  ident: key20220624155138097_ref1-bib66
  article-title: Peer mentoring in doctor performance assessment: strategies, obstacles and benefits
  publication-title: Med Educ
  doi: 10.1111/j.1365-2923.2009.03580.x
– volume: 31
  start-page: 484
  year: 2015
  ident: key20220624155138097_ref1-bib89
  article-title: Assessing user satisfaction in the era of user experience: comparison of the SUS, UMUX, and UMUX-LITE as a function of product experience
  publication-title: Int J Hum Comput Interact
  doi: 10.1080/10447318.2015.1064648
– volume: 381
  start-page: 1175
  year: 2019
  ident: key20220624155138097_ref1-bib110
  article-title: Creating a learning health system through rapid-cycle, randomized testing
  publication-title: N Engl J Med
  doi: 10.1056/NEJMsb1900856
– volume: 134
  start-page: 681
  year: 1994
  ident: key20220624155138097_ref1-bib52
  article-title: Individual versus group feedback in cooperative groups
  publication-title: J Soc Psychol
  doi: 10.1080/00224545.1994.9922999
– volume: 354
  start-page: i4079
  year: 2016
  ident: key20220624155138097_ref1-bib18
  article-title: Data feedback and behavioural change intervention to improve primary care prescribing safety (EFIPPS): multicentre, three arm, cluster randomised controlled trial
  publication-title: BMJ
  doi: 10.1136/bmj.i4079
– volume: 9
  start-page: 92
  year: 2014
  ident: key20220624155138097_ref1-bib25
  article-title: Application of theory to enhance audit and feedback interventions to increase the uptake of evidence-based transfusion practice: an intervention development protocol
  publication-title: Implement Sci
  doi: 10.1186/s13012-014-0092-1
– volume: 10
  start-page: 152
  year: 2001
  ident: key20220624155138097_ref1-bib2
  article-title: Systematic review of studies of quality of clinical care in general practice in the UK, Australia and New Zealand
  publication-title: Qual Health Care
  doi: 10.1136/qhc.0100152
– volume: 9
  start-page: 168
  year: 2014
  ident: key20220624155138097_ref1-bib15
  article-title: Economic evaluation of implementation strategies in health care
  publication-title: Implement Sci
  doi: 10.1186/s13012-014-0168-y
– volume: 6
  start-page: CD000259
  year: 2012
  ident: key20220624155138097_ref1-bib11
  article-title: Audit and feedback: effects on professional practice and healthcare outcomes
  publication-title: Cochrane Database Syst Rev
  doi: 10.1002/14651858.CD000259.pub3
– volume: 48
  start-page: 347
  year: 2014
  ident: key20220624155138097_ref1-bib84
  article-title: Reflective and automatic processes in health care professional behaviour: a dual process model tested across multiple behaviours
  publication-title: Ann Behav Med
  doi: 10.1007/s12160-014-9609-8
– volume: 19
  start-page: 1
  year: 2015
  ident: key20220624155138097_ref1-bib69
  article-title: Behaviour change techniques: the development and evaluation of a taxonomic method for reporting and describing behaviour change interventions (a suite of five studies involving consensus methods, randomised controlled trials and analysis of qualitative data)
  publication-title: Health Technol Assess
  doi: 10.3310/hta19990
– volume: 119
  start-page: 254
  year: 1996
  ident: key20220624155138097_ref1-bib98
  article-title: The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory
  publication-title: Psychol Bull
  doi: 10.1037/0033-2909.119.2.254
– volume-title: National Diabetes Audit Programme
  year: 2020
  ident: key20220624155138097_ref1-bib30
– volume: 31
  start-page: 496
  year: 2015
  ident: key20220624155138097_ref1-bib90
  article-title: Measuring perceived usability: the SUS, UMUX-LITE, and AltUsability
  publication-title: Int J Hum Comput Interact
  doi: 10.1080/10447318.2015.1064654
– volume: 29
  start-page: 179
  year: 2020
  ident: key20220624155138097_ref1-bib109
  article-title: A nudge towards increased experimentation to more rapidly improve healthcare
  publication-title: BMJ Qual Saf
  doi: 10.1136/bmjqs-2019-009948
– volume: 27
  start-page: 50
  year: 2021
  ident: key20220624155138097_ref1-bib108
  article-title: Embedded trials within national clinical audit programmes: a qualitative interview study of enablers and barriers
  publication-title: J Health Serv Res Policy
  doi: 10.1177/13558196211044321
– volume-title: Challenges in Applying Clinical Trial Standards to Routine Data. A Case Study from a Randomised Controlled Trial Embedded in National Clinic Audit.
  ident: key20220624155138097_ref1-bib115
– volume: 25
  start-page: 1229
  year: 2010
  ident: key20220624155138097_ref1-bib118
  article-title: What is an adequate sample size? Operationalising data saturation for theory-based interview studies
  publication-title: Psychol Health
  doi: 10.1080/08870440903194015
– volume: 317
  start-page: 858
  year: 1998
  ident: key20220624155138097_ref1-bib47
  article-title: Attributes of clinical guidelines that influence use of guidelines in general practice: observational study
  publication-title: BMJ
  doi: 10.1136/bmj.317.7162.858
– volume: 18
  start-page: 13
  year: 2013
  ident: key20220624155138097_ref1-bib119
  article-title: Collaborative action around implementation in Collaborations for Leadership in Applied Health Research and Care: towards a programme theory
  publication-title: J Health Serv Res Policy
  doi: 10.1177/1355819613498859
– volume: 1
  start-page: 106
  year: 2020
  ident: key20220624155138097_ref1-bib127
  article-title: Repeated analyses of national clinical audit reports demonstrate improvements in feedback methods
  publication-title: Implement Sci Commun
  doi: 10.1186/s43058-020-00089-3
– volume: 2
  issue: 3
  year: 1998
  ident: key20220624155138097_ref1-bib37
  article-title: Consensus development methods, and their use in clinical guideline development
  publication-title: Health Technol Assess
  doi: 10.3310/hta2030
– volume: 16
  start-page: 377
  year: 2009
  ident: key20220624155138097_ref1-bib36
  article-title: Improving professional practice in the disclosure of a diagnosis of dementia: a modeling experiment to evaluate a theory-based intervention
  publication-title: Int J Behav Med
  doi: 10.1007/s12529-008-9023-3
– volume: 6
  start-page: e010276
  year: 2016
  ident: key20220624155138097_ref1-bib4
  article-title: Prescribed opioids in primary care: cross-sectional and longitudinal analyses of influence of patient and practice characteristics
  publication-title: BMJ Open
  doi: 10.1136/bmjopen-2015-010276
– volume-title: The Audit & Feedback Metalab
  year: 2020
  ident: key20220624155138097_ref1-bib116
– volume: 14
  start-page: 102
  year: 2019
  ident: key20220624155138097_ref1-bib45
  article-title: Action, actor, context, target, time (AACTT): a framework for specifying behaviour
  publication-title: Implement Sci
  doi: 10.1186/s13012-019-0951-x
– volume: 337
  start-page: a1961
  year: 2008
  ident: key20220624155138097_ref1-bib63
  article-title: Giving feedback in clinical settings
  publication-title: BMJ
  doi: 10.1136/bmj.a1961
– volume-title: Head Injury: Assessment and Early Management
  ident: key20220624155138097_ref1-bib135
– volume: 79
  start-page: 281
  year: 2001
  ident: key20220624155138097_ref1-bib55
  article-title: Improving the quality of health care in the United Kingdom and the United States: a framework for change
  publication-title: Milbank Q
  doi: 10.1111/1468-0009.00206
– volume-title: Ergonomics of Human-System Interaction—Part 11: Usability: Definitions and Concepts
  year: 2018
  ident: key20220624155138097_ref1-bib87
– volume: 28
  start-page: 117
  year: 2006
  ident: key20220624155138097_ref1-bib50
  article-title: Systematic review of the literature on assessment, feedback and physicians’ clinical performance: BEME Guide No. 7
  publication-title: Med Teach
  doi: 10.1080/01421590600622665
– volume: 195
  start-page: 403
  year: 2003
  ident: key20220624155138097_ref1-bib70
  article-title: Can psychological models bridge the gap between clinical guidelines and clinicians’ behaviour? A randomised controlled trial of an intervention to influence dentists’ intention to implement evidence-based practice
  publication-title: Br Dent J
  doi: 10.1038/sj.bdj.4810565
– volume: 14
  start-page: 40
  year: 2019
  ident: key20220624155138097_ref1-bib27
  article-title: Clinical Performance Feedback Intervention Theory (CP-FIT): a new theory for designing, implementing, and evaluating feedback in health care based on a systematic review and meta-synthesis of qualitative research
  publication-title: Implement Sci
  doi: 10.1186/s13012-019-0883-5
– start-page: 1
  volume-title: Optimization of Behavioral, Biobehavioral, and Biomedical Interventions
  year: 2018
  ident: key20220624155138097_ref1-bib34
– volume: 8
  start-page: e55067
  year: 2013
  ident: key20220624155138097_ref1-bib58
  article-title: Comparison of alternative evidence summary and presentation formats in clinical guideline development: a mixed-method study
  publication-title: PLOS ONE
  doi: 10.1371/journal.pone.0055067
– volume: 9
  start-page: 14
  year: 2014
  ident: key20220624155138097_ref1-bib21
  article-title: No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention
  publication-title: Implement Sci
  doi: 10.1186/1748-5908-9-14
– volume: 12
  start-page: 117
  year: 2017
  ident: key20220624155138097_ref1-bib72
  article-title: Advancing the literature on designing audit and feedback interventions: identifying theory-informed hypotheses
  publication-title: Implement Sci
  doi: 10.1186/s13012-017-0646-0
– volume: 335
  start-page: 648
  year: 2007
  ident: key20220624155138097_ref1-bib75
  article-title: Use of process measures to monitor the quality of clinical practice
  publication-title: BMJ
  doi: 10.1136/bmj.39317.641296.AD
– volume: 52
  start-page: 863
  year: 2017
  ident: key20220624155138097_ref1-bib9
  article-title: Hospital surgical volumes and mortality after coronary artery bypass grafting: using international comparisons to determine a safe threshold
  publication-title: Health Serv Res
  doi: 10.1111/1475-6773.12508
– volume: 32
  start-page: S112
  year: 2007
  ident: key20220624155138097_ref1-bib91
  article-title: The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent eHealth interventions
  publication-title: Am J Prev Med
  doi: 10.1016/j.amepre.2007.01.022
– volume-title: UMUX-LITE: When There’s No Time for the SUS
  ident: key20220624155138097_ref1-bib88
  doi: 10.1145/2470654.2481287
– volume-title: Major Trauma: Assessment and Initial Management
  ident: key20220624155138097_ref1-bib134
– volume: 8
  start-page: e67611
  year: 2013
  ident: key20220624155138097_ref1-bib5
  article-title: Patient factors influencing the prescribing of lipid lowering drugs for primary prevention of cardiovascular disease in UK general practice: a national retrospective cohort study
  publication-title: PLOS ONE
  doi: 10.1371/journal.pone.0067611
– volume: 12
  start-page: 811
  year: 2010
  ident: key20220624155138097_ref1-bib114
  article-title: ‘Why partnership working doesn’t work’: pitfalls, problems and possibilities in English health and social care
  publication-title: Public Manag Rev
  doi: 10.1080/14719037.2010.488861
– volume: 1
  start-page: 28
  year: 2006
  ident: key20220624155138097_ref1-bib81
  article-title: Do self- reported intentions predict clinicians’ behaviour: a systematic review
  publication-title: Implement Sci
  doi: 10.1186/1748-5908-1-28
– volume: 353
  start-page: i2021
  year: 2016
  ident: key20220624155138097_ref1-bib8
  article-title: Inequalities in use of total hip arthroplasty for hip fracture: population based study
  publication-title: BMJ
  doi: 10.1136/bmj.i2021
– volume: 1
  start-page: 19
  year: 2018
  ident: key20220624155138097_ref1-bib130
  article-title: From taxonomy to requirements: a task space partitioning approach
  publication-title: IEEE Evaluation and Beyond – Methodological Approaches for Visualisation (BELIV)
  doi: 10.1109/BELIV.2018.8634027
– volume: 28
  start-page: 2687
  year: 2009
  ident: key20220624155138097_ref1-bib78
  article-title: Developing multicomponent interventions using fractional factorial designs
  publication-title: Stat Med
  doi: 10.1002/sim.3643
– volume: 6
  start-page: 42
  year: 2011
  ident: key20220624155138097_ref1-bib99
  article-title: The behaviour change wheel: a new method for characterising and designing behaviour change interventions
  publication-title: Implement Sci
  doi: 10.1186/1748-5908-6-42
– volume: 12
  start-page: 84
  year: 2017
  ident: key20220624155138097_ref1-bib24
  article-title: The evaluation of enhanced feedback interventions to reduce unnecessary blood transfusions (AFFINITIE): protocol for two linked cluster randomised factorial controlled trials
  publication-title: Implement Sci
  doi: 10.1186/s13012-017-0614-8
– volume-title: Constructing Questionnaires Based on the Theory of Planned Behaviour: A Manual for Health Services Researchers
  year: 2004
  ident: key20220624155138097_ref1-bib80
– volume: 354
  start-page: i2976
  year: 2016
  ident: key20220624155138097_ref1-bib7
  article-title: Use of evidence based practices to improve survival without severe morbidity for very preterm infants: results from the EPICE population based cohort
  publication-title: BMJ
  doi: 10.1136/bmj.i2976
– volume: 90
  start-page: 1698
  year: 2015
  ident: key20220624155138097_ref1-bib64
  article-title: Facilitated reflective performance feedback: developing an evidence- and theory-based model that builds relationship, explores reactions and content, and coaches for performance change (R2C2)
  publication-title: Acad Med
  doi: 10.1097/ACM.0000000000000809
– volume: 16
  start-page: 219
  year: 2007
  ident: key20220624155138097_ref1-bib92
  article-title: Multiple imputation of discrete and continuous data by fully conditional specification
  publication-title: Stat Methods Med Res
  doi: 10.1177/0962280206074463
– volume: 30
  start-page: 1596
  year: 2020
  ident: key20220624155138097_ref1-bib103
  article-title: Rapid techniques in qualitative research: a critical review of the literature
  publication-title: Qual Health Res
  doi: 10.1177/1049732320921835
– volume: 13
  start-page: e0206676
  year: 2018
  ident: key20220624155138097_ref1-bib26
  article-title: How do hospitals respond to feedback about blood transfusion practice? A multiple case study investigation
  publication-title: PLOS ONE
  doi: 10.1371/journal.pone.0206676
– volume: 3
  start-page: 77
  year: 2006
  ident: key20220624155138097_ref1-bib123
  article-title: Using thematic analysis in psychology
  publication-title: Qual Res Psychol
  doi: 10.1191/1478088706qp063oa
– volume: 8
  start-page: e019993
  year: 2018
  ident: key20220624155138097_ref1-bib102
  article-title: Can rapid approaches to qualitative analysis deliver timely, valid findings to clinical leaders? A mixed methods study comparing rapid and thematic analysis
  publication-title: BMJ Open
  doi: 10.1136/bmjopen-2017-019993
– ident: key20220624155138097_ref1-bib68
– volume-title: Statistics for Experimenters: An Introduction to Design, Data Analysis and Model Building
  year: 1978
  ident: key20220624155138097_ref1-bib77
– volume: 63
  start-page: 116
  year: 2013
  ident: key20220624155138097_ref1-bib85
  article-title: Narrative versus nonnarrative: the role of identification, transportation, and emotion in reducing health disparities
  publication-title: J Commun
  doi: 10.1111/jcom.12007
– volume: 63
  start-page: 581
  year: 1976
  ident: key20220624155138097_ref1-bib94
  article-title: Inference and missing data
  publication-title: Biometrika
  doi: 10.1093/biomet/63.3.581
– volume: 328
  start-page: 343
  year: 2004
  ident: key20220624155138097_ref1-bib44
  article-title: Changing clinical behaviour by making guidelines specific
  publication-title: BMJ
  doi: 10.1136/bmj.328.7435.343
– volume: 55
  start-page: 94
  year: 2005
  ident: key20220624155138097_ref1-bib46
  article-title: Improving management of hypertension in general practice: a randomised controlled trial of feedback derived from electronic patient data
  publication-title: Br J Gen Pract
– volume-title: Interaction Design: Beyond Human-Computer Interaction
  year: 2019
  ident: key20220624155138097_ref1-bib38
– volume: 8
  issue: 4
  year: 2020
  ident: key20220624155138097_ref1-bib106
  article-title: Developing and evaluating packages to support implementation of quality indicators in general practice: the ASPIRE research programme, including two cluster RCTs
  publication-title: Programme Grants Appl Res
  doi: 10.3310/pgfar08040
– volume: 4
  start-page: 50
  year: 2009
  ident: key20220624155138097_ref1-bib100
  article-title: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science
  publication-title: Implement Sci
  doi: 10.1186/1748-5908-4-50
– volume: 5
  start-page: 51
  year: 2010
  ident: key20220624155138097_ref1-bib83
  article-title: Healthcare professionals’ intentions to use clinical guidelines: a survey using the theory of planned behaviour
  publication-title: Implement Sci
  doi: 10.1186/1748-5908-5-51
– volume: 55
  start-page: 717
  year: 2002
  ident: key20220624155138097_ref1-bib48
  article-title: Attributes of clinical recommendations that influence change in practice following audit and feedback
  publication-title: J Clin Epidemiol
  doi: 10.1016/S0895-4356(02)00403-1
– volume: 6
  start-page: 19
  year: 2020
  ident: key20220624155138097_ref1-bib29
  article-title: The Myocardial Ischaemia National Audit Project (MINAP)
  publication-title: Eur Heart J Qual Care Clin Outcomes
  doi: 10.1093/ehjqcco/qcz052
– volume: 14
  start-page: 11
  year: 2019
  ident: key20220624155138097_ref1-bib101
  article-title: Comparison of rapid vs in-depth qualitative analytic methods from a process evaluation of academic detailing in the Veterans Health Administration
  publication-title: Implement Sci
  doi: 10.1186/s13012-019-0853-y
– volume: 3
  issue: 25
  year: 2015
  ident: key20220624155138097_ref1-bib128
  article-title: Delivering the aims of the Collaborations for Leadership in Applied Health Research and Care: understanding their strategies and contributions
  publication-title: Health Serv Del Res
  doi: 10.3310/hsdr03250
– volume: 24
  start-page: 659
  year: 1986
  ident: key20220624155138097_ref1-bib51
  article-title: Delayed feedback of physician performance versus immediate reminders to perform preventive care. Effects on physician compliance
  publication-title: Med Care
  doi: 10.1097/00005650-198608000-00001
– volume: 27
  start-page: 193
  year: 2013
  ident: key20220624155138097_ref1-bib113
  article-title: Towards a new paradigm in health research and practice? Collaborations for Leadership in Applied Health Research and Care
  publication-title: J Health Organ Manag
  doi: 10.1108/14777261311321770
– volume-title: A Review of UK Health Research Funding
  year: 2006
  ident: key20220624155138097_ref1-bib10
– volume: 47
  start-page: 356
  year: 2009
  ident: key20220624155138097_ref1-bib61
  article-title: Meta-analysis: audit and feedback features impact effectiveness on care quality
  publication-title: Med Care
  doi: 10.1097/MLR.0b013e3181893f6b
– volume: 27
  start-page: 858
  year: 2018
  ident: key20220624155138097_ref1-bib126
  article-title: Role of patient and public involvement in implementation research: a consensus study
  publication-title: BMJ Qual Saf
  doi: 10.1136/bmjqs-2017-006954
– volume: 368
  start-page: m213
  year: 2020
  ident: key20220624155138097_ref1-bib12
  article-title: Revitalising audit and feedback to improve patient care
  publication-title: BMJ
  doi: 10.1136/bmj.m213
– volume: 9
  start-page: 189
  year: 2004
  ident: key20220624155138097_ref1-bib65
  article-title: Do clinical clerks provide candidates with adequate formative assessment during Objective Structured Clinical Examinations?
  publication-title: Adv Health Sci Educ Theory Pract
  doi: 10.1023/B:AHSE.0000038172.97337.d5
– volume-title: Handbook of Usability Testing: How to Plan, Design and Conduct Effective Tests
  year: 2008
  ident: key20220624155138097_ref1-bib39
– volume: 17
  start-page: 34
  year: 2022
  ident: key20220624155138097_ref1-bib76
  article-title: A randomised fractional factorial screening experiment to predict effective features of audit and feedback
  publication-title: Implementation Sci
  doi: 10.1186/s13012-022-01208-5
– volume: 18
  start-page: 53
  year: 2013
  ident: key20220624155138097_ref1-bib120
  article-title: CLAHRCs in practice: combined knowledge transfer and exchange strategies, cultural change, and experimentation
  publication-title: J Health Serv Res Policy
  doi: 10.1177/1355819613499903
– volume: 4
  start-page: CD005470
  year: 2015
  ident: key20220624155138097_ref1-bib57
  article-title: Tailored interventions to address determinants of practice
  publication-title: Cochrane Database Syst Rev
  doi: 10.1002/14651858.CD005470.pub3
– volume: 337
  start-page: a1655
  year: 2008
  ident: key20220624155138097_ref1-bib23
  article-title: Developing and evaluating complex interventions: the new Medical Research Council guidance
  publication-title: BMJ
  doi: 10.1136/bmj.a1655
– volume: 28
  start-page: 1007
  year: 2019
  ident: key20220624155138097_ref1-bib43
  article-title: Impact of audit and feedback with action implementation toolbox on improving ICU pain management: cluster-randomised controlled trial
  publication-title: BMJ Qual Saf
  doi: 10.1136/bmjqs-2019-009588
– volume: 388
  start-page: 547
  year: 2016
  ident: key20220624155138097_ref1-bib28
  article-title: Reducing research waste with implementation laboratories
  publication-title: Lancet
  doi: 10.1016/S0140-6736(16)31256-9
– volume: 3
  start-page: 8
  year: 2008
  ident: key20220624155138097_ref1-bib121
  article-title: Overview of the VA Quality Enhancement Research Initiative (QUERI) and QUERI theme articles: QUERI Series
  publication-title: Implement Sci
  doi: 10.1186/1748-5908-3-8
– volume: 17
  start-page: e1003045
  year: 2020
  ident: key20220624155138097_ref1-bib129
  article-title: An adaptable implementation package targeting evidence-based indicators in primary care: a pragmatic cluster-randomised evaluation
  publication-title: PLOS Med
  doi: 10.1371/journal.pmed.1003045
– volume-title: National Comparative Audit of Blood Transfusion
  year: 2021
  ident: key20220624155138097_ref1-bib33
– volume: 27
  start-page: 591
  year: 2001
  ident: key20220624155138097_ref1-bib54
  article-title: Making health care quality reports easier to use
  publication-title: Jt Comm J Qual Improv
  doi: 10.1016/s1070-3241(01)27051-5
– volume: 342
  start-page: d3514
  year: 2011
  ident: key20220624155138097_ref1-bib3
  article-title: High risk prescribing in primary care patients particularly vulnerable to adverse drug events: cross sectional population database analysis in Scottish general practice
  publication-title: BMJ
  doi: 10.1136/bmj.d3514
– volume: 13
  start-page: 33
  year: 2018
  ident: key20220624155138097_ref1-bib95
  article-title: Health professionals’ perceptions about their clinical performance and the influence of audit and feedback on their intentions to improve practice: a theory-based study in Dutch intensive care units
  publication-title: Implement Sci
  doi: 10.1186/s13012-018-0727-8
– volume: 316
  start-page: 1073
  year: 2016
  ident: key20220624155138097_ref1-bib6
  article-title: Association of clinical factors and therapeutic strategies with improvements in survival following non-ST-elevation myocardial infarction, 2003–2013
  publication-title: JAMA
  doi: 10.1001/jama.2016.10766
– volume-title: The Paediatric Intensive Care Audit Network (PICANet)
  year: 2021
  ident: key20220624155138097_ref1-bib31
– volume: 29
  start-page: 1534
  year: 2014
  ident: key20220624155138097_ref1-bib20
  article-title: Growing literature, stagnant science? Systematic review, meta-regression and cumulative analysis of audit and feedback interventions in health care
  publication-title: J Gen Intern Med
  doi: 10.1007/s11606-014-2913-y
– volume-title: The Audit & Feedback Metalab
  ident: key20220624155138097_ref1-bib117
– volume: 35
  start-page: 3675
  year: 2020
  ident: key20220624155138097_ref1-bib125
  article-title: Embedded research in the learning healthcare system: ongoing challenges and recommendations for researchers, clinicians, and health system leaders
  publication-title: J Gen Intern Med
  doi: 10.1007/s11606-020-05865-4
SSID ssib048970023
ssj0002909496
ssib051604657
Score 2.1832716
Snippet Background: National clinical audit programmes aim to improve patient care by reviewing performance against explicit standards and directing action towards...
SourceID doaj
crossref
SourceType Open Website
Index Database
StartPage 1
SubjectTerms behavioural sciences
clinical audit
factorial
implementation
quality improvement
randomised controlled trial
user-computer interface
Title Interventions to optimise the outputs of national clinical audits to improve the quality of health care: a multi-method study including RCT
URI https://doaj.org/article/a99b5178d2f74c8b9c7129ddfd97695d
Volume 10
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAON
  databaseName: DOAJ Directory of Open Access Journals
  customDbUrl:
  eissn: 2755-0079
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0002909496
  issn: 2755-0060
  databaseCode: DOA
  dateStart: 20130101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 2755-0079
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssib051604657
  issn: 2755-0060
  databaseCode: M~E
  dateStart: 20220101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3PS91AEF7k4UGQ0lZFbStT8LqYbDbZ3d76xEd7kVYUxEvYn_CgJOJLCv4N_aed3X3PxpMXrwkbwmR2v28m880QchqqygtfO-q4KChvCkkNoiQtpdA2VCUikkvDJsTlpby9Vb8mo75iTVhuD5wNd6aVMnUppGNBcCuNsgIhyrngEEhV7eLpi6xnEkyhJ3GpRFH8B766bDAOXP_fi2c0UxjWpOFdTNQ1jV1JcmfaCunO2e_5_A55CH-BVZOW_gl7Fu_JuzVphO_5ZT-QLd99JLs54wZZSLRH_v2clC-uYOihx-MAP6MHJHnQj8P9OKygD7BJAMJGFgk6ajPSmmVKMuQlWXD5GJdkuSTEOrFvoCGVIdI8fRpSh1pYdvbPGIEQrs6v98nN4uL6_Addj1qgFoNUTpuqMRzJlGZOhtpbKUMTpDCGMYOMzzPruWJMuNJFJa0QukTeyLWoQqOq0lQHZNb1nT8kEIKThjnVxK2udVAhWKd0Y32hvWP-iHzdGLW9zx01WoxEouHbjeGPyDxa-_l-7IGdLqBntGvPaF_zjOO3eMgnssOi4CHlXT6T2fAw-i9k2_4dlquHk-R0T8rn2kk
linkProvider Directory of Open Access Journals
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Interventions+to+optimise+the+outputs+of+national+clinical+audits+to+improve+the+quality+of+health+care%3A+a+multi-method+study+including+RCT&rft.jtitle=Health+and+social+care+delivery+research&rft.au=Thomas+A+Willis&rft.au=Alexandra+Wright-Hughes&rft.au=Ana+Weller&rft.au=Sarah+L+Alderson&rft.date=2022-06-01&rft.pub=NIHR+Journals+Library&rft.issn=2755-0060&rft.eissn=2755-0079&rft.volume=10&rft.issue=15&rft_id=info:doi/10.3310%2FQBBZ1124&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_a99b5178d2f74c8b9c7129ddfd97695d
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2755-0060&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2755-0060&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2755-0060&client=summon