Curriculum Innovations: Teaching Residents About Guideline Development and Cost-Conscious Care A Mixed-Method Evaluation Study

Clinical practice guidelines (CPGs) can play a crucial role in achieving better and more cost-efficient health care. This requires training health care providers in CPG development. This study presents results of design-based research on a training program based on the learning theory of problem-bas...

Full description

Saved in:
Bibliographic Details
Published in:Neurology. Education Vol. 4; no. 1; p. e200198
Main Authors: Majoie, Marian, Visser, Anne, Ulubas, Merve, van Mastrigt, Ghislaine, Alonso-Coello, Pablo, Valli, Claudia, Niño de Guzman, Ena, Gartlehner, Gerald, Nussbaumer-Streit, Barbara, Klerings, Irma, James, Roberta, Service, Duncan, Evers, Silvia, Kleijnen, Jos, Leone, Maurizio, Verstegen, Danielle
Format: Journal Article
Language:English
Published: Hagerstown, MD Lippincott Williams & Wilkins 01.03.2025
ISSN:2771-9979, 2771-9979
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Clinical practice guidelines (CPGs) can play a crucial role in achieving better and more cost-efficient health care. This requires training health care providers in CPG development. This study presents results of design-based research on a training program based on the learning theory of problem-based learning, following the underlying principles of active, authentic, collaborative, and blended learning. The CoCoCare training aims to equip neurology residents with insight in CPG development (including cost aspects) and understanding of how to apply CPGs in clinical practice. The CoCoCare training consisted of 6 asynchronous e-learning modules, synchronous workshops (1 day onsite in run 1 and dispersed online sessions in run 2), and a series of online assignments mimicking the steps of CPG development. Participants could present their draft guidelines at the European Academy of Neurology conference. Between 2019 and 2021, 55 participants from 21 European member states participated in the training. A mixed-method design-based research study design was used to collect questionnaire and interview data from participants and trainers. Participants felt that the training prepared them to participate in CPG development and that they had learned how to critically appraise a guideline and were stimulated to apply guidelines in practice. Trainers were also positive and observed an upward trend in the knowledge of the participants. Participants especially appreciated the active (assignments) and authentic learning in the practical part of the training, but the workload of the assignments in combination with clinical work was a challenge. They also enjoyed the collaborative learning in an international group of residents but asked for more interaction and support during the period dedicated to assignments. The CoCoCare training program proved to be a feasible and unique, international guideline development training with a focus on cost-efficient care. Recommendations include to arrange accreditation, ensure regular interaction between trainers and participants, review the workload of assignments, and look at possibilities to provide feedback. Future research should evaluate the impact on CPG application and participation in CPG development.
AbstractList Clinical practice guidelines (CPGs) can play a crucial role in achieving better and more cost-efficient health care. This requires training health care providers in CPG development. This study presents results of design-based research on a training program based on the learning theory of problem-based learning, following the underlying principles of active, authentic, collaborative, and blended learning.Introduction and Problem StatementClinical practice guidelines (CPGs) can play a crucial role in achieving better and more cost-efficient health care. This requires training health care providers in CPG development. This study presents results of design-based research on a training program based on the learning theory of problem-based learning, following the underlying principles of active, authentic, collaborative, and blended learning.The CoCoCare training aims to equip neurology residents with insight in CPG development (including cost aspects) and understanding of how to apply CPGs in clinical practice.ObjectivesThe CoCoCare training aims to equip neurology residents with insight in CPG development (including cost aspects) and understanding of how to apply CPGs in clinical practice.The CoCoCare training consisted of 6 asynchronous e-learning modules, synchronous workshops (1 day onsite in run 1 and dispersed online sessions in run 2), and a series of online assignments mimicking the steps of CPG development. Participants could present their draft guidelines at the European Academy of Neurology conference. Between 2019 and 2021, 55 participants from 21 European member states participated in the training. A mixed-method design-based research study design was used to collect questionnaire and interview data from participants and trainers.Methods and Curriculum DescriptionThe CoCoCare training consisted of 6 asynchronous e-learning modules, synchronous workshops (1 day onsite in run 1 and dispersed online sessions in run 2), and a series of online assignments mimicking the steps of CPG development. Participants could present their draft guidelines at the European Academy of Neurology conference. Between 2019 and 2021, 55 participants from 21 European member states participated in the training. A mixed-method design-based research study design was used to collect questionnaire and interview data from participants and trainers.Participants felt that the training prepared them to participate in CPG development and that they had learned how to critically appraise a guideline and were stimulated to apply guidelines in practice. Trainers were also positive and observed an upward trend in the knowledge of the participants. Participants especially appreciated the active (assignments) and authentic learning in the practical part of the training, but the workload of the assignments in combination with clinical work was a challenge. They also enjoyed the collaborative learning in an international group of residents but asked for more interaction and support during the period dedicated to assignments.Results and Assessment DataParticipants felt that the training prepared them to participate in CPG development and that they had learned how to critically appraise a guideline and were stimulated to apply guidelines in practice. Trainers were also positive and observed an upward trend in the knowledge of the participants. Participants especially appreciated the active (assignments) and authentic learning in the practical part of the training, but the workload of the assignments in combination with clinical work was a challenge. They also enjoyed the collaborative learning in an international group of residents but asked for more interaction and support during the period dedicated to assignments.The CoCoCare training program proved to be a feasible and unique, international guideline development training with a focus on cost-efficient care. Recommendations include to arrange accreditation, ensure regular interaction between trainers and participants, review the workload of assignments, and look at possibilities to provide feedback. Future research should evaluate the impact on CPG application and participation in CPG development.Discussion and Lessons LearnedThe CoCoCare training program proved to be a feasible and unique, international guideline development training with a focus on cost-efficient care. Recommendations include to arrange accreditation, ensure regular interaction between trainers and participants, review the workload of assignments, and look at possibilities to provide feedback. Future research should evaluate the impact on CPG application and participation in CPG development.
Clinical practice guidelines (CPGs) can play a crucial role in achieving better and more cost-efficient health care. This requires training health care providers in CPG development. This study presents results of design-based research on a training program based on the learning theory of problem-based learning, following the underlying principles of active, authentic, collaborative, and blended learning. The CoCoCare training aims to equip neurology residents with insight in CPG development (including cost aspects) and understanding of how to apply CPGs in clinical practice. The CoCoCare training consisted of 6 asynchronous e-learning modules, synchronous workshops (1 day onsite in run 1 and dispersed online sessions in run 2), and a series of online assignments mimicking the steps of CPG development. Participants could present their draft guidelines at the European Academy of Neurology conference. Between 2019 and 2021, 55 participants from 21 European member states participated in the training. A mixed-method design-based research study design was used to collect questionnaire and interview data from participants and trainers. Participants felt that the training prepared them to participate in CPG development and that they had learned how to critically appraise a guideline and were stimulated to apply guidelines in practice. Trainers were also positive and observed an upward trend in the knowledge of the participants. Participants especially appreciated the active (assignments) and authentic learning in the practical part of the training, but the workload of the assignments in combination with clinical work was a challenge. They also enjoyed the collaborative learning in an international group of residents but asked for more interaction and support during the period dedicated to assignments. The CoCoCare training program proved to be a feasible and unique, international guideline development training with a focus on cost-efficient care. Recommendations include to arrange accreditation, ensure regular interaction between trainers and participants, review the workload of assignments, and look at possibilities to provide feedback. Future research should evaluate the impact on CPG application and participation in CPG development.
Author Gartlehner, Gerald
Verstegen, Danielle
James, Roberta
Kleijnen, Jos
Nussbaumer-Streit, Barbara
Klerings, Irma
Service, Duncan
Alonso-Coello, Pablo
Leone, Maurizio
Visser, Anne
Evers, Silvia
Niño de Guzman, Ena
Ulubas, Merve
Valli, Claudia
van Mastrigt, Ghislaine
Majoie, Marian
Author_xml – sequence: 1
  givenname: Marian
  surname: Majoie
  fullname: Majoie, Marian
– sequence: 2
  givenname: Anne
  surname: Visser
  fullname: Visser, Anne
– sequence: 3
  givenname: Merve
  surname: Ulubas
  fullname: Ulubas, Merve
– sequence: 4
  givenname: Ghislaine
  surname: van Mastrigt
  fullname: van Mastrigt, Ghislaine
– sequence: 5
  givenname: Pablo
  surname: Alonso-Coello
  fullname: Alonso-Coello, Pablo
– sequence: 6
  givenname: Claudia
  surname: Valli
  fullname: Valli, Claudia
– sequence: 7
  givenname: Ena
  surname: Niño de Guzman
  fullname: Niño de Guzman, Ena
– sequence: 8
  givenname: Gerald
  orcidid: 0000-0001-5531-3678
  surname: Gartlehner
  fullname: Gartlehner, Gerald
– sequence: 9
  givenname: Barbara
  surname: Nussbaumer-Streit
  fullname: Nussbaumer-Streit, Barbara
– sequence: 10
  givenname: Irma
  surname: Klerings
  fullname: Klerings, Irma
– sequence: 11
  givenname: Roberta
  surname: James
  fullname: James, Roberta
– sequence: 12
  givenname: Duncan
  surname: Service
  fullname: Service, Duncan
– sequence: 13
  givenname: Silvia
  surname: Evers
  fullname: Evers, Silvia
– sequence: 14
  givenname: Jos
  surname: Kleijnen
  fullname: Kleijnen, Jos
– sequence: 15
  givenname: Maurizio
  orcidid: 0000-0002-6339-5738
  surname: Leone
  fullname: Leone, Maurizio
– sequence: 16
  givenname: Danielle
  surname: Verstegen
  fullname: Verstegen, Danielle
BackLink https://www.ncbi.nlm.nih.gov/pubmed/40041757$$D View this record in MEDLINE/PubMed
BookMark eNpdkU1PAyEQhonR-Nl_YAxHL1uZQsvixZj1MzGaGL1KWBYqZhcq7Dbx34uxNiqXGTIP7zDz7qFNH7xB6BDIGCYwObm_FGOyPhNCQJQbaHfCORRCcLH5K99Bo5TeMkYpUDoT22iHEcKAT_kueqmGGJ0e2qHDt96Hpepd8OkUPxmlX52f40eTXGN8n_B5HYYeXw_52jpv8IVZmjYsulzEyje4CqkvqvxauzAkXKloDtCWVW0yo1XcR89Xl0_VTXH3cH1bnd8VGqacFFNBuWIceGlnDScls7MSLLUASlgzFbVQDbWECKXLpiZcNIbVGqiucwbC0n109q27GOrONDp_KapWLqLrVPyQQTn5t-Ldq5yHpQQouWCcZIXjlUIM74NJvexc0qZtlTd5GkmBM8grLFlGj343W3f52WoG2DegY0gpGrtGgMgv_2T2T_73j34CZjyOLw
Cites_doi 10.1016/S0140-6736(04)16778-0
10.1186/s12913-020-4979-z
10.1370/afm.1713
10.1111/ene.13855
10.1136/bmjopen-2015-009189
10.1007/s10459-019-09940-2
10.1377/hlthaff.27.3.759
10.1016/0140-6736(93)92244-n
10.1111/all.13316
10.1016/S1474-4422(18)30499-X
10.1212/WNL.0000000000004135
10.1787/9789264233386-en
10.3109/0142159X.2011.595437
10.1007/s11606-019-05502-9
10.1111/jep.12775
ContentType Journal Article
Copyright 2025 American Academy of Neurology.
2025 American Academy of Neurology 2025 American Academy of Neurology
Copyright_xml – notice: 2025 American Academy of Neurology.
– notice: 2025 American Academy of Neurology 2025 American Academy of Neurology
DBID AAYXX
CITATION
NPM
7X8
5PM
DOI 10.1212/NE9.0000000000200198
DatabaseName CrossRef
PubMed
MEDLINE - Academic
PubMed Central (Full Participant titles)
DatabaseTitle CrossRef
PubMed
MEDLINE - Academic
DatabaseTitleList MEDLINE - Academic
PubMed
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 2
  dbid: 7X8
  name: MEDLINE - Academic
  url: https://search.proquest.com/medline
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Medicine
EISSN 2771-9979
ExternalDocumentID PMC11879470
40041757
10_1212_NE9_0000000000200198
Genre Journal Article
GroupedDBID 0R~
AAAAV
AAHPQ
AAIQE
AASCR
AAYXX
ABVCZ
ABZZY
ACILI
ACXJB
ADGGA
ADHPY
ADKSD
ADPDF
AFBFQ
AFDTB
AHQNM
AINUH
AJCLO
AJNWD
AJZMW
AKCTQ
ALKUP
ALMA_UNASSIGNED_HOLDINGS
AMNEI
AOHHW
AOQMC
CITATION
DIWNM
EEVPB
FCALG
GNXGY
GQDEL
HLJTE
IKREB
M~E
OVD
OVDNE
OVEED
RPM
SJN
TEORI
TSPGW
NPM
7X8
5PM
ID FETCH-LOGICAL-c1570-5937a47178f6d7084f681f3f11a9fe59b9ad3f009ac8db079de4bc13cb9de19f3
ISSN 2771-9979
IngestDate Tue Sep 30 17:05:12 EDT 2025
Sun Sep 28 01:40:10 EDT 2025
Mon Jul 21 05:56:51 EDT 2025
Sat Nov 29 08:11:29 EST 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 1
Language English
License 2025 American Academy of Neurology.
This is an open access article distributed under the Creative Commons Attribution License 4.0 (CCBY), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c1570-5937a47178f6d7084f681f3f11a9fe59b9ad3f009ac8db079de4bc13cb9de19f3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
Submitted and externally peer reviewed. The handling editor was Roy E. Strowd, III, MD, MEd, MS.
These authors contributed equally to this work.
ORCID 0000-0002-6339-5738
0000-0001-5531-3678
OpenAccessLink https://pubmed.ncbi.nlm.nih.gov/PMC11879470
PMID 40041757
PQID 3174103384
PQPubID 23479
ParticipantIDs pubmedcentral_primary_oai_pubmedcentral_nih_gov_11879470
proquest_miscellaneous_3174103384
pubmed_primary_40041757
crossref_primary_10_1212_NE9_0000000000200198
PublicationCentury 2000
PublicationDate 2025-Mar
PublicationDateYYYYMMDD 2025-03-01
PublicationDate_xml – month: 03
  year: 2025
  text: 2025-Mar
PublicationDecade 2020
PublicationPlace Hagerstown, MD
PublicationPlace_xml – name: Hagerstown, MD
PublicationTitle Neurology. Education
PublicationTitleAlternate Neurol Educ
PublicationYear 2025
Publisher Lippincott Williams & Wilkins
Publisher_xml – name: Lippincott Williams & Wilkins
References e_1_3_5_17_2
e_1_3_5_16_2
e_1_3_5_15_2
e_1_3_5_14_2
e_1_3_5_13_2
e_1_3_5_10_2
e_1_3_5_11_2
Colla CH (e_1_3_5_12_2) 2016; 22
e_1_3_5_2_2
e_1_3_5_8_2
(e_1_3_5_19_2) 2019
e_1_3_5_20_2
e_1_3_5_7_2
e_1_3_5_9_2
CoCoCare Consortium (e_1_3_5_18_2) 2022
Inguide (e_1_3_5_21_2) 2020
e_1_3_5_4_2
e_1_3_5_3_2
e_1_3_5_6_2
e_1_3_5_5_2
References_xml – ident: e_1_3_5_10_2
  doi: 10.1016/S0140-6736(04)16778-0
– ident: e_1_3_5_16_2
– volume: 22
  start-page: 337
  issue: 5
  year: 2016
  ident: e_1_3_5_12_2
  article-title: Physician perceptions of choosing wisely and drivers of overuse
  publication-title: Am J Manag Care
– ident: e_1_3_5_17_2
  doi: 10.1186/s12913-020-4979-z
– ident: e_1_3_5_6_2
  doi: 10.1370/afm.1713
– ident: e_1_3_5_7_2
  doi: 10.1111/ene.13855
– ident: e_1_3_5_8_2
  doi: 10.1136/bmjopen-2015-009189
– ident: e_1_3_5_14_2
  doi: 10.1007/s10459-019-09940-2
– ident: e_1_3_5_4_2
  doi: 10.1377/hlthaff.27.3.759
– ident: e_1_3_5_13_2
  doi: 10.1016/0140-6736(93)92244-n
– ident: e_1_3_5_9_2
  doi: 10.1111/all.13316
– volume-title: International Guideline Training and Certification Program
  year: 2020
  ident: e_1_3_5_21_2
– ident: e_1_3_5_2_2
  doi: 10.1016/S1474-4422(18)30499-X
– ident: e_1_3_5_3_2
  doi: 10.1212/WNL.0000000000004135
– ident: e_1_3_5_5_2
  doi: 10.1787/9789264233386-en
– volume-title: Cost-conscious healthcare-CoCoCare
  year: 2019
  ident: e_1_3_5_19_2
– ident: e_1_3_5_15_2
  doi: 10.3109/0142159X.2011.595437
– ident: e_1_3_5_20_2
  doi: 10.1007/s11606-019-05502-9
– ident: e_1_3_5_11_2
  doi: 10.1111/jep.12775
– volume-title: European Partnership on Competencies for High Value Cost Conscious CARE. Project Report of EC Project Number: 2018-1-NL01-KA203-039070. Erasmus+, CoCoCare Project
  year: 2022
  ident: e_1_3_5_18_2
SSID ssj0003313369
Score 2.2843447
Snippet Clinical practice guidelines (CPGs) can play a crucial role in achieving better and more cost-efficient health care. This requires training health care...
SourceID pubmedcentral
proquest
pubmed
crossref
SourceType Open Access Repository
Aggregation Database
Index Database
StartPage e200198
Subtitle A Mixed-Method Evaluation Study
Title Curriculum Innovations: Teaching Residents About Guideline Development and Cost-Conscious Care
URI https://www.ncbi.nlm.nih.gov/pubmed/40041757
https://www.proquest.com/docview/3174103384
https://pubmed.ncbi.nlm.nih.gov/PMC11879470
Volume 4
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 2771-9979
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0003313369
  issn: 2771-9979
  databaseCode: M~E
  dateStart: 20220101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1LaxsxEBZOWkovpe-6j6BCr0r3rVVvwaTpoWtKSYJPXbRaKXEJ6xDbIaf8ifzhzkj7dEJpDvVhWWQjZM0naWb0zQwhn8A-E2EsOQuk0SwqtGBSpSXzk6AwKlGqtBHex9_5dJrOZuLHaHTTxMJcnvGqSq-uxPl_FTW0gbAxdPYe4m47hQZ4B6HDE8QOz38S_KR16sHib0qeLp0bvWZO_tRYpBMJMHuWl3ywxmRXqG_2OET2WmGyWK4YFvVUliuL0Up9ddam9kC__G7HFOl83L8X7vIjA3u8A-GxZQA4MmV3p390ti5cbFmGHMymGaOrMom1RU7saXFwOgcMN1yA2lsRxB1dy21qAec-E8IVkNnVd7TVu3K0Cb5bez0cuiCL6b5wOSjtBxlirqr1MLX2xpHXEhHRBIJ-cugl3-xlizwIeCyQJ5hdd467MASz3pZKbMddh2RCR5_vGs5Q5bllx2zScXv6zeFT8qQ2TOieA9QzMtLVc_Ioq6kXL8ivDle0h6svtEEVbVFFLapoiyraQxUFVNEhqiii6iU5-rp_OPnG6uIcTPkx91gMeq0EzYanJim5l0YmSX0TGt-XwuhYFEKWoQENHpd-4XFR6qhQfqgKePOFCV-R7WpR6TeEJjqSYFWXBm13qYUUoghN4ukkVlIFwZiwZv7yc5eDJf-b4MbkYzPJOWyWeAMmKw3_JwdlOfJBgmk0Jq_dpLc94mEGujQfk3QgjvYHmIh9-E01P7UJ2cFIh2ONe2_vOdB35HG3Rt6T7dXFWn8gD9Xlar682CFbfJbuWPD9ARQHqEk
linkProvider ISSN International Centre
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Curriculum+Innovations%3A+Teaching+Residents+About+Guideline+Development+and+Cost-Conscious+Care&rft.jtitle=Neurology.+Education&rft.au=Majoie%2C+Marian&rft.au=Visser%2C+Anne&rft.au=Ulubas%2C+Merve&rft.au=van+Mastrigt%2C+Ghislaine&rft.date=2025-03-01&rft.issn=2771-9979&rft.eissn=2771-9979&rft.volume=4&rft.issue=1&rft_id=info:doi/10.1212%2FNE9.0000000000200198&rft.externalDBID=n%2Fa&rft.externalDocID=10_1212_NE9_0000000000200198
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2771-9979&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2771-9979&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2771-9979&client=summon