Learning Theory and Educational Intervention: Producing Meaningful Evidence of Impact Through Layered Analysis

Like evidence-based medicine, evidence-based education seeks to produce sound evidence of impact that can be used to intervene successfully in the future. The function of educational innovations, however, is much less well understood than the physical mechanisms of action of medical treatments. This...

Full description

Saved in:
Bibliographic Details
Published in:Academic medicine Vol. 94; no. 6; p. 789
Main Authors: Cianciolo, Anna T, Regehr, Glenn
Format: Journal Article
Language:English
Published: United States 01.06.2019
Subjects:
ISSN:1938-808X, 1938-808X
Online Access:Get more information
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Like evidence-based medicine, evidence-based education seeks to produce sound evidence of impact that can be used to intervene successfully in the future. The function of educational innovations, however, is much less well understood than the physical mechanisms of action of medical treatments. This makes production, interpretation, and use of educational impact evidence difficult. Critiques of medical education experiments highlight a need for such studies to do a better job of deepening understanding of learning in context; conclusions that "it worked" often precede scrutiny of what "it" was. The authors unpack the problem of representing educational innovation in a conceptually meaningful way. The more fundamental questions of "What is the intended intervention?" and "Did that intervention, in fact, occur?" are proposed as an alternative to the ubiquitous evaluative question of "Did it work?" The authors excavate the layers of intervention-techniques at the surface, principle in the middle, and philosophy at the core-and propose layered analysis as a way of examining an innovation's intended function in context. The authors then use problem-based learning to illustrate how layered analysis can promote meaningful understanding of impact through specification of what was tried, under what circumstances, and what happened as a result. Layered analysis should support innovation design and evaluation by illuminating what principled adaptation of educational technique to local context could look like. It also promotes theory development by enabling more precise description of the learning conditions at work in a given implementation and how they may evolve with broader adoption.
AbstractList Like evidence-based medicine, evidence-based education seeks to produce sound evidence of impact that can be used to intervene successfully in the future. The function of educational innovations, however, is much less well understood than the physical mechanisms of action of medical treatments. This makes production, interpretation, and use of educational impact evidence difficult. Critiques of medical education experiments highlight a need for such studies to do a better job of deepening understanding of learning in context; conclusions that "it worked" often precede scrutiny of what "it" was. The authors unpack the problem of representing educational innovation in a conceptually meaningful way. The more fundamental questions of "What is the intended intervention?" and "Did that intervention, in fact, occur?" are proposed as an alternative to the ubiquitous evaluative question of "Did it work?" The authors excavate the layers of intervention-techniques at the surface, principle in the middle, and philosophy at the core-and propose layered analysis as a way of examining an innovation's intended function in context. The authors then use problem-based learning to illustrate how layered analysis can promote meaningful understanding of impact through specification of what was tried, under what circumstances, and what happened as a result. Layered analysis should support innovation design and evaluation by illuminating what principled adaptation of educational technique to local context could look like. It also promotes theory development by enabling more precise description of the learning conditions at work in a given implementation and how they may evolve with broader adoption.Like evidence-based medicine, evidence-based education seeks to produce sound evidence of impact that can be used to intervene successfully in the future. The function of educational innovations, however, is much less well understood than the physical mechanisms of action of medical treatments. This makes production, interpretation, and use of educational impact evidence difficult. Critiques of medical education experiments highlight a need for such studies to do a better job of deepening understanding of learning in context; conclusions that "it worked" often precede scrutiny of what "it" was. The authors unpack the problem of representing educational innovation in a conceptually meaningful way. The more fundamental questions of "What is the intended intervention?" and "Did that intervention, in fact, occur?" are proposed as an alternative to the ubiquitous evaluative question of "Did it work?" The authors excavate the layers of intervention-techniques at the surface, principle in the middle, and philosophy at the core-and propose layered analysis as a way of examining an innovation's intended function in context. The authors then use problem-based learning to illustrate how layered analysis can promote meaningful understanding of impact through specification of what was tried, under what circumstances, and what happened as a result. Layered analysis should support innovation design and evaluation by illuminating what principled adaptation of educational technique to local context could look like. It also promotes theory development by enabling more precise description of the learning conditions at work in a given implementation and how they may evolve with broader adoption.
Like evidence-based medicine, evidence-based education seeks to produce sound evidence of impact that can be used to intervene successfully in the future. The function of educational innovations, however, is much less well understood than the physical mechanisms of action of medical treatments. This makes production, interpretation, and use of educational impact evidence difficult. Critiques of medical education experiments highlight a need for such studies to do a better job of deepening understanding of learning in context; conclusions that "it worked" often precede scrutiny of what "it" was. The authors unpack the problem of representing educational innovation in a conceptually meaningful way. The more fundamental questions of "What is the intended intervention?" and "Did that intervention, in fact, occur?" are proposed as an alternative to the ubiquitous evaluative question of "Did it work?" The authors excavate the layers of intervention-techniques at the surface, principle in the middle, and philosophy at the core-and propose layered analysis as a way of examining an innovation's intended function in context. The authors then use problem-based learning to illustrate how layered analysis can promote meaningful understanding of impact through specification of what was tried, under what circumstances, and what happened as a result. Layered analysis should support innovation design and evaluation by illuminating what principled adaptation of educational technique to local context could look like. It also promotes theory development by enabling more precise description of the learning conditions at work in a given implementation and how they may evolve with broader adoption.
Author Regehr, Glenn
Cianciolo, Anna T
Author_xml – sequence: 1
  givenname: Anna T
  surname: Cianciolo
  fullname: Cianciolo, Anna T
  organization: A.T. Cianciolo is associate professor of medical education, Southern Illinois University School of Medicine, Springfield, Illinois; ORCID: https://orcid.org/0000-0001-5948-9304. G. Regehr is professor, Department of Surgery, and associate director, Center for Health Education Scholarship, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada; ORCID: https://orcid.org/0000-0002-3144-331X
– sequence: 2
  givenname: Glenn
  surname: Regehr
  fullname: Regehr, Glenn
BackLink https://www.ncbi.nlm.nih.gov/pubmed/30640265$$D View this record in MEDLINE/PubMed
BookMark eNpNkMtOwzAQRS1URB_wBwh5ySbFjzhO2FVVgUqpYFEkdpFjT9qgxCl2Uil_T8pD6mxmrubMWcwUjWxjAaFbSuaUJPJhsdzMyVkxkdALNKEJj4OYxB-js3mMpt5_DlAkBb9CY06ikLBITJBNQTlb2h3e7qFxPVbW4JXptGrLxqoKr20L7gj2FB_xm2uG3QnfgDqdFV2FV8fSgNWAmwKv64PS7SBzTbfb41T14MDgxaDqfemv0WWhKg83f32G3p9W2-VLkL4-r5eLNNBcRDSIaE4ElXGYRyHXEYFYSy2hoDLRNFFSmoQYo1lugOUQi1gD4UwZ-hOVYjN0_-s9uOarA99mdek1VJWy0HQ-Y4OJ81CIcEDv_tAur8FkB1fWyvXZ_4_YN7M1bRY
CitedBy_id crossref_primary_10_1002_acr_25203
crossref_primary_10_1097_CEH_0000000000000542
crossref_primary_10_1186_s13643_021_01832_0
crossref_primary_10_1080_0142159X_2023_2289850
crossref_primary_10_1136_bmjopen_2021_049862
crossref_primary_10_1111_medu_14654
crossref_primary_10_1097_ACM_0000000000005826
crossref_primary_10_1111_tct_13775
crossref_primary_10_1111_medu_14281
crossref_primary_10_1007_S40037_022_00701_3
crossref_primary_10_1016_j_rdc_2019_09_004
crossref_primary_10_1016_j_heliyon_2024_e28133
crossref_primary_10_1108_EJTD_03_2024_0038
crossref_primary_10_1111_medu_15374
crossref_primary_10_1080_10401334_2020_1779070
crossref_primary_10_3389_fmed_2023_1017783
crossref_primary_10_1007_s10459_021_10083_6
crossref_primary_10_1007_S40037_019_00551_6
crossref_primary_10_1007_s40670_021_01259_1
crossref_primary_10_1016_j_acap_2020_07_005
crossref_primary_10_3390_healthcare10081584
crossref_primary_10_7202_1118374ar
crossref_primary_10_1186_s12912_022_00943_w
crossref_primary_10_1007_s10459_022_10119_5
crossref_primary_10_1186_s12909_024_05186_8
crossref_primary_10_1111_tct_13800
crossref_primary_10_36834_cmej_78199
crossref_primary_10_1111_medu_15218
crossref_primary_10_1080_10401334_2023_2215755
crossref_primary_10_1097_SIH_0000000000000758
crossref_primary_10_1097_ACM_0000000000004075
crossref_primary_10_1080_0142159X_2022_2105200
crossref_primary_10_1007_s10459_022_10184_w
crossref_primary_10_1002_prp2_762
crossref_primary_10_1007_s10459_019_09945_x
crossref_primary_10_1007_s10459_019_09946_w
crossref_primary_10_1007_S40037_020_00603_2
ContentType Journal Article
DBID CGR
CUY
CVF
ECM
EIF
NPM
7X8
DOI 10.1097/ACM.0000000000002591
DatabaseName Medline
MEDLINE
MEDLINE (Ovid)
MEDLINE
MEDLINE
PubMed
MEDLINE - Academic
DatabaseTitle MEDLINE
Medline Complete
MEDLINE with Full Text
PubMed
MEDLINE (Ovid)
MEDLINE - Academic
DatabaseTitleList MEDLINE - Academic
MEDLINE
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 2
  dbid: 7X8
  name: MEDLINE - Academic
  url: https://search.proquest.com/medline
  sourceTypes: Aggregation Database
DeliveryMethod no_fulltext_linktorsrc
Discipline Medicine
Education
EISSN 1938-808X
ExternalDocumentID 30640265
Genre Research Support, Non-U.S. Gov't
Journal Article
GroupedDBID ---
.-D
.3C
.55
.GJ
.Z2
01R
07C
0R~
1CY
1J1
23M
2FS
3O-
40H
4Q1
4Q2
4Q3
53G
5GY
5RE
5VS
77Y
7O~
AAAAV
AAAXR
AAGIX
AAHPQ
AAIQE
AAMOA
AAMTA
AAQKA
AARTV
AASCR
AASOK
AAWTL
AAXQO
ABASU
ABBUW
ABDIG
ABIVO
ABJNI
ABVCZ
ABXVJ
ABZAD
ACCJW
ACDDN
ACEWG
ACGFO
ACGFS
ACIJW
ACILI
ACLDA
ACNCT
ACNWC
ACWDW
ACWRI
ACXJB
ACXNZ
ADFPA
ADGGA
ADHPY
ADNKB
AE3
AEETU
AENEX
AFDTB
AFFNX
AFUWQ
AGINI
AHJKT
AHOMT
AHQNM
AHRYX
AHVBC
AI.
AIJEX
AINUH
AJCLO
AJIOK
AJNWD
AJNYG
AJZMW
AKCTQ
AKULP
ALKUP
ALMA_UNASSIGNED_HOLDINGS
ALMTX
AMJPA
AMKUR
AMNEI
AOHHW
AWKKM
BOYCO
BQLVK
BS7
BYPQX
C1A
C45
CGR
CS3
CUY
CVF
DIWNM
DUNZO
E.X
EBS
ECM
EEVPB
EIF
EJD
ERAAH
EX3
F2K
F2L
F2M
F2N
F5P
FCALG
FL-
FW0
GNXGY
GQDEL
H0~
HLJTE
HZ~
H~9
IKREB
IKYAY
IN~
IPNFZ
J5H
JF9
JG8
JK3
JK8
K8S
KD2
KMI
L-C
L7B
MVM
MZP
N4W
N9A
NEJ
NPM
N~7
N~B
N~M
O9-
OAG
OAH
OCUKA
ODA
OHT
OJAPA
OK1
OLG
OLH
OLU
OLV
OLW
OLY
OLZ
OPUJH
ORVUJ
OUVQU
OVD
OVDNE
OVIDH
OVLEI
OWU
OWV
OWW
OWX
OWY
OWZ
OXXIT
P-K
P2P
P6G
PKN
R58
RIG
RLZ
S4R
S4S
SJN
T8P
TEORI
TR2
TSPGW
TWZ
V2I
VH1
VVN
W3M
WF8
WF9
WH7
WOQ
WOW
X3V
X3W
X7M
XJT
XYM
YCJ
YHG
YR5
ZCG
ZFV
ZGI
ZXP
ZY1
ZZMQN
7X8
AAFWJ
ABPXF
ABZZY
ACZKN
AFBFQ
AOQMC
ID FETCH-LOGICAL-c3561-61b051784b643c60e8c7c7ef179c19a77d90ddc2bde2be858ce032ad1e2be8aa2
IEDL.DBID 7X8
ISICitedReferencesCount 46
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000474067900020&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1938-808X
IngestDate Fri Jul 11 10:56:50 EDT 2025
Wed Feb 19 02:31:05 EST 2025
IsPeerReviewed true
IsScholarly true
Issue 6
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c3561-61b051784b643c60e8c7c7ef179c19a77d90ddc2bde2be858ce032ad1e2be8aa2
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
PMID 30640265
PQID 2179334554
PQPubID 23479
ParticipantIDs proquest_miscellaneous_2179334554
pubmed_primary_30640265
PublicationCentury 2000
PublicationDate 2019-06-00
20190601
PublicationDateYYYYMMDD 2019-06-01
PublicationDate_xml – month: 06
  year: 2019
  text: 2019-06-00
PublicationDecade 2010
PublicationPlace United States
PublicationPlace_xml – name: United States
PublicationTitle Academic medicine
PublicationTitleAlternate Acad Med
PublicationYear 2019
SSID ssj0006753
Score 2.4913836
SecondaryResourceType review_article
Snippet Like evidence-based medicine, evidence-based education seeks to produce sound evidence of impact that can be used to intervene successfully in the future. The...
SourceID proquest
pubmed
SourceType Aggregation Database
Index Database
StartPage 789
SubjectTerms Diffusion of Innovation
Education, Medical - methods
Education, Medical - trends
Evaluation Studies as Topic
Evidence-Based Medicine - education
Humans
Learning - physiology
Models, Educational
Problem-Based Learning - methods
Title Learning Theory and Educational Intervention: Producing Meaningful Evidence of Impact Through Layered Analysis
URI https://www.ncbi.nlm.nih.gov/pubmed/30640265
https://www.proquest.com/docview/2179334554
Volume 94
WOSCitedRecordID wos000474067900020&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1bS8MwFA7qRHzxMm_zRgRfy3rJmtQXGcPhYB17UOlbya0ykHY6J_jvPUlT54sg2IdCIQltepJ8J-fk-xC6liqkPALkxqUmHokK7XFf-h7lYCyh8ImwWgRPYzqZsCxLpm7DbeHSKps50U7UqpJmj7wbGkuKCKx-t_NXz6hGmeiqk9BYR60IoIwZmDRbsYXHNQslYBQGMzHLmqNzCe32B2lNXegu8AKC30GmXWyGu_99zT2042Am7td2sY_WdNk2Cs0um6ONtlIXVD9ApeNYfcb1QX3MS4W_i0Irox95kTd4ajliTfFUc1OtWL7gRpwUVwUe2YOX0JhVAMJj_mn0QHFDf3KIHod3D4N7z8kweDICdAXOpTBEXowIQC8y9jWTVFJdwJfKIOGUqsRXSoZC6VBo1mNGgizkKrCPnIdHaKOsSn2CsE8CpXoCqpAY_HKRFL6SMXg8ESsI4ayDrppezcHMTeyCl7paLvJVv3bQcf1r8nnNx5EbJwpcyd7pH2qfoW2APEmd7HWOWgUMcn2BNuXH-2zxdmntB-6TafoFDHjPjQ
linkProvider ProQuest
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Learning+Theory+and+Educational+Intervention%3A+Producing+Meaningful+Evidence+of+Impact+Through+Layered+Analysis&rft.jtitle=Academic+medicine&rft.au=Cianciolo%2C+Anna+T&rft.au=Regehr%2C+Glenn&rft.date=2019-06-01&rft.eissn=1938-808X&rft.volume=94&rft.issue=6&rft.spage=789&rft_id=info:doi/10.1097%2FACM.0000000000002591&rft_id=info%3Apmid%2F30640265&rft_id=info%3Apmid%2F30640265&rft.externalDocID=30640265
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1938-808X&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1938-808X&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1938-808X&client=summon