Assessment of Basic Orthopedic Surgical Skills in a Low-Cost Simulation-Based Setting: A Validation Study

Basic orthopedic surgery skills (BOSS) have been identified as critical in resident surgeons' training. Costs and limited evidence hinder integrating simulation training into resident surgeons' curricula. This study aimed to gather validity evidence for a low-cost simulation-based test to...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Simulation in healthcare : journal of the Society for Medical Simulation
Hauptverfasser: Schmidt, Jacob J, Nielsen, Anders B, Christensen, Thomas B, Kallesen, Mette, Gustafsson, Amandus, Viberg, Bjarke
Format: Journal Article
Sprache:Dänisch
Englisch
Veröffentlicht: United States 04.08.2025
Schlagworte:
assessment
basic surgery skills
education
competency-based education
orthopedic surgery
Simulation-based training
low-cost
ISSN:1559-713X, 1559-713X
Online-Zugang:Weitere Angaben
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Basic orthopedic surgery skills (BOSS) have been identified as critical in resident surgeons' training. Costs and limited evidence hinder integrating simulation training into resident surgeons' curricula. This study aimed to gather validity evidence for a low-cost simulation-based test to assess BOSS. We modified 5 practical stations testing BOSS from a previous study. All stations were made of standard items from hardware stores and 3D prints. The Messick framework was used to gather validity evidence for the tests. A novice and an expert group were invited to participate and repeated testing each station until the plateau score was reached. The Levene test and Student t test were applied to compare performances. The expert group's mean plateau score was used as pass/fail score. Another novice group was invited to perform the test. The total costs were less than 900 USD for all stations. We included 11 novices and 9 experts yielding an interclass correlation coefficient (ICC) of 0.40 to 0.95, demonstrating moderate to high reliability. The mean plateau scores for the 5 stations were 2.6 to 17.9 mm for the novice group. The expert group performed statistically significantly better (0.9-6.9 mm, P-value of 0.002-0.022) and the mastery standard was defined as the experts' mean. A second novice group (n = 10) all achieved the mastery standard across all stations after a median of 53.5 attempts (IQR: 33-85.5) and 61.5 minutes (IQR: 45.2-111.2). We modified a low-cost, practical test to assess BOSS with supporting validity evidence. A credible mastery standard was established enabling evidence-based and objective testing for assessing BOSS.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:1559-713X
1559-713X
DOI:10.1097/SIH.0000000000000878