View in EDS

Development and validation of a new tool for assessment of trainees’ interventional musculoskeletal ultrasound skills

Saved in:
Bibliographic Details
Title: Development and validation of a new tool for assessment of trainees’ interventional musculoskeletal ultrasound skills
Authors: Stine Maya Dreier Carstensen, Søren Andreas Just, Mogens Pfeiffer-Jensen, Mikkel Østergaard, Lars Konge, Lene Terslev
Source: Rheumatology. 64:484-492
Publisher Information: Oxford University Press (OUP), 2024.
Publication Year: 2024
Subject Terms: Male, assessment, 03 medical and health sciences, 0302 clinical medicine, Interventional/methods, Rheumatology, education research, Musculoskeletal System/diagnostic imaging, injection training, Humans, Musculoskeletal Diseases/diagnostic imaging, Musculoskeletal Diseases, Ultrasonography, Interventional, Ultrasonography, training, Educational Measurement/methods, Reproducibility of Results, competency-based education, 3. Good health, Female, Clinical Competence, Educational Measurement, Rheumatology/education, medical education, musculoskeletal ultrasound, ultrasound competence
Description: Objectives Interventional musculoskeletal ultrasound (MSUS) procedures are routinely performed in rheumatology practice. However, the efficacy and safety of the procedures rely on the competence of the physician, and assessment of skills is crucial. Thus, this study aimed to develop and establish validity evidence for a tool assessing trainees' interventional MSUS skills. Methods An expert panel of rheumatologists modified an existing tool for assessing competences in invasive abdominal and thoracic ultrasound procedures. The new tool (the Assessment of Interventional Musculoskeletal Ultrasound Skills [AIMUS] tool) reflects the essential steps in interventional MSUS. To establish validity evidence, physicians with different levels of interventional MSUS experience were enrolled and performed two procedures on a rubber phantom, simulating real patient cases. All performances were video-recorded, anonymized and assessed in random order by two blinded raters using the AIMUS tool. Results 65 physicians from 21 different countries were included and categorized into groups based on their experience, resulting in 130 videos for analysis. The internal consistency of the tool was excellent, with a Cronbach’s α of 0.96. The inter-case reliability was good with a Pearson’s correlation coefficient (PCC) of 0.74 and the inter-rater reliability was moderate to good (PCC 0.58). The ability to discriminate between different levels of experience was highly significant (P Conclusion We have developed and established validity evidence for a new interventional MSUS assessment tool. The tool can be applied in future competency-based educational programmes, provide structured feedback to trainees in daily clinical practice and ensure end-of-training competence. Trial registration ClinicalTrials.gov, http://clinicaltrials.gov, NCT05303974.
Document Type: Article
Language: English
ISSN: 1462-0332
1462-0324
DOI: 10.1093/rheumatology/keae050
Access URL: https://pubmed.ncbi.nlm.nih.gov/38273715
Rights: OUP Standard Publication Reuse
Accession Number: edsair.doi.dedup.....f0d9f79313f717c292e5161d14d52a29
Database: OpenAIRE
Description
Abstract:Objectives Interventional musculoskeletal ultrasound (MSUS) procedures are routinely performed in rheumatology practice. However, the efficacy and safety of the procedures rely on the competence of the physician, and assessment of skills is crucial. Thus, this study aimed to develop and establish validity evidence for a tool assessing trainees' interventional MSUS skills. Methods An expert panel of rheumatologists modified an existing tool for assessing competences in invasive abdominal and thoracic ultrasound procedures. The new tool (the Assessment of Interventional Musculoskeletal Ultrasound Skills [AIMUS] tool) reflects the essential steps in interventional MSUS. To establish validity evidence, physicians with different levels of interventional MSUS experience were enrolled and performed two procedures on a rubber phantom, simulating real patient cases. All performances were video-recorded, anonymized and assessed in random order by two blinded raters using the AIMUS tool. Results 65 physicians from 21 different countries were included and categorized into groups based on their experience, resulting in 130 videos for analysis. The internal consistency of the tool was excellent, with a Cronbach’s α of 0.96. The inter-case reliability was good with a Pearson’s correlation coefficient (PCC) of 0.74 and the inter-rater reliability was moderate to good (PCC 0.58). The ability to discriminate between different levels of experience was highly significant (P Conclusion We have developed and established validity evidence for a new interventional MSUS assessment tool. The tool can be applied in future competency-based educational programmes, provide structured feedback to trainees in daily clinical practice and ensure end-of-training competence. Trial registration ClinicalTrials.gov, http://clinicaltrials.gov, NCT05303974.
ISSN:14620332
14620324
DOI:10.1093/rheumatology/keae050