Tailored Feedback Based on Clinically Relevant Performance Metrics Expedites the Acquisition of Robotic Suturing Skills-An Unblinded Pilot Randomized Controlled Trial
Previously, we identified 8 objective suturing performance metrics highly predictive of urinary continence recovery after robotic-assisted radical prostatectomy. Here, we aimed to test the feasibility of providing tailored feedback based upon these clinically relevant metrics and explore the impact...
Saved in:
| Published in: | The Journal of urology Vol. 208; no. 2; p. 101097JU0000000000002691 |
|---|---|
| Main Authors: | , , , , , , , , , , |
| Format: | Journal Article |
| Language: | English |
| Published: |
United States
01.08.2022
|
| Subjects: | |
| ISSN: | 1527-3792, 1527-3792 |
| Online Access: | Get more information |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | Previously, we identified 8 objective suturing performance metrics highly predictive of urinary continence recovery after robotic-assisted radical prostatectomy. Here, we aimed to test the feasibility of providing tailored feedback based upon these clinically relevant metrics and explore the impact on the acquisition of robotic suturing skills.
Training surgeons were recruited and randomized to a feedback group or a control group. Both groups completed a baseline, midterm and final dry laboratory vesicourethral anastomosis (VUA) and underwent 4 intervening training sessions each, consisting of 3 suturing exercises. Eight performance metrics were recorded during each exercise: 4 automated performance metrics (derived from kinematic and system events data of the da Vinci® Robotic System) representing efficiency and console manipulation competency, and 4 suturing technical skill scores. The feedback group received tailored feedback (a visual diagram+verbal instructions+video examples) based on these metrics after each session. Generalized linear mixed model was used to compare metric improvement (Δ) from baseline to the midterm and final VUA.
Twenty-three participants were randomized to the feedback group (11) or the control group (12). Demographic data and baseline VUA metrics were comparable between groups. The feedback group showed greater improvement than the control group in aggregate suturing scores at midterm (mean Δ feedback group 4.5 vs Δ control group 1.1) and final VUA (Δ feedback group 5.3 vs Δ control group 4.9). The feedback group also showed greater improvement in the majority of the included metrics at midterm and final VUA.
Tailored feedback based on specific, clinically relevant performance metrics is feasible and may expedite the acquisition of robotic suturing skills. |
|---|---|
| AbstractList | Previously, we identified 8 objective suturing performance metrics highly predictive of urinary continence recovery after robotic-assisted radical prostatectomy. Here, we aimed to test the feasibility of providing tailored feedback based upon these clinically relevant metrics and explore the impact on the acquisition of robotic suturing skills.
Training surgeons were recruited and randomized to a feedback group or a control group. Both groups completed a baseline, midterm and final dry laboratory vesicourethral anastomosis (VUA) and underwent 4 intervening training sessions each, consisting of 3 suturing exercises. Eight performance metrics were recorded during each exercise: 4 automated performance metrics (derived from kinematic and system events data of the da Vinci® Robotic System) representing efficiency and console manipulation competency, and 4 suturing technical skill scores. The feedback group received tailored feedback (a visual diagram+verbal instructions+video examples) based on these metrics after each session. Generalized linear mixed model was used to compare metric improvement (Δ) from baseline to the midterm and final VUA.
Twenty-three participants were randomized to the feedback group (11) or the control group (12). Demographic data and baseline VUA metrics were comparable between groups. The feedback group showed greater improvement than the control group in aggregate suturing scores at midterm (mean Δ feedback group 4.5 vs Δ control group 1.1) and final VUA (Δ feedback group 5.3 vs Δ control group 4.9). The feedback group also showed greater improvement in the majority of the included metrics at midterm and final VUA.
Tailored feedback based on specific, clinically relevant performance metrics is feasible and may expedite the acquisition of robotic suturing skills. Previously, we identified 8 objective suturing performance metrics highly predictive of urinary continence recovery after robotic-assisted radical prostatectomy. Here, we aimed to test the feasibility of providing tailored feedback based upon these clinically relevant metrics and explore the impact on the acquisition of robotic suturing skills.PURPOSEPreviously, we identified 8 objective suturing performance metrics highly predictive of urinary continence recovery after robotic-assisted radical prostatectomy. Here, we aimed to test the feasibility of providing tailored feedback based upon these clinically relevant metrics and explore the impact on the acquisition of robotic suturing skills.Training surgeons were recruited and randomized to a feedback group or a control group. Both groups completed a baseline, midterm and final dry laboratory vesicourethral anastomosis (VUA) and underwent 4 intervening training sessions each, consisting of 3 suturing exercises. Eight performance metrics were recorded during each exercise: 4 automated performance metrics (derived from kinematic and system events data of the da Vinci® Robotic System) representing efficiency and console manipulation competency, and 4 suturing technical skill scores. The feedback group received tailored feedback (a visual diagram+verbal instructions+video examples) based on these metrics after each session. Generalized linear mixed model was used to compare metric improvement (Δ) from baseline to the midterm and final VUA.MATERIALS AND METHODSTraining surgeons were recruited and randomized to a feedback group or a control group. Both groups completed a baseline, midterm and final dry laboratory vesicourethral anastomosis (VUA) and underwent 4 intervening training sessions each, consisting of 3 suturing exercises. Eight performance metrics were recorded during each exercise: 4 automated performance metrics (derived from kinematic and system events data of the da Vinci® Robotic System) representing efficiency and console manipulation competency, and 4 suturing technical skill scores. The feedback group received tailored feedback (a visual diagram+verbal instructions+video examples) based on these metrics after each session. Generalized linear mixed model was used to compare metric improvement (Δ) from baseline to the midterm and final VUA.Twenty-three participants were randomized to the feedback group (11) or the control group (12). Demographic data and baseline VUA metrics were comparable between groups. The feedback group showed greater improvement than the control group in aggregate suturing scores at midterm (mean Δ feedback group 4.5 vs Δ control group 1.1) and final VUA (Δ feedback group 5.3 vs Δ control group 4.9). The feedback group also showed greater improvement in the majority of the included metrics at midterm and final VUA.RESULTSTwenty-three participants were randomized to the feedback group (11) or the control group (12). Demographic data and baseline VUA metrics were comparable between groups. The feedback group showed greater improvement than the control group in aggregate suturing scores at midterm (mean Δ feedback group 4.5 vs Δ control group 1.1) and final VUA (Δ feedback group 5.3 vs Δ control group 4.9). The feedback group also showed greater improvement in the majority of the included metrics at midterm and final VUA.Tailored feedback based on specific, clinically relevant performance metrics is feasible and may expedite the acquisition of robotic suturing skills.CONCLUSIONSTailored feedback based on specific, clinically relevant performance metrics is feasible and may expedite the acquisition of robotic suturing skills. |
| Author | Cen, Steven Haque, Taseen F Robert, Sidney I Gill, Inderbir S Cowan, Andrew Ma, Runzhuo Jarc, Anthony Lee, Ryan S Nguyen, Jessica H Hung, Andrew J You, Jonathan |
| Author_xml | – sequence: 1 givenname: Runzhuo orcidid: 0000-0001-6381-2661 surname: Ma fullname: Ma, Runzhuo organization: Center for Robotic Simulation and Education, Catherine and Joseph Aresty Department of Urology, USC Institute of Urology, University of Southern California, Los Angeles, California – sequence: 2 givenname: Ryan S surname: Lee fullname: Lee, Ryan S organization: Center for Robotic Simulation and Education, Catherine and Joseph Aresty Department of Urology, USC Institute of Urology, University of Southern California, Los Angeles, California – sequence: 3 givenname: Jessica H surname: Nguyen fullname: Nguyen, Jessica H organization: Center for Robotic Simulation and Education, Catherine and Joseph Aresty Department of Urology, USC Institute of Urology, University of Southern California, Los Angeles, California – sequence: 4 givenname: Andrew surname: Cowan fullname: Cowan, Andrew organization: Center for Robotic Simulation and Education, Catherine and Joseph Aresty Department of Urology, USC Institute of Urology, University of Southern California, Los Angeles, California – sequence: 5 givenname: Taseen F surname: Haque fullname: Haque, Taseen F organization: Center for Robotic Simulation and Education, Catherine and Joseph Aresty Department of Urology, USC Institute of Urology, University of Southern California, Los Angeles, California – sequence: 6 givenname: Jonathan surname: You fullname: You, Jonathan organization: Center for Robotic Simulation and Education, Catherine and Joseph Aresty Department of Urology, USC Institute of Urology, University of Southern California, Los Angeles, California – sequence: 7 givenname: Sidney I surname: Robert fullname: Robert, Sidney I organization: Center for Robotic Simulation and Education, Catherine and Joseph Aresty Department of Urology, USC Institute of Urology, University of Southern California, Los Angeles, California – sequence: 8 givenname: Steven surname: Cen fullname: Cen, Steven organization: Department of Radiology, Keck School of Medicine, University of Southern California, Los Angeles, California – sequence: 9 givenname: Anthony surname: Jarc fullname: Jarc, Anthony organization: Medical Research, Intuitive Surgical Inc., Norcross, Georgia – sequence: 10 givenname: Inderbir S surname: Gill fullname: Gill, Inderbir S organization: Center for Robotic Simulation and Education, Catherine and Joseph Aresty Department of Urology, USC Institute of Urology, University of Southern California, Los Angeles, California – sequence: 11 givenname: Andrew J orcidid: 0000-0002-7201-6736 surname: Hung fullname: Hung, Andrew J organization: Center for Robotic Simulation and Education, Catherine and Joseph Aresty Department of Urology, USC Institute of Urology, University of Southern California, Los Angeles, California |
| BackLink | https://www.ncbi.nlm.nih.gov/pubmed/35394359$$D View this record in MEDLINE/PubMed |
| BookMark | eNpNUNtKAzEQDVKxF_0CQfLoy9bd7DWPtbReqFh6eS7Z7KzGZpM2yYr1g_xOA1boMDBnDsM5M9NHHaUVIHQdhcMopPnd83oYngTJaHSGelFK8iDOKemc4C7qW_sRhlGS5uQCdeM0pkmc0h76WTEhtYEKTwGqkvEtvmfWt1rhsRRKcCblAS9AwidTDs_B1No0THHAL-CM4BZPvnZQCQcWu3fAI75vhRVOeAVd44UutRMcL1vXGqHe8HIrpLTBSOG1Kr1D5c3mfgeHF0xVuhHfnhhr5YyW0sOVEUxeovOaSQtXxzpA6-lkNX4MZq8PT-PRLOD-pCjIszKuC0h9JjzOCs6KLGJxRaDKywRIwaHOCppyz5YJJSykLE_zuqYQJjyqyQDd_unujN63YN2mEZaDlEyBbu2GZElRUC9B_OjNcbQtG6g2OyMaZg6b_9-SX0WwgSk |
| CitedBy_id | crossref_primary_10_1097_JU_0000000000003897 crossref_primary_10_1016_j_amjsurg_2025_116262 crossref_primary_10_1016_j_mcpdig_2025_100257 crossref_primary_10_1016_j_cpsurg_2024_101666 crossref_primary_10_1016_j_euros_2022_09_015 crossref_primary_10_1001_jamanetworkopen_2023_20702 crossref_primary_10_1007_s00464_023_10432_z crossref_primary_10_1007_s00464_023_10041_w crossref_primary_10_1007_s11701_024_01867_0 crossref_primary_10_1007_s11701_024_02065_8 crossref_primary_10_1007_s11701_022_01457_y crossref_primary_10_1038_s41746_024_01383_3 crossref_primary_10_1016_j_jss_2024_07_103 crossref_primary_10_1097_XCS_0000000000001208 crossref_primary_10_1007_s00464_024_11472_9 crossref_primary_10_3389_fmed_2024_1382609 crossref_primary_10_1007_s00464_023_10481_4 crossref_primary_10_1097_MOU_0000000000001141 crossref_primary_10_1007_s11701_025_02670_1 crossref_primary_10_1038_s41746_022_00738_y |
| ContentType | Journal Article |
| DBID | NPM 7X8 |
| DOI | 10.1097/JU.0000000000002691 |
| DatabaseName | PubMed MEDLINE - Academic |
| DatabaseTitle | PubMed MEDLINE - Academic |
| DatabaseTitleList | PubMed MEDLINE - Academic |
| Database_xml | – sequence: 1 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database |
| DeliveryMethod | no_fulltext_linktorsrc |
| Discipline | Medicine |
| EISSN | 1527-3792 |
| ExternalDocumentID | 35394359 |
| Genre | Journal Article |
| GroupedDBID | --- --K .XZ 0R~ 123 1B1 354 4.4 457 4Q1 4Q2 4Q3 53G 5RE AAAAV AAEDT AAGIX AAHPQ AAIQE AAJCS AAMOA AAQKA AASCR AASXQ ABASU ABCQX ABDIG ABJNI ABLJU ABOCM ABPPZ ABPXF ABVCZ ABXYN ABZZY ACGFS ACILI ACLDA ACOAL ACXJB ACZKN ADGGA ADHPY AEBDS AENEX AFBFQ AFDTB AFEXH AFNMH AFUWQ AHOMT AHQNM AHQVU AINUH AJCLO AJIOK AJNWD AJZMW AKCTQ AKULP ALKUP ALMA_UNASSIGNED_HOLDINGS ALMTX AMJPA AMKUR AMNEI AOQMC ASGHL BCGUY BELOY BYPQX C45 C5W CS3 DIWNM DU5 EBS EEVPB EJD ERAAH EX3 F5P FCALG FDB GBLVA GNXGY GQDEL HLJTE IH2 IHE IKREB IKYAY IPNFZ KMI L7B MJL MO0 NPM O9- OAG OAH OB3 OBH ODMTH OGROG OL1 OVD OWW OWY P2P RIG RLZ RPZ SEL SES SJN SSZ TEORI TSPGW UNMZH UV1 VVN WOW XH2 YFH YOC ZFV ZY1 7X8 ACBKD ADKSD ADSXY |
| ID | FETCH-LOGICAL-c3531-76b3f8e58e54c368ca861a3d2ed7b4e28cef6895c61ab492a09a757ff9e04c1f2 |
| IEDL.DBID | 7X8 |
| ISICitedReferencesCount | 25 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000823292100042&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 1527-3792 |
| IngestDate | Sun Nov 09 14:06:20 EST 2025 Mon Jul 21 06:00:38 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 2 |
| Keywords | robotics formative feedback education, medical |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c3531-76b3f8e58e54c368ca861a3d2ed7b4e28cef6895c61ab492a09a757ff9e04c1f2 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 ObjectType-Undefined-3 |
| ORCID | 0000-0001-6381-2661 0000-0002-7201-6736 |
| PMID | 35394359 |
| PQID | 2648896892 |
| PQPubID | 23479 |
| ParticipantIDs | proquest_miscellaneous_2648896892 pubmed_primary_35394359 |
| PublicationCentury | 2000 |
| PublicationDate | 2022-August |
| PublicationDateYYYYMMDD | 2022-08-01 |
| PublicationDate_xml | – month: 08 year: 2022 text: 2022-August |
| PublicationDecade | 2020 |
| PublicationPlace | United States |
| PublicationPlace_xml | – name: United States |
| PublicationTitle | The Journal of urology |
| PublicationTitleAlternate | J Urol |
| PublicationYear | 2022 |
| SSID | ssj0014572 |
| Score | 2.5116496 |
| Snippet | Previously, we identified 8 objective suturing performance metrics highly predictive of urinary continence recovery after robotic-assisted radical... |
| SourceID | proquest pubmed |
| SourceType | Aggregation Database Index Database |
| StartPage | 101097JU0000000000002691 |
| Title | Tailored Feedback Based on Clinically Relevant Performance Metrics Expedites the Acquisition of Robotic Suturing Skills-An Unblinded Pilot Randomized Controlled Trial |
| URI | https://www.ncbi.nlm.nih.gov/pubmed/35394359 https://www.proquest.com/docview/2648896892 |
| Volume | 208 |
| WOSCitedRecordID | wos000823292100042&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3da9swEBdbO8Ze9v3Rrhs32KuoI8uW7qmkpaGMJYQ0GXkL1heYenY7t4PtD-rfuZPtkKfBYMYYIxASujvdSXf3O8Y-owsmplhy76TgUqYJR4vI89TkGkNmZXd18e2rms30eo3z4cKtHcIqt3tit1G7xsY78uMYiaWR-ouT6xseq0ZF7-pQQuMh20_JlIlcrdY7L4LMuuJNsXIrCRKKLeoQquMvqx65cHhEjqO_25idrpk8-99ZPmdPBysTxj1bvGAPfP2SPZ4OfvRX7H5ZlHRQ9w4mpL1MYa_glNSZg6aGASm0qn7BIiaf09LDfJdeANNYg8u2EEGSHQ3bAtmQMLY3d2Uf_wVNgEVjGhobLiNkCWlHuLwqq6rl4xpWtakiRqODOc3hFhZF7Zrv5W9qOOvj5iv6XUbBeM1Wk_Pl2QUfKjZwm5Iwc5WbNGif0Sttmmtb6HxUpE54p4z0QlsfaHEyS61GoigSLFSmQkCfSDsK4g3bq5vav2OQCCuEdVqQBSrjIc3IxAQMCpPU6aAO2KctBTYkEdHNUdS-uWs3OxocsLc9GTfXPXTHhmaJZCDi4T_0fs-eiJjr0EX7HbH9QPuB_8Ae2Z-3ZfvjY8dq9J3Np38AFwLfeg |
| linkProvider | ProQuest |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Tailored+Feedback+Based+on+Clinically+Relevant+Performance+Metrics+Expedites+the+Acquisition+of+Robotic+Suturing+Skills-An+Unblinded+Pilot+Randomized+Controlled+Trial&rft.jtitle=The+Journal+of+urology&rft.au=Ma%2C+Runzhuo&rft.au=Lee%2C+Ryan+S&rft.au=Nguyen%2C+Jessica+H&rft.au=Cowan%2C+Andrew&rft.date=2022-08-01&rft.issn=1527-3792&rft.eissn=1527-3792&rft.volume=208&rft.issue=2&rft.spage=414&rft_id=info:doi/10.1097%2FJU.0000000000002691&rft.externalDBID=NO_FULL_TEXT |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1527-3792&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1527-3792&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1527-3792&client=summon |