Virtual Monitoring Technician Performance in High-Fidelity Simulations of Remote Patient Monitoring: An Exploratory Study.
Saved in:
| Title: | Virtual Monitoring Technician Performance in High-Fidelity Simulations of Remote Patient Monitoring: An Exploratory Study. |
|---|---|
| Authors: | Sanghavi H; From the Department of Human Factors (H.S., Y.P., E.T., L.D.W.), Center for the Simulation, Research, and Patient Safety, Carilion Clinic, Roanoke, VA; and Health Systems and Implementation Science (S.H.P.), Virginia Tech Carilion School of Medicine, Roanoke, VA., Peng Y, Tetteh E, Parker SH, Wolf LD |
| Source: | Simulation in healthcare : journal of the Society for Simulation in Healthcare [Simul Healthc] 2025 Oct 01; Vol. 20 (5), pp. 279-289. Date of Electronic Publication: 2025 Jan 13. |
| Publication Type: | Journal Article |
| Language: | English |
| Journal Info: | Publisher: Lippincott Williams & Wilkins Country of Publication: United States NLM ID: 101264408 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1559-713X (Electronic) Linking ISSN: 15592332 NLM ISO Abbreviation: Simul Healthc Subsets: MEDLINE |
| Imprint Name(s): | Original Publication: Hagerstown, MD : Lippincott Williams & Wilkins |
| MeSH Terms: | Telemetry*/methods , High Fidelity Simulation Training*, Humans ; Workload ; Task Performance and Analysis ; Female ; Male ; Adult ; Remote Patient Monitoring |
| Abstract: | Competing Interests: The authors declare no conflict of interest. Introduction: Virtual Monitor Technicians (VMTs) are crucial in remotely monitoring inpatient telemetry. However, little is known about VMT workload and intratask performance changes, and their potential impact on patient safety. This exploratory study used a high-fidelity simulation aimed to evaluate VMTs' workload and performance changes over time in telemetry monitoring and identify future research directions for performance improvement. Methods: The research team created a simulation of the current remote telemetry stations with 36 patient waveforms across 3 screens alongside a documentation screen, replicating VMTs' work. Twelve VMTs participated in a 1-hour session, and time-to-escalate and detection accuracy to auditory/visual alerts were recorded. Workload was measured using the NASA-Task Load Index. Results: The post-task NASA-Task Load Index score showed an increased workload score of 64 of 100 from a prescore of 38 of 100, with mental and temporal demands being the largest contributors. The performance of VMTs did not change significantly over time, with a 52% correct response rate. Participants' ability to detect signals was slightly better than chance ( d ' = 0.477), and they tended to be cautious in their responses, β ( M = 1.989, SD = 1.635). Urgent, Warning, and Medium audiovisual alerts were recognized in 9, 35, and 39 seconds, respectively, whereas advisory alerts (visual only) were recognized in 13 minutes. Conclusion: This study sets a foundation for future work on VMT workload expectations. Although our work is exploratory, the results indicate a significant increase in VMT workload with no decline in performance; VMTs responded most quickly and accurately to urgent alerts, whereas overall response accuracy to nonurgent alerts was marginally better than chance. Future research needs to explore techniques to improve response accuracy rate beyond the 52% measured in this study. (Copyright © 2025 Society for Simulation in Healthcare.) |
| References: | Sandau KE, Funk M, Auerbach A, et al. Update to practice standards for electrocardiographic monitoring in hospital settings: a scientific statement from the American Heart Association. Circulation 2017;136:e273–e344. doi:10.1161/CIR.0000000000000527. (PMID: 10.1161/CIR.0000000000000527) Funk M, Ruppel H, Blake N, et al. Research Use of monitor watchers in hospitals: characteristics, training, and practices. Biomed Instrum Technol 2016;50:428–438. doi:10.2345/0899-8205-50.6.428. (PMID: 10.2345/0899-8205-50.6.428) Klösch G, Zeitlhofer J, Ipsiroglu O. Revisiting the concept of vigilance. Front Psych 2022;13:874757. Drew BJ, Califf RM, Funk M, et al. Practice standards for electrocardiographic monitoring in hospital settings: an American Heart Association scientific statement from the councils on cardiovascular nursing, clinical cardiology, and cardiovascular disease in the young: endorsed by the International Society of Computerized Electrocardiology and the American Association of Critical-Care Nurses. Circulation 2004;110:2721–2746. Bonzheim KA, Gebara RI, O'Hare BM, et al. Communication strategies and timeliness of response to life critical telemetry alarms. Telemed J E Health 2011;17:241–246. doi:10.1089/tmj.2010.0139. (PMID: 10.1089/tmj.2010.0139) Segall N, Hobbs G, Granger CB, et al. Patient load effects on response time to critical arrhythmias in cardiac telemetry: a randomized trial. Crit Care Med 2015;43:1036–1042. doi:10.1097/CCM.0000000000000923. (PMID: 10.1097/CCM.0000000000000923) Adler RF, Benbunan-Fich R. The effects of task difficulty and multitasking on performance. Interact Comput 2012;27:430–439. doi:10.1093/iwc/iwu005. (PMID: 10.1093/iwc/iwu005) Adler RF, Benbunan-Fich R. Juggling on a high wire: multitasking effects on performance. Int J Hum Comput Stud 2012;70:156–168. doi:10.1016/j.ijhcs.2011.10.003. (PMID: 10.1016/j.ijhcs.2011.10.003) Wickens CD. Multiple resources and mental workload. Hum Factors 2008;50:449–455. doi:10.1518/001872008X288394. (PMID: 10.1518/001872008X288394) Wickens CD. Multiple resources and performance prediction. Theor Issues Ergon Sci 2002;3:159–177. doi:10.1080/14639220210123806. (PMID: 10.1080/14639220210123806) Ghalenoei M, Mortazavi SB, Mazloumi A, et al. Impact of workload on cognitive performance of control room operators. Cogn Technol Work 2022;24:195–207. doi:10.1007/S10111-021-00679-8/METRICS. (PMID: 10.1007/S10111-021-00679-8/METRICS) Stukshis I, Funk M, Johnson CR, et al. Accuracy of detection of clinically important dysrhythmias with and without a dedicated monitor watcher. Am J Crit Care 1997;6:312–317. Cantillon DJ, Loy M, Burkle A, et al. Association between off-site central monitoring using standardized cardiac telemetry and clinical outcomes among non-critically ill patients. JAMA 2016;316:519–524. doi:10.1001/jama.2016.10258. (PMID: 10.1001/jama.2016.10258) Segall N, Joines JA, Baldwin RD, et al. Effect of remote cardiac monitoring system design on response time to critical arrhythmias. Simul Healthc 2022;17:112–119. doi:10.1097/SIH.0000000000000610. (PMID: 10.1097/SIH.0000000000000610) Hart SG. NASA-Task Load Index (NASA-TLX); 20 years later. Proc Hum Factors Ergon Soc Annu Meet 2006;50:904–908. Hallingberg B, Turley R, Segrott J, et al. Exploratory studies to decide whether and how to proceed with full-scale evaluations of public health interventions: a systematic review of guidance. Pilot Feasibility Stud 2018;4:104. doi:10.1186/S40814-018-0290-8/TABLES/3. (PMID: 10.1186/S40814-018-0290-8/TABLES/3) Warm JS, Parasuraman R, Matthews G. Vigilance requires hard mental work and is stressful. Hum Factors 2008;50:433–441. doi:10.1518/001872008X312152. (PMID: 10.1518/001872008X312152) Teichner WH. The detection of a simple visual signal as a function of time of watch. Hum Factors 1974;16:339–352. doi:10.1177/001872087401600402. (PMID: 10.1177/001872087401600402) Diller T, Helmrich G, Dunning S, et al. The human factors analysis classification system (HFACS) applied to health care. Am J Med Qual 2013;29:181–190. doi:10.1177/1062860613491623. (PMID: 10.1177/1062860613491623) Macmillan NA, Creelman CD. Detection Theory: A User's Guide . 2nd ed: New York: Psychology Press; 2004. Hart SG. NASA Task Load Index (TLX). NASA Ames Research Center Moffett Field, CA United States. 1986. Available at: https://ntrs.nasa.gov/citations/20000021488 . Accessed February 5, 2024. Boring MJ, Ridgeway K, Shvartsman M, et al. The mental workload analysis of staff in study program of private educational organization. IOP Conf Ser Mater Sci Eng 2019;528:012018. doi:10.1088/1757-899X/528/1/012018. (PMID: 10.1088/1757-899X/528/1/012018) Rozin P, Royzman EB. Negativity Bias, Negativity dominance, and contagion. Pers Soc Psychol Rev 2001;5:5–320. doi:10.1207/S15327957PSPR0504_2. (PMID: 10.1207/S15327957PSPR0504_2) Bisseret A. Application of signal detection theory to decision making in supervisory control the effect of the operator's experience. Ergonomics 1981;24:81–94. doi:10.1080/00140138108924833. (PMID: 10.1080/00140138108924833) Wiener EL. Application of vigilance research: rare, medium, or well done? Hum Factors 1987;29:725–736. doi:10.1177/001872088702900611. (PMID: 10.1177/001872088702900611) Monteiro R, Tomé D, Neves P, et al. The interactive effect of occupational noise on attention and short-term memory: a pilot study. Noise Health 2018;20:190–198. doi:10.4103/nah.NAH_3_18. (PMID: 10.4103/nah.NAH_3_18) Patterson ES, Rayo MF, Edworthy JR, et al. Applying human factors engineering to address the telemetry alarm problem in a large medical center. Hum Factors 2022;64:126–142. doi:10.1177/00187208211018883. (PMID: 10.1177/00187208211018883) |
| Contributed Indexing: | Keywords: Human factors; remote patient monitoring; telemetry; virtual telemetry; workload |
| Entry Date(s): | Date Created: 20250113 Date Completed: 20251002 Latest Revision: 20251002 |
| Update Code: | 20251002 |
| DOI: | 10.1097/SIH.0000000000000843 |
| PMID: | 39804250 |
| Database: | MEDLINE |
Nájsť tento článok vo Web of Science | Abstract: | Competing Interests: The authors declare no conflict of interest.<br />Introduction: Virtual Monitor Technicians (VMTs) are crucial in remotely monitoring inpatient telemetry. However, little is known about VMT workload and intratask performance changes, and their potential impact on patient safety. This exploratory study used a high-fidelity simulation aimed to evaluate VMTs' workload and performance changes over time in telemetry monitoring and identify future research directions for performance improvement.<br />Methods: The research team created a simulation of the current remote telemetry stations with 36 patient waveforms across 3 screens alongside a documentation screen, replicating VMTs' work. Twelve VMTs participated in a 1-hour session, and time-to-escalate and detection accuracy to auditory/visual alerts were recorded. Workload was measured using the NASA-Task Load Index.<br />Results: The post-task NASA-Task Load Index score showed an increased workload score of 64 of 100 from a prescore of 38 of 100, with mental and temporal demands being the largest contributors. The performance of VMTs did not change significantly over time, with a 52% correct response rate. Participants' ability to detect signals was slightly better than chance ( d ' = 0.477), and they tended to be cautious in their responses, β ( M = 1.989, SD = 1.635). Urgent, Warning, and Medium audiovisual alerts were recognized in 9, 35, and 39 seconds, respectively, whereas advisory alerts (visual only) were recognized in 13 minutes.<br />Conclusion: This study sets a foundation for future work on VMT workload expectations. Although our work is exploratory, the results indicate a significant increase in VMT workload with no decline in performance; VMTs responded most quickly and accurately to urgent alerts, whereas overall response accuracy to nonurgent alerts was marginally better than chance. Future research needs to explore techniques to improve response accuracy rate beyond the 52% measured in this study.<br /> (Copyright © 2025 Society for Simulation in Healthcare.) |
|---|---|
| ISSN: | 1559-713X |
| DOI: | 10.1097/SIH.0000000000000843 |