Usability and educational potential of a virtual reality software for training in a target-controlled infusion pump handling: a pilot study
Sergio Gelbvaks, Carlos Darcy Alves Bersot, José Eduardo Guimarães Pereira
Abstract
Background: Total Intravenous Anesthesia involves automated and controlled infusion of anesthetic drugs. Despite advancements in smart infusion pump technology, errors in their use remain significant, threatening patient safety. This study focused on the development and usability evaluation of a virtual reality software designed to train anesthesiologists in handling target-controlled infusion pumps during total intravenous anesthesia.
Methods: A co-creation process guided the pilot development of the software. Participants engaged in a simulated virtual reality scenario, executing tasks that mimicked real-world use of a target-controlled infusion pump. Usability was assessed using the System Usability Scale questionnaire and qualitative feedback.
Conclusion: The System Usability Scale score of 67.32 indicated a marginally acceptable level of usability. Participants positively evaluated the software in terms of realism, immersion, interactivity, and autonomy in performing tasks. Although qualitative evaluations were favorable, usability findings indicated areas for improvement to enhance the user experience and educational effectiveness of the tool.
Keywords
References
Nimmo AF, Absalom AR, Bagshaw O, Biswas A, Cook TM, Costello A, et al. Guidelines for the safe practice of total intravenous anaesthesia (TIVA). Anaesthesia. 2019;74(2):211-24. http://doi.org/10.1111/anae.14428. PMid:30378102.
Talih G, Yüksek A, Şahin E. Evaluation of emergence agitation after general anaesthesia in rhinoplasty patients: inhalation anaesthesia versus total intravenous anaesthesia. Am J Otolaryngol. 2020;41(3):102387. http://doi.org/10.1016/j.amjoto.2020.102387.
Snodrass D. Smart pump technology. Biomed Instrum Technol. 2005;39(6):444-6.
ISMP: Institute for Safe Medication Practices. Proceedings from ISMP summit on the use of smart infusion pumps: guidelines for safe implementation and use. Horsham: Institute for Safe Medication Practices; 2014.
Pang RKY, Kong DCM, Cliford JM, Lam B. Smart infusion pumps reduce intravenous medication administration errors in an Australian teaching hospital. J Pharm Pract Res. 2011;40(3):192-5. http://doi.org/10.1002/j.2055-2335.2011.tb00860.x.
Pandit JJ, Andrade J, Bogod DG, Hitchman JM, Jonker WR, Lucas N, et al. 5th National Audit Project (NAP5) on accidental awareness during general anaesthesia: summary of main findings and risk factors. Br J Anaesth. 2014;113(4):549-59. http://doi.org/10.1093/bja/aeu313. PMid:25204697. W.R
Hosny SG, Johnston MJ, Pucher P, Erridge S, Darzi A. Barriers to the implementation and uptake of simulation-based training programs in general surgery: a multinational qualitative study. J Surg Res. 2017;220:419-426.e2. http://doi.org/10.1016/j.jss.2017.07.020. PMid:28844460.
Clay CJ, Budde JR, Hoang AQ, Gushchyan A. An evaluation of the effectiveness of immersive virtual reality training in non- specialized medical procedures for caregivers and students: a brief literature review. Front Virtual Real. 2024;5:1402093. http://doi.org/10.3389/frvir.2024.1402093.
Tang MY, Chau KY, Kwok APK, Zhu T, Ma X. A systematic review of immersive technology applications for medical practice and education - Trends, application areas, recipients, teaching contents, evaluation methods, and performance. Educ Res Rev. 2022;35:100429. http://doi.org/10.1016/j.edurev.2021.100429.
Farra SN, Gneuhs M, Hodgson E, Kawosa B, Miller E, Simon A, et al. Comparative costs of virtual reality training and live exercises for training hospital workers for evacuation. Comput Inform Nurs. 2019;37(9):446-54. http://doi.org/10.1097/CIN.0000000000000540. PMid:31166203.
Millard D, Howard Y, Gilbert L, Wills G. Multiplatform E-Learning systems and technologies: mobile devices for ubiquitous ICT-Based education. IGI Global 2009;147.
Brooke J. System usability scale (SUS): a quick-and-dirty method of system evaluation user information. Reading, UK: Digital Equipment Co Ltd; 1986.
Kasurinen J. Usability issues of virtual reality learning simulator in healthcare and cybersecurity. Procedia Comput Sci. 2017;119:341-9. http://doi.org/10.1016/j.procs.2017.11.193.
Bowman DA, Gabbard JL, Hix D. A survey of usability evaluation in virtual environments: classification and comparison of methods. Presence. 2002;11(4):404-24. http://doi.org/10.1162/105474602760204309.
Maciej H, Raymond B, Maurice M, Bai L, Dix A, Leigh S, et al. System usability scale benchmarking for digital health apps: meta-analysis. JMIR Mhealth Uhealth. 2022;10(8):e37290. http://doi.org/10.2196/37290. PMid:35980732.
Submitted date:
11/13/2024
Accepted date:
05/09/2025
Facebook
Google+
Twitter
LinkedIn
Mendeley
StumbleUpon
CiteULike
Reddit
Email