The unique project utilizes teleteaching for burn care procedures and supports medical training scenarios within the U.S. Army’s Synthetic Training Environment.
November 17, 2021: Orlando, FL – Engineering & Computer Simulations (ECS) has delivered “Advanced Haptics Development to Support Medical Simulated Training Environments” as part of a Phase II Small Business Innovation Research (SBIR) project for the Defense Health Agency. This project includes the design and development of haptics-based virtual reality (VR) training systems to support combat medicine within the U.S. Army’s Synthetic Training Environment (STE) and allows for potential expansion to the broader medical community.
Led by Shane Taber, ECS Vice President of Operations, Orlando, this research project has been designed as an extension of Tactical Combat Casualty Care Simulation (TC3Sim) and has been implemented using the baseline of multimodal haptic-based VR research scenarios developed from TC3Sim. The SBIR project features a multiplayer teleteaching capability for the synchronous training of students while an instructor can be observing and providing increasing levels of intervention to guide students on the procedure. The system also supports a single-player experience for new users or those requiring refresher training. In addition, this project currently includes a VR solution, whereas TC3Sim is available as a desktop/tablet-based experience.
Waymon Armstrong, ECS CEO/President says: “We are proud to provide this innovative medical training to our Soldiers within the Army’s STE systems. The integration with haptic devices offers a sense of touch and natural interactions within the immersive environment which strengthens the quality of the training and the users’ retention. When applied in almost any medical scenario, this enhanced training can provide all healthcare professionals – in the government or industry sectors – with the tools they need to potentially save more lives.”
During the first year of the study, the ECS team worked with medical professionals at Mayo Clinic in Jacksonville, Florida, to perform a literature review and to design the scenario for instructors and students to address escharotomy, a critical burn care treatment. ECS developed the scenario as a prototype system to demonstrate how learners can effectively collaborate using multiple modalities within the medical environment with support from haptics devices to learn potentially lifesaving techniques. ECS partnered with HaptX to integrate their DK2 haptic glove system into the VR-based training scenario for escharotomy. Upon completing development, ECS successfully conducted a usability study at Mayo Clinic Jacksonville for future research and development and to capture feedback on the technology and training approach based on a prototype training scenario.
Within the scenario, users are presented with a simulated burn patient, with which they can directly interact to perform the escharotomy. Running in a VR scenario including interaction with the patient’s leg, marker, scalpel, iodine, and cleaning pads, the trainee completes the procedure, individually or with a live instructor’s assistance. Next, the player may independently review their overall performance or while collaborating with an instructor regarding feedback and areas for improvement.
During the second year of the SBIR study, the ECS team will continue its research expanding the scenarios to the point of injury in the battlefield for Combat Life Saver and Care Under Fire training. This SBIR will culminate with a training effectiveness evaluation to determine the learning value and engagement for learners, as compared to other methods of training.
Taber adds: “We’re excited to contribute to this body of research related to human performance and training effectiveness for both the military and medical communities. By collaborating with HaptX and Mayo Clinic, this type of innovative work advances high-fidelity VR training by combining the state-of-the-art hardware and software solutions.”
