US IGNITE: Exploring ultrafast networks for training surgeons using virtual reality based environments, NSF Computer and Networking Systems
Download the PowerPoint Presentation (PDF)
This project had twin thrusts:
- Explore the feasibility of adopting SDN based approaches to support distributed collaborative training involving haptic and 3D immersive training simulators
- Design Human-Computer Interaction (HCI) based VR and Mixed Reality MR simulators to support training of orthopedic residents
Our groundbreaking work in HCI based design of 3D simulators has thrown more light on the role of attributes such as affordance, cognitive load and visual density on cognition (comprehension and knowledge acquisition) as well as skills acquisition by medical residents. We have proposed the first comprehensive framework for the design and assessment of Extended Reality (XR) based simulation environments to support training of medical residents in orthopedic surgery.
We also investigated the creation of a Next Generation Network based 3D simulation training framework that can be used by medical residents for training in orthopedic surgery. Some of the networking techniques can be viewed as belonging to umbrella of smart cyber physical technologies and Internet-of-Things (IoT) based practises; they exploit the capabilities of Global Environment for Network Innovation (GENI)'s national test bed infrastructure. Specifically, we have shown that the ultra-fast communication networks are effective in linking expert surgeons in different hospitals with medical residents at many geographically distributed locations through advanced 3D Digital Twins of Target Surgical Environments in a hospital room setting. The high-definition multimedia streaming and haptic interfaces enable trainees to remotely observe, participate and practice surgical techniques using the surgical DIGITAL TWINS with the support of software defined networking SDN). We are collaborating with Dr. Miguel Pirela-Cruz (Texas Tech Health Sciences Centers) in El Paso as part of this initiative. The use of such advanced cyber infrastructure also lays the foundation for reducing health care costs in hospitals and medical education programs. It also is a precursor to the creation of smart cyber cities where the use of such advanced cyber physical tools will be extended to support tele-medicine applications.
A View of the 3D Digital Training Twin created to train surgical residents (left) and a Medical resident training on this 3D digital twin using the Vive platform
We are working with Dr. Miguel Pirela-Cruz at the Texas Tech Health Sciences Center (TTHSC) in El Paso, Texas.
View of the Virtual Environment for orthopedic surgery planning and simulation
Our recently accepted paper (to be presented at the 2022 IEEE Systems Engineering conference) is below:
An Investigation into the Role of Affordance in the Design of Extended Reality based Environments for Surgical Training (Download PDF)
Avinash Gupta, J. Cecil, Ph.D., Miguel Pirela-Cruz, M.D., Rittika Shamsuddin, Ph.D., Shelia Kennison, Ph.D., Christopher Crick Ph.D.