English

Virtual Reality for Immersive Education in Orthopedic Surgery Digital Twins

Human-Computer Interaction 2024-09-18 v1

Abstract

Virtual Reality technology, when integrated with Surgical Digital Twins (SDTs), offers significant potential in medical training and surgical planning. We present SurgTwinVR, a VR application that immerses users within an SDT and enables them to navigate a high-fidelity virtual replica of the surgical environment. SurgTwinVR is the first VR application to utilize a dynamic 3D environment that is a clone of a real surgery, encompassing the entire surgical scene, including the surgeon, anatomy, and instruments. Our system utilizes a SDT with important improvements for real-time rendering and features to showcase the potential benefits of such an application in surgical education.

Keywords

Cite

@article{arxiv.2409.11014,
  title  = {Virtual Reality for Immersive Education in Orthopedic Surgery Digital Twins},
  author = {Jonas Hein and Jan Grunder and Lilian Calvet and Frédéric Giraud and Nicola Alessandro Cavalcanti and Fabio Carrillo and Philipp Fürnstahl},
  journal= {arXiv preprint arXiv:2409.11014},
  year   = {2024}
}

Comments

Accepted demo at ISMAR 2024. Project page: https://jonashein.github.io/surgerydigitization/