English
Related papers

Related papers: IMHOTEP - Virtual Reality Framework for Surgical A…

200 papers

Robotic-assisted medical systems (RAMS) have gained significant attention for their advantages in alleviating surgeons' fatigue and improving patients' outcomes. These systems comprise a range of human-computer interactions, including…

Robotics · Computer Science 2024-10-22 Letian Ai , Yihao Liu , Mehran Armand , Amir Kheradmand , Alejandro Martin-Gomez

Robot-assisted surgery is rapidly developing in the medical field, and the integration of augmented reality shows the potential of improving the surgeons' operation performance by providing more visual information. In this paper, we…

Although effective teamwork and communication are critical to surgical safety, structured training for non-technical skills (NTS) remains limited compared with technical simulation. The ACS/APDS Phase III Team-Based Skills Curriculum calls…

Medical doctors rely on images of the human anatomy, such as magnetic resonance imaging (MRI), to localize regions of interest in the patient during diagnosis and treatment. Despite advances in medical imaging technology, the information…

Human-Computer Interaction · Computer Science 2024-07-10 Laura Schütz , Sasan Matinfar , Gideon Schafroth , Navid Navab , Merle Fairhurst , Arthur Wagner , Benedikt Wiestler , Ulrich Eck , Nassir Navab

Machine learning models built on training data with multiple modalities can reveal new insights that are not accessible through unimodal datasets. For example, cardiac magnetic resonance images (MRIs) and electrocardiograms (ECGs) are both…

Machine Learning · Computer Science 2023-12-05 Bum Chul Kwon , Samuel Friedman , Kai Xu , Steven A Lubitz , Anthony Philippakis , Puneet Batra , Patrick T Ellinor , Kenney Ng

Research on autonomous surgery has largely focused on simple task automation in controlled environments. However, real-world surgical applications demand dexterous manipulation over extended durations and generalization to the inherent…

Purpose: To develop a multi-criteria optimization framework for image guided radiotherapy. Methods: An algorithm is proposed for a multi-criteria framework for the purpose of patient setup verification decision processes. Optimal patient…

Medical Physics · Physics 2011-08-16 Brian Winey , James Balter

Most existing robotic surgery systems adopt a human-in-the-loop paradigm, often with the surgeon directly teleoperating the robotic system. Adding intelligence to these robots would enable higher-level control, such as supervised autonomy…

In this paper, we describe the development and operating principles of an immersive virtual reality (VR) visualisation environment that is designed around the use of consumer VR headsets in an existing wide area motion capture suite. We…

Human-Computer Interaction · Computer Science 2016-04-21 Stefan Marks , Javier E. Estevez , Andy M. Connor

ivadomed is an open-source Python package for designing, end-to-end training, and evaluating deep learning models applied to medical imaging data. The package includes APIs, command-line tools, documentation, and tutorials. ivadomed also…

Image and Video Processing · Electrical Eng. & Systems 2020-10-26 Charley Gros , Andreanne Lemay , Olivier Vincent , Lucas Rouhier , Anthime Bucquet , Joseph Paul Cohen , Julien Cohen-Adad

Healthcare systems generate diverse multimodal data, including Electronic Health Records (EHR), clinical notes, and medical images. Effectively leveraging this data for clinical prediction is challenging, particularly as real-world samples…

Machine Learning · Computer Science 2025-09-01 Xiaoyang Wang , Christopher C. Yang

This paper presents a new technique for the virtual reality (VR) visu-alization of complex volume images obtained from computer tomography (CT) and Magnetic Resonance Imaging (MRI) by combining three-dimensional (3D) mesh processing and…

Multimedia · Computer Science 2023-05-02 Iva Vasic , Roberto Pierdicca , Emanuele Frontoni , Bata Vasic

Vision foundation models (VFMs) have emerged as powerful tools for surgical scene understanding. However, current approaches predominantly rely on unimodal RGB pre-training, overlooking the complex 3D geometry inherent to surgical…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 John J. Han , Adam Schmidt , Muhammad Abdullah Jamal , Chinedu Nwoye , Anita Rau , Jie Ying Wu , Omid Mohareri

Intelligent assistive technologies are increasingly recognized as critical daily-use enablers for people with disabilities and age-related functional decline. Longitudinal studies, curation of quality datasets, live monitoring in activities…

Systems and Control · Electrical Eng. & Systems 2026-01-21 Maxim Yudayev , Juha Carlon , Diwas Lamsal , Vayalet Stefanova , Benjamin Filtjens

Medical imaging plays a vital role in modern diagnostics; however, interpreting high-resolution radiological data remains time-consuming and susceptible to variability among clinicians. Traditional image processing techniques often lack the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Melika Filvantorkaman , Maral Filvan Torkaman

Advancements in heterogeneous computing technologies enable the significant potential of virtual reality (VR) applications. To offer the best user experience (UX), a system should adopt an untethered, wireless-network-based architecture to…

Networking and Internet Architecture · Computer Science 2021-01-20 Alec Rohloff , Zackary Allen , Kung-Min Lin , Joshua Okrend , Chengyi Nie , Yu-Chia Liu , Hung-Wei Tseng

In the field of medical Vision-Language Pre-training (VLP), significant efforts have been devoted to deriving text and image features from both clinical reports and associated medical images. However, most existing methods may have…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Che Liu , Sibo Cheng , Miaojing Shi , Anand Shah , Wenjia Bai , Rossella Arcucci

Purpose: Development of a novel interactive visualization approach for the exploration of radiotherapy treatment plans with a focus on overlap volumes with the aim of healthy tissue sparing. Methods: We propose a visualization approach to…

Human-Computer Interaction · Computer Science 2023-10-03 Matthias Schlachter , Samuel Peters , Daniel Camenisch , Paul Martin Putora , Katja Bühler

Surgery is a high-stakes domain where surgeons must navigate critical anatomical structures and actively avoid potential complications while achieving the main task at hand. Such surgical activity has been shown to affect long-term patient…

We investigate how both the adaptation of a generic foundation model via transfer learning and the integration of complementary modalities from the operating room (OR) can support surgical data science. To this end, we use V-JEPA as the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Simon Pezold , Jérôme A. Kurylec , Jan S. Liechti , Beat P. Müller , Joël L. Lavanchy