English
Related papers

Related papers: ORBIT-Surgical: An Open-Simulation Framework for L…

200 papers

Virtual Reality technology, when integrated with Surgical Digital Twins (SDTs), offers significant potential in medical training and surgical planning. We present SurgTwinVR, a VR application that immerses users within an SDT and enables…

Human-Computer Interaction · Computer Science 2024-09-18 Jonas Hein , Jan Grunder , Lilian Calvet , Frédéric Giraud , Nicola Alessandro Cavalcanti , Fabio Carrillo , Philipp Fürnstahl

Autonomous robots in endovascular operations have the potential to navigate circulatory systems safely and reliably while decreasing the susceptibility to human errors. However, there are numerous challenges involved with the process of…

Poor adaptation of orbital implants remains a major contributor to postoperative complications and revision surgery. Although preformed orbital plates are widely used to reduce cost and operative time compared with customized implants,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Chi Zhang , Braedon Gunn , Andrew M. Read-Fuller

Ultrasound (US) is a widely used medical imaging modality due to its real-time capabilities, non-invasive nature, and cost-effectiveness. Robotic ultrasound can further enhance its utility by reducing operator dependence and improving…

Surgical training involves didactic teaching, mentor-led learning, surgical skills laboratories, and direct exposure to surgery; however, increasing clinical pressures have limited operating room (OR) exposure. This work leverages virtual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Raj Kumar Ranabhat , Tayler D Ross , Tony Jiao , Jeremie Larouche , Joel Finkelstein , Michael Hardisty

Data scarcity remains a fundamental barrier to achieving fully autonomous surgical robots. While large scale vision language action (VLA) models have shown impressive generalization in household and industrial manipulation by leveraging…

Accurate and robust tracking and reconstruction of the surgical scene is a critical enabling technology toward autonomous robotic surgery. Existing algorithms for 3D perception in surgery mainly rely on geometric information, while we…

Image and Video Processing · Electrical Eng. & Systems 2023-02-21 Shan Lin , Albert J. Miao , Jingpei Lu , Shunkai Yu , Zih-Yun Chiu , Florian Richter , Michael C. Yip

With the advent of robot-assisted surgery, the role of data-driven approaches to integrate statistics and machine learning is growing rapidly with prominent interests in objective surgical skill assessment. However, most existing work…

Computer Vision and Pattern Recognition · Computer Science 2019-03-08 Ziheng Wang , Ann Majewicz Fey

Robotic automation in surgery requires precise tracking of surgical tools and mapping of deformable tissue. Previous works on surgical perception frameworks require significant effort in developing features for surgical tool and tissue…

Robotics · Computer Science 2021-03-26 Jingpei Lu , Ambareesh Jayakumari , Florian Richter , Yang Li , Michael C. Yip

Research on autonomous surgery has largely focused on simple task automation in controlled environments. However, real-world surgical applications demand dexterous manipulation over extended durations and generalization to the inherent…

Recent advances in reinforcement learning (RL) have increased the promise of introducing cognitive assistance and automation to robot-assisted laparoscopic surgery (RALS). However, progress in algorithms and methods depends on the…

Purpose: We describe a 3D multi-view perception system for the da Vinci surgical system to enable Operating room (OR) scene understanding and context awareness. Methods: Our proposed system is comprised of four Time-of-Flight (ToF) cameras…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Zhaoshuo Li , Amirreza Shaban , Jean-Gabriel Simard , Dinesh Rabindran , Simon DiMaio , Omid Mohareri

Every day, countless surgeries are performed worldwide, each within the distinct settings of operating rooms (ORs) that vary not only in their setups but also in the personnel, tools, and equipment used. This inherent diversity poses a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Ege Özsoy , Chantal Pellegrini , Matthias Keicher , Nassir Navab

In this paper we develop a surgical system using the da Vinci research kit (dVRK) that is capable of autonomously searching for tumors and dynamically displaying the tumor location using augmented reality. Such a system has the potential to…

Automation of surgical subtasks using cable-driven robotic surgical assistants (RSAs) such as Intuitive Surgical's da Vinci Research Kit (dVRK) is challenging due to imprecision in control from cable-related effects such as cable stretching…

Datasets are an essential component for training effective machine learning models. In particular, surgical robotic datasets have been key to many advances in semi-autonomous surgeries, skill assessment, and training. Simulated surgical…

Reinforcement learning in massively parallel physics simulations has driven major progress in sim-to-real robot learning. However, current approaches remain brittle and task-specific, relying on extensive per-task engineering to design…

Robot-assisted surgery is an established clinical practice. The automatic identification of surgical actions is needed for a range of applications, including performance assessment of trainees and surgical process modeling for autonomous…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Daniele Meli , Paolo Fiorini

High-resolution imaging is crucial for enhancing visual clarity and enabling precise computer-assisted guidance in minimally invasive surgery (MIS). Despite the increasing adoption of 4K endoscopic systems, there remains a significant gap…

In this paper, we develop a virtual reality (VR) simulator for the Robossis robot-assisted femur fracture surgery. Due to the steep learning curve for such procedures, a VR simulator is essential for training surgeon(s) and staff. The…