English
Related papers

Related papers: Open-Source Multi-Viewpoint Surgical Telerobotics

200 papers

Physics-based simulations have accelerated progress in robot learning for driving, manipulation, and locomotion. Yet, a fast, accurate, and robust surgical simulation environment remains a challenge. In this paper, we present…

Suboptimal interaction with patient data and challenges in mastering 3D anatomy based on ill-posed 2D interventional images are essential concerns in image-guided therapies. Augmented reality (AR) has been introduced in the operating rooms…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Javad Fotouhi , Arian Mehrfard , Tianyu Song , Alex Johnson , Greg Osgood , Mathias Unberath , Mehran Armand , Nassir Navab

Robotic manipulation tasks often rely on static cameras for perception, which can limit flexibility, particularly in scenarios like robotic surgery and cluttered environments where mounting static cameras is impractical. Ideally, robots…

Robotics · Computer Science 2025-09-18 Xiatao Sun , Francis Fan , Yinxing Chen , Daniel Rakita

Autonomous multi-robot systems, where a team of robots shares information to perform tasks that are beyond an individual robot's abilities, hold great promise for a number of applications, such as planetary exploration missions. Each robot…

Human-Computer Interaction · Computer Science 2020-09-07 Suyun Bae , Federico Rossi , Joshua Vander Hook , Scott Davidoff , Kwan-Liu Ma

Robotic non-destructive disassembly of mating parts remains challenging due to the need for flexible manipulation and the limited visibility of internal structures. This study presents an affordance-guided teleoperation system that enables…

Robotics · Computer Science 2025-08-11 Gen Sako , Takuya Kiyokawa , Kensuke Harada , Tomoki Ishikura , Naoya Miyaji , Genichiro Matsuda

Virtual Reality (VR) interfaces are increasingly used as remote visualization media in telerobotics. Remote environments captured through RGB-D cameras and visualized using VR interfaces can enhance operators' situational awareness and…

Human-Computer Interaction · Computer Science 2022-10-12 Y. T. Tefera , D. Mazzanti , S. Anastasi , D. G. Caldwell , P. Fiorini , N. Deshpande

Human-robot shared control, which integrates the advantages of both humans and robots, is an effective approach to facilitate efficient surgical operation. Learning from demonstration (LfD) techniques can be used to automate some of the…

Surgical robots offer the exciting potential for remote telesurgery, but advances are needed to make this technology efficient and accurate to ensure patient safety. Achieving these goals is hindered by the deleterious effects of latency…

Robotics · Computer Science 2019-02-22 Florian Richter , Yifei Zhang , Yuheng Zhi , Ryan K. Orosco , Michael C. Yip

Minimally invasive surgery is highly operator dependant with a lengthy procedural time causing fatigue to surgeon and risks to patients such as injury to organs, infection, bleeding, and complications of anesthesia. To mitigate such risks,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Mansoor Ali , Rafael Martinez Garcia Pena , Gilberto Ochoa Ruiz , Sharib Ali

Telepresence and teleoperation robotics have attracted a great amount of attention in the last 10 years. With the Artificial Intelligence (AI) revolution already being started, we can see a wide range of robotic applications being realized.…

Robotics · Computer Science 2022-03-08 Hrishav Bakul Barua , Ashis Sau , Ruddra dev Roychoudhury

This paper presents a novel telepresence system for enhancing aerial manipulation capabilities. It involves not only a haptic device, but also a virtual reality that provides a 3D visual feedback to a remotely-located teleoperator in…

In percutaneous orthopedic interventions the surgeon attempts to reduce and fixate fractures in bony structures. The complexity of these interventions arises when the surgeon performs the challenging task of navigating surgical tools…

Computer Vision and Pattern Recognition · Computer Science 2018-03-26 Jonas Hajek , Mathias Unberath , Javad Fotouhi , Bastian Bier , Sing Chun Lee , Greg Osgood , Andreas Maier , Mehran Armand , Nassir Navab

Robotic ultrasound (US) imaging has been seen as a promising solution to overcome the limitations of free-hand US examinations, i.e., inter-operator variability. However, the fact that robotic US systems cannot react to subject movements…

Robotics · Computer Science 2022-09-07 Zhongliang Jiang , Nehil Danis , Yuan Bi , Mingchuan Zhou , Markus Kroenke , Thomas Wendler , Nassir Navab

Multi-View Photometric Stereo (MVPS) is a popular method for fine-detailed 3D acquisition of an object from images. Despite its outstanding results on diverse material objects, a typical MVPS experimental setup requires a well-calibrated…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Suryansh Kumar

We introduce Reality Fusion, a novel robot teleoperation system that localizes, streams, projects, and merges a typical onboard depth sensor with a photorealistic, high resolution, high framerate, and wide field of view (FoV) rendering of…

Robotics · Computer Science 2025-08-08 Ke Li , Reinhard Bacher , Susanne Schmidt , Wim Leemans , Frank Steinicke

Robot-assisted surgical systems have demonstrated significant potential in enhancing surgical precision and minimizing human errors. However, existing systems cannot accommodate individual surgeons' unique preferences and requirements.…

Robotics · Computer Science 2024-08-13 Amr Gomaa , Bilal Mahdy , Niko Kleer , Antonio Krüger

In this paper, we study state estimation of multi-visual-inertial systems (MVIS) and develop sensor fusion algorithms to optimally fuse an arbitrary number of asynchronous inertial measurement units (IMUs) or gyroscopes and global and(or)…

Robotics · Computer Science 2024-09-04 Yulin Yang , Patrick Geneva , Guoquan Huang

Modern microscopy routinely produces gigapixel images that contain structures across multiple spatial scales, from fine cellular morphology to broader tissue organization. Many analysis tasks require combining these scales, yet most vision…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Albert Dominguez Mantes , Gioele La Manno , Martin Weigert

Intraoperative ultrasound facilitates localisation of tumour boundaries during minimally invasive procedures. Autonomous ultrasound scanning systems have been recently proposed to improve scanning accuracy and reduce surgeons' cognitive…

Robotics · Computer Science 2018-03-19 Lin Zhang , Menglong Ye , Stamatia Giannarou , Philip Pratt , Guang-Zhong Yang

Augmented Reality (AR) systems describe the class of systems that use computers to overlay virtual information on the real world. AR environments allow the development of promising tools in several application domains. In medical training…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-03 Felix G. Hamza-Lup , Jannick P. Rolland , Charles Hughes