English
Related papers

Related papers: SuPer: A Surgical Perception Framework for Endosco…

200 papers

We explore whether surgical manipulation tasks can be learned on the da Vinci robot via imitation learning. However, the da Vinci system presents unique challenges which hinder straight-forward implementation of imitation learning. Notably,…

The robotic shape control of deformable linear objects has garnered increasing interest within the robotics community. Despite recent progress, the majority of shape control approaches can be classified into two main groups: open-loop…

Robotics · Computer Science 2024-09-20 Azad Artinian , Faiz Ben Amar , Veronique Perdereau

For soft continuum arms, visual servoing is a popular control strategy that relies on visual feedback to close the control loop. However, robust visual servoing is challenging as it requires reliable feature extraction from the image,…

Scene graphs (SGs) provide structured relational representations crucial for decoding complex, dynamic surgical environments. This PRISMA-ScR-guided scoping review systematically maps the evolving landscape of SG research in surgery,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Angelo Henriques , Korab Hoxha , Daniel Zapp , Peter C. Issa , Nassir Navab , M. Ali Nasseri

We propose a novel architecture UniTransfer, which introduces both spatial and diffusion timestep decomposition in a progressive paradigm, achieving precise and controllable video concept transfer. Specifically, in terms of spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Guojun Lei , Rong Zhang , Chi Wang , Tianhang Liu , Hong Li , Zhiyuan Ma , Weiwei Xu

Purpose: Segmentation of surgical instruments in endoscopic videos is essential for automated surgical scene understanding and process modeling. However, relying on fully supervised deep learning for this task is challenging because manual…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Manish Sahu , Anirban Mukhopadhyay , Stefan Zachow

We introduce specialized diffusion-based generative models that capture the spatiotemporal dynamics of fine-grained robotic surgical sub-stitch actions through supervised learning on annotated laparoscopic surgery footage. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Mehmet Kerem Turkcan , Mattia Ballo , Filippo Filicori , Zoran Kostic

Reliable and real-time 3D reconstruction and localization functionality is a crucial prerequisite for the navigation of actively controlled capsule endoscopic robots as an emerging, minimally invasive diagnostic and therapeutic technology…

Dynamic motions are a key feature of robotic arms, enabling them to perform tasks quickly and efficiently. Soft continuum manipulators do not currently consider dynamic parameters when operating in task space. This shortcoming makes…

Robotics · Computer Science 2022-10-19 Oliver Fischer , Yasunori Toshimitsu , Amirhossein Kazemipour , Robert K. Katzschmann

Tissue deformation recovery based on stereo endoscopic images is crucial for tool-tissue interaction analysis and benefits surgical navigation and autonomous soft tissue manipulation. Previous research suffers from the problems raised from…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Jiahe Chen , Naoki Tomii , Ichiro Sakuma , Etsuko Kobayashi

In percutaneous orthopedic interventions the surgeon attempts to reduce and fixate fractures in bony structures. The complexity of these interventions arises when the surgeon performs the challenging task of navigating surgical tools…

Computer Vision and Pattern Recognition · Computer Science 2018-03-26 Jonas Hajek , Mathias Unberath , Javad Fotouhi , Bastian Bier , Sing Chun Lee , Greg Osgood , Andreas Maier , Mehran Armand , Nassir Navab

This paper introduces a SSSUMO, semi-supervised deep learning approach for submovement decomposition that achieves state-of-the-art accuracy and speed. While submovement analysis offers valuable insights into motor control, existing methods…

Human-Computer Interaction · Computer Science 2025-07-14 Evgenii Rudakov , Jonathan Shock , Otto Lappi , Benjamin Ultan Cowley

Surgical simulation is essential for medical training, enabling practitioners to develop crucial skills in a risk-free environment while improving patient safety and surgical outcomes. However, conventional methods for building simulation…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Zhenya Yang

This paper presents a survey of the state-of-the-art deformable models studied in the literature concerning soft tissue deformable modeling for interactive surgical simulation. It first introduces the challenges of surgical simulation,…

Computational Engineering, Finance, and Science · Computer Science 2019-09-10 Jinao Zhang , Yongmin Zhong , Chengfan Gu

Localizing oneself during endoscopic procedures can be problematic due to the lack of distinguishable textures and landmarks, as well as difficulties due to the endoscopic device such as a limited field of view and challenging lighting…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Gary Sarwin , Alessandro Carretta , Victor Staartjes , Matteo Zoli , Diego Mazzatenta , Luca Regli , Carlo Serra , Ender Konukoglu

In the context of surgery, robots can provide substantial assistance by performing small, repetitive tasks such as suturing, needle exchange, and tissue retraction, thereby enabling surgeons to concentrate on more complex aspects of the…

Machine Learning · Computer Science 2023-09-06 Amritpal Singh , Wenqi Shi , May D Wang

In minimal invasive surgery, it is important to rebuild and visualize the latest deformed shape of soft-tissue surfaces to mitigate tissue damages. This paper proposes an innovative Simultaneous Localization and Mapping (SLAM) algorithm for…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Jingwei Song , Jun Wang , Liang Zhao , Shoudong Huang , Gamini Dissanayake

Deformation detection is vital for enabling accurate assessment and prediction of structural changes in materials, ensuring timely and effective interventions to maintain safety and integrity. Automating deformation detection through…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Joel Sol , Jamil Fayyad , Shadi Alijani , Homayoun Najjaran

Interactive perception enables robots to manipulate the environment and objects to bring them into states that benefit the perception process. Deformable objects pose challenges to this due to significant manipulation difficulty and…

3D perception tasks, such as 3D object detection and Bird's-Eye-View (BEV) segmentation using multi-camera images, have drawn significant attention recently. Despite the fact that accurately estimating both semantic and 3D scene layouts are…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Qi Song , Qingyong Hu , Chi Zhang , Yongquan Chen , Rui Huang