English
Related papers

Related papers: SuPer: A Surgical Perception Framework for Endosco…

200 papers

Robotic surgery has been proven to offer clear advantages during surgical procedures, however, one of the major limitations is obtaining haptic feedback. Since it is often challenging to devise a hardware solution with accurate force…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Cong Gao , Xingtong Liu , Michael Peven , Mathias Unberath , Austin Reiter

Surgical tool segmentation in endoscopic images is the first step towards pose estimation and (sub-)task automation in challenging minimally invasive surgical operations. While many approaches in the literature have shown great results…

Robotics · Computer Science 2019-02-14 Cristian da Costa Rocha , Nicolas Padoy , Benoit Rosa

Accurate segmentation and tracking of relevant elements of the surgical scene is crucial to enable context-aware intraoperative assistance and decision making. Current solutions remain tethered to domain-specific, supervised models that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Jecia Z. Y. Mao , Francis X Creighton , Russell H Taylor , Manish Sahu

Autonomy in robotic surgery is very challenging in unstructured environments, especially when interacting with deformable soft tissues. The main difficulty is to generate model-based control methods that account for deformation dynamics…

Robotics · Computer Science 2021-05-03 Fei Liu , Zihan Li , Yunhai Han , Jingpei Lu , Florian Richter , Michael C. Yip

We address dynamic manipulation of deformable linear objects by presenting SPiD, a physics-informed self-supervised learning framework that couples an accurate deformable object model with an augmented self-supervised training strategy. On…

Robotics · Computer Science 2026-02-04 Youyuan Long , Gokhan Solak , Sara Zeynalpour , Heng Zhang , Arash Ajoudani

Tissue manipulation is a frequently used fundamental subtask of any surgical procedures, and in some cases it may require the involvement of a surgeon's assistant. The complex dynamics of soft tissue as an unstructured environment is one of…

Improved surgical skill is generally associated with improved patient outcomes, although assessment is subjective; labour-intensive; and requires domain specific expertise. Automated data driven metrics can alleviate these difficulties, as…

Transfer learning has gained attention in medical image analysis due to limited annotated 3D medical datasets for training data-driven deep learning models in the real world. Existing 3D-based methods have transferred the pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Eunji Jun , Seungwoo Jeong , Da-Woon Heo , Heung-Il Suk

Objective: The computation of anatomical information and laparoscope position is a fundamental block of surgical navigation in Minimally Invasive Surgery (MIS). Recovering a dense 3D structure of surgical scene using visual cues remains a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Ruofeng Wei , Bin Li , Hangjie Mo , Bo Lu , Yonghao Long , Bohan Yang , Qi Dou , Yunhui Liu , Dong Sun

Minimally invasive procedures have been advanced rapidly by the robotic laparoscopic surgery. The latter greatly assists surgeons in sophisticated and precise operations with reduced invasiveness. Nevertheless, it is still safety critical…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Zeqing Wang , Han Fang , Yihong Xu , Yutong Ban

Minimally invasive surgery is highly operator dependant with a lengthy procedural time causing fatigue to surgeon and risks to patients such as injury to organs, infection, bleeding, and complications of anesthesia. To mitigate such risks,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Mansoor Ali , Rafael Martinez Garcia Pena , Gilberto Ochoa Ruiz , Sharib Ali

Surgical simulation offers a promising addition to conventional surgical training. However, available simulation tools lack photorealism and rely on hardcoded behaviour. Denoising Diffusion Models are a promising alternative for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Yannik Frisch , Ssharvien Kumar Sivakumar , Çağhan Köksal , Elsa Böhm , Felix Wagner , Adrian Gericke , Ghazal Ghazaei , Anirban Mukhopadhyay

We introduce SurgFormer, a multiresolution gated transformer for data driven soft tissue simulation on volumetric meshes. High fidelity biomechanical solvers are often too costly for interactive use, so we train SurgFormer on solver…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ashkan Shahbazi , Elaheh Akbari , Kyvia Pereira , Jon S. Heiselman , Annie C. Benson , Garrison L. H. Johnston , Jie Ying Wu , Nabil Simaan , Michael I. Miga , Soheil Kolouri

Surgical scene simulation plays a crucial role in surgical education and simulator-based robot learning. Traditional approaches for creating these environments with surgical scene involve a labor-intensive process where designers hand-craft…

Robotics · Computer Science 2024-08-07 Zhenya Yang , Kai Chen , Yonghao Long , Qi Dou

Laparoscopic Field of View (FOV) control is one of the most fundamental and important components in Minimally Invasive Surgery (MIS), nevertheless, the traditional manual holding paradigm may easily bring fatigue to surgical assistants, and…

Robotics · Computer Science 2021-09-23 Bin Li , Bo Lu , Yiang Lu , Qi Dou , Yun-Hui Liu

Intelligent vision control systems for surgical robots should adapt to unknown and diverse objects while being robust to system disturbances. Previous methods did not meet these requirements due to mainly relying on pose estimation and…

Robotics · Computer Science 2024-05-29 Hongbin Lin , Bin Li , Chun Wai Wong , Juan Rojas , Xiangyu Chu , Kwok Wai Samuel Au

Most existing robotic surgery systems adopt a human-in-the-loop paradigm, often with the surgeon directly teleoperating the robotic system. Adding intelligence to these robots would enable higher-level control, such as supervised autonomy…

Laparoscope-holding robots can provide surgeons with a stable laparoscopic field of view (FOV) and reduce the burden on human assistants. To maintain an ideal intraoperative FOV, the robot must continuously adjust the laparoscope pose…

Robotics · Computer Science 2026-05-07 Xiaojian Li , Jin Fang , Yudong Shi , Xilin Xiao , Kai Yan , Kang Min , Ling Li , Hua Tang , Hangjie Mo

Soft tissue tracking is crucial for computer-assisted interventions. Existing approaches mainly rely on extracting discriminative features from the template and videos to recover corresponding matches. However, it is difficult to adopt…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Jiaxin Guo , Jiangliu Wang , Zhaoshuo Li , Tongyu Jia , Qi Dou , Yun-Hui Liu

Laparoscopic surgery constrains surgeons spatial awareness because procedures are performed through a monocular, two-dimensional (2D) endoscopic view. Conventional training methods using dry-lab models or recorded videos provide limited…

Human-Computer Interaction · Computer Science 2025-11-05 Songyang Liu , Yunpeng Tan , Shuai Li