English
Related papers

Related papers: SuPer: A Surgical Perception Framework for Endosco…

200 papers

Soft robots are robotic systems made of deformable materials and exhibit unique flexibility that can be exploited for complex environments and tasks. However, their control problem has been considered a challenging subject because they are…

Robotics · Computer Science 2022-10-04 Tongjia Zheng , Qing Han , Hai Lin

Surgical navigation provides real-time guidance by estimating the pose of patient anatomy and surgical instruments to visualize relevant intraoperative information. In conventional systems, instruments are typically tracked using fiducial…

Human-Computer Interaction · Computer Science 2026-03-10 Jiaming Zhang , Mingxu Liu , Hongchao Shu , Ruixing Liang , Yihao Liu , Ojas Taskar , Amir Kheradmand , Mehran Armand , Alejandro Martin-Gomez

Real-time proprioception is a challenging problem for soft robots, which have almost infinite degrees-of-freedom in body deformation. When multiple actuators are used, it becomes more difficult as deformation can also occur on actuators…

Robotics · Computer Science 2020-12-24 Rob B. N. Scharff , Guoxin Fang , Yingjun Tian , Jun Wu , Jo M. P. Geraedts , Charlie C. L. Wang

For robot manipulation, both the controller and end-effector design are crucial. Soft grippers are generalizable by deforming to different geometries, but designing such a gripper and finding its grasp pose remains challenging. In this…

Robotics · Computer Science 2025-09-03 Sha Yi , Xueqian Bai , Adabhav Singh , Jianglong Ye , Michael T Tolley , Xiaolong Wang

Objective: Deep learning-based deformable image registration has achieved strong accuracy, but remains sensitive to variations in input image characteristics such as artifacts, field-of-view mismatch, or modality difference. We aim to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Yihao Liu , Junyu Chen , Lianrui Zuo , Shuwen Wei , Brian D. Boyd , Carmen Andreescu , Olusola Ajilore , Warren D. Taylor , Aaron Carass , Bennett A. Landman

Soft bodies made from flexible and deformable materials are popular in many robotics applications, but their proprioceptive sensing has been a long-standing challenge. In other words, there has hardly been a method to measure and model the…

Robotics · Computer Science 2019-12-09 Ruoyu Wang , Shiheng Wang , Songyu Du , Erdong Xiao , Wenzhen Yuan , Chen Feng

In recent decades, the tremendous benefits surgical robots have brought to surgeons and patients have been witnessed. With the dexterous operation and the great precision, surgical robots can offer patients less recovery time and less…

Robotics · Computer Science 2022-04-13 Ruiqi Zhu , Dandan Zhang , Benny Lo

Holistic surgical scene segmentation in robot-assisted surgery (RAS) enables surgical residents to identify various anatomical tissues, articulated tools, and critical structures, such as veins and vessels. Given the firm intraoperative…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Fatimaelzahraa Ahmed , Muraam Abdel-Ghani , Muhammad Arsalan , Mahmoud Ali , Abdulaziz Al-Ali , Shidin Balakrishnan

Visualizing subtle vascular motions in endoscopic surgery is crucial for surgical precision and decision-making, yet remains challenging due to the complex and dynamic nature of surgical scenes. To address this, we introduce EndoControlMag,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 An Wang , Rulin Zhou , Mengya Xu , Yiru Ye , Longfei Gou , Yiting Chang , Hao Chen , Chwee Ming Lim , Jiankun Wang , Hongliang Ren

In augmented reality (AR)-guided surgical navigation, preoperative organ models are superimposed onto the patient's intraoperative anatomy to visualize critical structures such as vessels and tumors. Accurate deformation modeling is…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Zheng Han , Jun Zhou , Jialun Pei , Jing Qin , Yingfang Fan , Qi Dou

Minimally invasive and robot-assisted surgery relies heavily on endoscopic imaging, yet surgical smoke produced by electrocautery and vessel-sealing instruments can severely degrade visual perception and hinder vision-based functionalities.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jingpei Lu , Fengyi Jiang , Xiaorui Zhang , Lingbo Jin , Omid Mohareri

The precise tracking and segmentation of surgical instruments have led to a remarkable enhancement in the efficiency of surgical procedures. However, the challenge lies in achieving accurate segmentation of surgical instruments while…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Jieming Yu , Long Bai , Guankun Wang , An Wang , Xiaoxiao Yang , Huxin Gao , Hongliang Ren

Autonomy in robot-assisted surgery is essential to reduce surgeons' cognitive load and eventually improve the overall surgical outcome. A key requirement for autonomy in a safety-critical scenario as surgery lies in the generation of…

Robotics · Computer Science 2021-09-29 D. Meli , E. Tagliabue , D. Dall'Alba , P. Fiorini

Reconstruction of deformable scenes from endoscopic videos is important for many applications such as intraoperative navigation, surgical visual perception, and robotic surgery. It is a foundational requirement for realizing autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Shreya Saha , Zekai Liang , Shan Lin , Jingpei Lu , Michael Yip , Sainan Liu

Safety-critical control using high-dimensional sensory feedback from optical data (e.g., images, point clouds) poses significant challenges in domains like autonomous driving and robotic surgery. Control can rely on low-dimensional states…

Accurate feature matching and correspondence in endoscopic images play a crucial role in various clinical applications, including patient follow-up and rapid anomaly localization through panoramic image generation. However, developing…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Manel Farhat , Achraf Ben-Hamadou

Providing force feedback as relevant information in current Robot-Assisted Minimally Invasive Surgery systems constitutes a technological challenge due to the constraints imposed by the surgical environment. In this context, Sensorless…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Arturo Marban , Vignesh Srinivasan , Wojciech Samek , Josep Fernández , Alicia Casals

Modeling the dynamic behavior of deformable objects is crucial for creating realistic digital worlds. While conventional simulations produce high-quality motions, their computational costs are often prohibitive. Subspace simulation…

Many modern robotic systems operate autonomously, however they often lack the ability to accurately analyze the environment and adapt to changing external conditions, while teleoperation systems often require special operator skills. In the…

Robotics · Computer Science 2024-11-04 Maria Makarova , Daria Trinitatova , Qian Liu , Dzmitry Tsetserukou

Soft robotic grippers facilitate contact-rich manipulation, including robust grasping of varied objects. Yet the beneficial compliance of a soft gripper also results in significant deformation that can make precision manipulation…