English
Related papers

Related papers: Magnetic-Visual Sensor Fusion-based Dense 3D Recon…

200 papers

Deep learning techniques hold promise to develop dense topography reconstruction and pose estimation methods for endoscopic videos. However, currently available datasets do not support effective quantitative benchmarking. In this paper, we…

In endoscopic sinus surgery (ESS), intraoperative CT (iCT) offers valuable intraoperative assessment but is constrained by slow deployment and radiation exposure, limiting its clinical utility. Endoscope-based monocular 3D reconstruction is…

Image and Video Processing · Electrical Eng. & Systems 2025-03-03 Pengcheng Chen , Wenhao Li , Nicole Gunderson , Jeremy Ruthberg , Randall Bly , Zhenglong Sun , Waleed M. Abuzeid , Eric J. Seibel

In Minimally Invasive Surgery (MIS), tissue scanning with imaging probes is required for subsurface visualisation to characterise the state of the tissue. However, scanning of large tissue surfaces in the presence of deformation is a…

Robotics · Computer Science 2021-01-12 Jian Zhan , Joao Cartucho , Stamatia Giannarou

Soft bodies made from flexible and deformable materials are popular in many robotics applications, but their proprioceptive sensing has been a long-standing challenge. In other words, there has hardly been a method to measure and model the…

Robotics · Computer Science 2019-12-09 Ruoyu Wang , Shiheng Wang , Songyu Du , Erdong Xiao , Wenzhen Yuan , Chen Feng

Autonomy in robotic surgery is very challenging in unstructured environments, especially when interacting with deformable soft tissues. The main difficulty is to generate model-based control methods that account for deformation dynamics…

Robotics · Computer Science 2021-05-03 Fei Liu , Zihan Li , Yunhai Han , Jingpei Lu , Florian Richter , Michael C. Yip

The 3D depth estimation and relative pose estimation problem within a decentralized architecture is a challenging problem that arises in missions that require coordination among multiple vision-controlled robots. The depth estimation…

Robotics · Computer Science 2019-08-02 Romulo T. Rodrigues , Pedro Miraldo , Dimos V. Dimarogonas , A. Pedro Aguiar

The D4D Dataset provides paired endoscopic video and high-quality structured-light geometry for evaluating 3D reconstruction of deforming abdominal soft tissue in realistic surgical conditions. Data were acquired from six porcine cadaver…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Reuben Docea , Rayan Younis , Yonghao Long , Maxime Fleury , Jinjing Xu , Chenyang Li , André Schulze , Ann Wierick , Johannes Bender , Micha Pfeiffer , Qi Dou , Martin Wagner , Stefanie Speidel

The availability of high-speed 3D video sensors has greatly facilitated 3D shape acquisition of dynamic and deformable objects, but high frame rate 3D reconstruction is always degraded by spatial noise and temporal fluctuations. This paper…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Jie Zhang , Christos Maniatis , Luis Horna , Robert B. Fisher

Continuum robots have emerged as a promising technology in the medical field due to their potential of accessing deep sited locations of the human body with low surgical trauma. When deriving physics-based models for these robots,…

Robotics · Computer Science 2024-05-27 Matthias K. Hoffmann , Julian Mühlenhoff , Zhaoheng Ding , Thomas Sattel , Kathrin Flaßkamp

Continuum robots have been widely adopted in robot-assisted minimally invasive surgery (RMIS) because of their compact size and high flexibility. However, their proprioceptive capabilities remain limited, particularly in narrow lumens,…

Robotics · Computer Science 2025-06-24 Peiyu Luo , Shilong Yao , Yuhan Chen , Max Q. -H. Meng

Colonoscopy is considered the golden standard for cancer screening of the lower gastrointestinal (GI) tract, with screening programs all over the world considering lowering the recommended screening age. Nonetheless, conventional…

Robotics · Computer Science 2022-09-20 Vanni Consumi , Lukas Lindenroth , Jeref Merlin , Danail Stoyanov , Agostino Stilli

Grasp force estimation can help prevent robots from damaging delicate objects during manipulation and improve learning-based robotic control. Integrating force sensing into deformable grippers negotiates trade-offs in cost, complexity,…

Robotics · Computer Science 2026-05-04 Kaiwen Zuo , Shuyuan Yang , Zonghe Chua

Robotic magnetic manipulation offers a minimally invasive approach to gastrointestinal examinations through capsule endoscopy. However, controlling such systems using external permanent magnets (EPM) is challenging due to nonlinear magnetic…

Robotics · Computer Science 2025-05-02 Ogulcan Isitman , Gokhan Alcan , Ville Kyrki

Targeted drug delivery in the gastrointestinal (GI) tract using magnetic robots offers a promising alternative to systemic treatments. However, controlling these robots is a major challenge. Stationary magnetic systems have a limited…

Robotics · Computer Science 2026-01-23 Zhifan Yan , Chang Liu , Yiyang Jiang , Wenxuan Zheng , Xinhao Chen , Axel Krieger

Minimally invasive surgery (MIS) offers significant benefits such as reduced recovery time and minimised patient trauma, but poses challenges in visibility and access, making accurate 3D reconstruction a significant tool in surgical…

3D reconstruction of endoscopic surgery scenes plays a vital role in enhancing scene perception, enabling AR visualization, and supporting context-aware decision-making in image-guided surgery. A critical yet challenging step in this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Changhao Zhang , Matthew J. Clarkson , Mobarak I. Hoque

Achieving 3D spatial awareness is crucial for surgical robotic manipulation, where precise and delicate operations are required. Existing methods either explicitly reconstruct the surgical scene prior to manipulation, or enhance multi-view…

Robotics · Computer Science 2026-03-05 Yu Sheng , Lidian Wang , Xiaomeng Chu , Jiajun Deng , Min Cheng , Yanyong Zhang , Bei Hua , Houqiang Li , Jianmin Ji

Accurate shape sensing, only achievable through distributed proprioception, is a key requirement for closed-loop control of soft robots. Low-cost power efficient optoelectronic sensors manufactured from flexible materials represent a…

Robotics · Computer Science 2025-02-07 Ellis Capp , Marco Pontin , Peter Walters , Perla Maiolino

Accurate 3D reconstruction of deformable soft tissues is essential for surgical robotic perception. However, low-texture surfaces, specular highlights, and instrument occlusions often fragment geometric continuity, posing a challenge for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Falong Fan , Yi Xie , Arnis Lektauers , Bo Liu , Jerzy Rozenblit

Accurate intra-operative localization of the bronchoscope tip relative to patient anatomy remains challenging due to respiratory motion, anatomical variability, and CT-to-body divergence that cause deformation and misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Hongchao Shu , Roger D. Soberanis-Mukul , Jiru Xu , Hao Ding , Morgan Ringel , Mali Shen , Saif Iftekar Sayed , Hedyeh Rafii-Tari , Mathias Unberath