English
Related papers

Related papers: Colonoscopy Navigation using End-to-End Deep Visuo…

200 papers

Endoscopic depth estimation is a critical technology for improving the safety and precision of minimally invasive surgery. It has attracted considerable attention from researchers in medical imaging, computer vision, and robotics. Over the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Ke Niu , Zeyun Liu , Xue Feng , Heng Li , Qika Lin , Kaize Shi

Visualizing subtle vascular motions in endoscopic surgery is crucial for surgical precision and decision-making, yet remains challenging due to the complex and dynamic nature of surgical scenes. To address this, we introduce EndoControlMag,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 An Wang , Rulin Zhou , Mengya Xu , Yiru Ye , Longfei Gou , Yiting Chang , Hao Chen , Chwee Ming Lim , Jiankun Wang , Hongliang Ren

In this work, we investigate laparoscopic camera motion automation through imitation learning from retrospective videos of laparoscopic interventions. A novel method is introduced that learns to augment a surgeon's behavior in image space…

Image and Video Processing · Electrical Eng. & Systems 2023-10-06 Martin Huber , Sebastien Ourselin , Christos Bergeles , Tom Vercauteren

Colonoscopy is a routine outpatient procedure used to examine the colon and rectum for any abnormalities including polyps, diverticula and narrowing of colon structures. A significant amount of the clinician's time is spent in…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Aniruddha Tamhane , Tse'ela Mida , Erez Posner , Moshe Bouhnik

New endoscopists require a large volume of expert-proctored colonoscopies to attain minimal competency. Developing multi-fingered, synchronized control of a colonoscope requires significant time and exposure to the device. Current training…

Robotics · Computer Science 2025-07-01 Olivia Richards , Keith L. Obstein , Nabil Simaan

Depth estimation plays a crucial role in various tasks within endoscopic surgery, including navigation, surface reconstruction, and augmented reality visualization. Despite the significant achievements of foundation models in vision tasks,…

Image and Video Processing · Electrical Eng. & Systems 2024-05-15 Beilei Cui , Mobarakol Islam , Long Bai , An Wang , Hongliang Ren

We present a robust deep learning based 6 degrees-of-freedom (DoF) localization system for endoscopic capsule robots. Our system mainly focuses on localization of endoscopic capsule robots inside the GI tract using only visual information…

Computer Vision and Pattern Recognition · Computer Science 2017-05-17 Mehmet Turan , Yasin Almalioglu , Ender Konukoglu , Metin Sitti

The advances in deep reinforcement learning recently revived interest in data-driven learning based approaches to navigation. In this paper we propose to learn viewpoint invariant and target invariant visual servoing for local mobile robot…

Computer Vision and Pattern Recognition · Computer Science 2020-03-06 Yimeng Li , Jana Kosecka

Accurate depth estimation plays a critical role in the navigation of endoscopic surgical robots, forming the foundation for 3D reconstruction and safe instrument guidance. Fine-tuning pretrained models heavily relies on endoscopic surgical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Yinheng Lin , Yiming Huang , Beilei Cui , Long Bai , Huxin Gao , Hongliang Ren , Jiewen Lai

Laparoscope-holding robots can provide surgeons with a stable laparoscopic field of view (FOV) and reduce the burden on human assistants. To maintain an ideal intraoperative FOV, the robot must continuously adjust the laparoscope pose…

Robotics · Computer Science 2026-05-07 Xiaojian Li , Jin Fang , Yudong Shi , Xilin Xiao , Kai Yan , Kang Min , Ling Li , Hua Tang , Hangjie Mo

Flexible endoscopy requires high skills to manipulate both the endoscope and associated instruments. In most robotic flexible endoscopic systems, the endoscope and instruments are controlled separately by two operators, which may result in…

Robotics · Computer Science 2020-07-14 Yanpei Huang , Wenjie Lai , Lin Cao , Jiajun Liu , Xiaoguo Li , Etienne Burdet , Soo Jay Phee

Autonomous robots for endovascular interventions hold significant potential to enhance procedural safety and reliability by navigating guidewires with precision, minimizing human error, and reducing surgical time. However, existing methods…

Robotics · Computer Science 2025-02-28 Wentao Liu , Weijin Xu , Xiaochuan Li , Bowen Liang , Ziyang He , Mengke Zhu , Jingzhou Song , Huihua Yang , Qingsheng Lu

Retinal vein cannulation (RVC) is a minimally invasive microsurgical procedure for treating retinal vein occlusion (RVO), a leading cause of vision impairment. However, the small size and fragility of retinal veins, coupled with the need…

Robotics · Computer Science 2025-07-30 Yi Wang , Peiyao Zhang , Mojtaba Esfandiari , Peter Gehlbach , Iulian I. Iordachita

Laparoscopic Field of View (FOV) control is one of the most fundamental and important components in Minimally Invasive Surgery (MIS), nevertheless, the traditional manual holding paradigm may easily bring fatigue to surgical assistants, and…

Robotics · Computer Science 2021-09-23 Bin Li , Bo Lu , Yiang Lu , Qi Dou , Yun-Hui Liu

As surgical interventions trend towards minimally invasive approaches, Concentric Tube Robots (CTRs) have been explored for various interventions such as brain, eye, fetoscopic, lung, cardiac and prostate surgeries. Arranged concentrically,…

Robotics · Computer Science 2023-09-06 Keshav Iyengar , Sarah Spurgeon , Danail Stoyanov

Prior research on deep video compression (DVC) for machine tasks typically necessitates training a unique codec for each specific task, mandating a dedicated decoder per task. In contrast, traditional video codecs employ a flexible encoder…

Image and Video Processing · Electrical Eng. & Systems 2024-04-23 Xingtong Ge , Jixiang Luo , Xinjie Zhang , Tongda Xu , Guo Lu , Dailan He , Jing Geng , Yan Wang , Jun Zhang , Hongwei Qin

Desktop-based virtual colonoscopy has been proven to be an asset in the identification of colon anomalies. The process is accurate, although time-consuming. The use of immersive interfaces for virtual colonoscopy is incipient and not yet…

Human-Computer Interaction · Computer Science 2023-05-05 João Serras , Anderson Maciel , Soraia Paulo , Andrew Duchowski , Regis Kopper , Catarina Moreira , Joaquim Jorge

This paper presents a novel design and experimental investigation for a self-propelled capsule robot that can be used for painless colonoscopy during a retrograde progression from the patient's rectum. The steerable robot is driven forward…

Robotics · Computer Science 2022-03-02 Jiajia Zhang , Jiyuan Tian , Dibin Zhu , Yang Liu , Shyam Prasad

With the increasing application of automated robotic digestive endoscopy (RDE), ensuring safe and efficient navigation in the unstructured and narrow digestive tract has become a critical challenge. Existing automated reinforcement learning…

Robotics · Computer Science 2025-04-01 Min Tan , Yushun Tao , Boyun Zheng , GaoSheng Xie , Lijuan Feng , Zeyang Xia , Jing Xiong

Polyps are well-known cancer precursors identified by colonoscopy. However, variability in their size, location, and surface largely affect identification, localisation, and characterisation. Moreover, colonoscopic surveillance and removal…