English
Related papers

Related papers: Sparse-then-Dense Alignment based 3D Map Reconstru…

200 papers

Abdominal organ segmentation from CT and MRI is an essential prerequisite for surgical planning and computer-aided navigation systems. It is challenging due to the high variability in the shape, size, and position of abdominal organs.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Fabian Bongratz , Anne-Marie Rickmann , Christian Wachinger

Monocular depth estimation (MDE) is a critical task to guide autonomous medical robots. However, obtaining absolute (metric) depth from an endoscopy camera in surgical scenes is difficult, which limits supervised learning of depth on real…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Hao Li , Daiwei Lu , Jesse d'Almeida , Dilara Isik , Ehsan Khodapanah Aghdam , Nick DiSanto , Ayberk Acar , Susheela Sharma , Jie Ying Wu , Robert J. Webster , Ipek Oguz

Self-supervised monocular depth estimation is a significant task for low-cost and efficient 3D scene perception and measurement in endoscopy. However, the variety of illumination conditions and scene features is still the primary challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Liangjing Shao , Chenkang Du , Benshuang Chen , Xueli Liu , Xinrong Chen

Accurate 3D reconstruction of dynamic surgical scenes from endoscopic video is essential for robotic-assisted surgery. While recent 3D Gaussian Splatting methods have shown promise in achieving high-quality reconstructions with fast…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jialei Chen , Xin Zhang , Mobarakol Islam , Francisco Vasconcelos , Danail Stoyanov , Daniel S. Elson , Baoru Huang

Scale-aware monocular depth estimation poses a significant challenge in computer-aided endoscopic navigation. However, existing depth estimation methods that do not consider the geometric priors struggle to learn the absolute scale from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Ruofeng Wei , Bin Li , Kai Chen , Yiyao Ma , Yunhui Liu , Qi Dou

Computed tomography (CT) has been a powerful diagnostic tool since its emergence in the 1970s. Using CT data, three-dimensional (3D) structures of human internal organs and tissues, such as blood vessels, can be reconstructed using…

Applications · Statistics 2024-04-01 Qianhan Zeng , Jing Zhou , Ying Ji , Hansheng Wang

Visual SLAM inside the human body will open the way to computer-assisted navigation in endoscopy. However, due to space limitations, medical endoscopes only provide monocular images, leading to systems lacking true scale. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Victor M. Batlle , J. M. M. Montiel , Juan D. Tardos

In order to improve model accuracy, generalization, and class imbalance issues, this work offers a strong methodology for classifying endoscopic images. We suggest a hybrid feature extraction method that combines convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Bidisha Chakraborty , Shree Mitra

Within colorectal cancer diagnostics, conventional colonoscopy techniques face critical limitations, including a limited field of view and a lack of depth information, which can impede the detection of precancerous lesions. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Sierra Bonilla , Shuai Zhang , Dimitrios Psychogyios , Danail Stoyanov , Francisco Vasconcelos , Sophia Bano

In recent years, 3D mapping for indoor environments has undergone considerable research and improvement because of its effective applications in various fields, including robotics, autonomous navigation, and virtual reality. Building an…

In this paper, we proposed a new deep learning based dense monocular SLAM method. Compared to existing methods, the proposed framework constructs a dense 3D model via a sparse to dense mapping using learned surface normals. With single view…

Robotics · Computer Science 2019-03-25 Jiexiong Tang , John Folkesson , Patric Jensfelt

Surgical simulation is essential for medical training, enabling practitioners to develop crucial skills in a risk-free environment while improving patient safety and surgical outcomes. However, conventional methods for building simulation…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Zhenya Yang

Indoor robot navigation is often compromised by glass surfaces, which severely corrupt depth sensor measurements. While foundation models like Depth Anything 3 provide excellent geometric priors, they lack an absolute metric scale. We…

Robotics · Computer Science 2026-05-07 Jiamin Zheng , Jingwen Yu , Guangcheng Chen , Hong Zhang

3-D pose estimation of instruments is a crucial step towards automatic scene understanding in robotic minimally invasive surgery. Although robotic systems can potentially directly provide joint values, this information is not commonly…

Robotics · Computer Science 2021-03-02 Luca Sestini , Benoit Rosa , Elena De Momi , Giancarlo Ferrigno , Nicolas Padoy

Magnetically controlled capsule endoscope (MCCE) is an emerging tool for the diagnosis of gastric diseases with the advantages of comfort, safety, and no anesthesia. In this paper, we develop algorithms to detect and measure human gastric…

Image and Video Processing · Electrical Eng. & Systems 2023-01-25 Xueshen Li , Yu Gan , David Duan , Xiao Yang

Estimating a dense and accurate depth map is the key requirement for autonomous driving and robotics. Recent advances in deep learning have allowed depth estimation in full resolution from a single image. Despite this impressive result,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Sungho Yoon , Ayoung Kim

X-ray tomography is a reliable tool for determining the inner structure of 3D object with penetrating X-rays. However, traditional reconstruction methods such as FDK require dense angular sampling in the data acquisition phase leading to…

Background. Flexible bendable instruments are key tools for performing surgical endoscopy. Being able to measure the 3D position of such instruments can be useful for various tasks, such as controlling automatically robotized instruments…

Image and Video Processing · Electrical Eng. & Systems 2019-12-02 Paolo Cabras , Florent Nageotte , Philippe Zanne , Christophe Doignon

In this article, a novel approach for merging 3D point cloud maps in the context of egocentric multi-robot exploration is presented. Unlike traditional methods, the proposed approach leverages state-of-the-art place recognition and learned…

In this work, we introduce a fast and accurate method for unsupervised 3D medical image registration. This work is built on top of a recent algorithm SAM, which is capable of computing dense anatomical/semantic correspondences between two…

Image and Video Processing · Electrical Eng. & Systems 2021-09-27 Fengze Liu , Ke Yan , Adam Harrison , Dazhou Guo , Le Lu , Alan Yuille , Lingyun Huang , Guotong Xie , Jing Xiao , Xianghua Ye , Dakai Jin