English
Related papers

Related papers: High-fidelity Endoscopic Image Synthesis by Utiliz…

200 papers

Colorectal cancer is one of the most common cancers in the world. While colonoscopy is an effective screening technique, navigating an endoscope through the colon to detect polyps is challenging. A 3D map of the observed surfaces could…

Neural implicit 3D reconstruction can reproduce shapes without 3D supervision, and it learns the 3D scene through volume rendering methods and neural implicit representations. Current neural surface reconstruction methods tend to randomly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Shikun Zhang , Yiqun Wang , Cunjian Chen , Yong Li , Qiuhong Ke

Deep learning has the potential to improve colonoscopy by enabling 3D reconstruction of the colon, providing a comprehensive view of mucosal surfaces and lesions, and facilitating the identification of unexplored areas. However, the…

Implicit representations have been widely applied in robotics for obstacle avoidance and path planning. In this paper, we explore the problem of constructing an implicit distance representation from a single image. Past methods for implicit…

Robotics · Computer Science 2026-03-13 Wei-Teng Chu , Tianyi Zhang , Matthew Johnson-Roberson , Weiming Zhi

Reconstruction of endoscopic scenes is an important asset for various medical applications, from post-surgery analysis to educational training. Neural rendering has recently shown promising results in endoscopic reconstruction with…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Florian Philipp Stilz , Mert Asim Karaoglu , Felix Tristram , Nassir Navab , Benjamin Busam , Alexander Ladikos

The reconstruction of high-quality shape geometry is crucial for developing freehand 3D ultrasound imaging. However, the shape reconstruction of multi-view ultrasound data remains challenging due to the elevation distortion caused by thick…

Image and Video Processing · Electrical Eng. & Systems 2024-08-15 Hongbo Chen , Yuchong Gao , Shuhang Zhang , Jiangjie Wu , Yuexin Ma , Rui Zheng

Visual SLAM inside the human body will open the way to computer-assisted navigation in endoscopy. However, due to space limitations, medical endoscopes only provide monocular images, leading to systems lacking true scale. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Victor M. Batlle , J. M. M. Montiel , Juan D. Tardos

Accurate endoscope pose estimation and 3D tissue surface reconstruction significantly enhances monocular minimally invasive surgical procedures by enabling accurate navigation and improved spatial awareness. However, monocular endoscope…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Muzammil Khan , Enzo Kerkhof , Matteo Fusaglia , Koert Kuhlmann , Theo Ruers , Françoise J. Siepel

Digital elevation modeling of planetary surfaces is essential for studying past and ongoing geological processes. Wide-angle imagery acquired during spacecraft descent promises to offer a low-cost option for high-resolution terrain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Melonie de Almeida , George Brydon , Divya M. Persaud , John H. Williamson , Paul Henderson

Object-centric surface reconstruction from multi-view images is crucial in creating editable digital assets for AR/VR. Due to the lack of geometric constraints, existing methods, e.g., NeuS necessitate annotating the object masks to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Haotian Bai , Yize Chen , Lin Wang

Recently, methods for neural surface representation and rendering, for example NeuS, have shown that learning neural implicit surfaces through volume rendering is becoming increasingly popular and making good progress. However, these…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Hanqi Jiang , Cheng Zeng , Runnan Chen , Shuai Liang , Yinhe Han , Yichao Gao , Conglin Wang

We present LoD-NeuS, an efficient neural representation for high-frequency geometry detail recovery and anti-aliased novel view rendering. Drawing inspiration from voxel-based representations with the level of detail (LoD), we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Yiyu Zhuang , Qi Zhang , Ying Feng , Hao Zhu , Yao Yao , Xiaoyu Li , Yan-Pei Cao , Ying Shan , Xun Cao

Scale-aware monocular depth estimation poses a significant challenge in computer-aided endoscopic navigation. However, existing depth estimation methods that do not consider the geometric priors struggle to learn the absolute scale from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Ruofeng Wei , Bin Li , Kai Chen , Yiyao Ma , Yunhui Liu , Qi Dou

Colonoscopy is the choice procedure to diagnose colon and rectum cancer, from early detection of small precancerous lesions (polyps), to confirmation of malign masses. However, the high variability of the organ appearance and the complex…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Josué Ruano , Martín Gómez , Eduardo Romero , Antoine Manzanera

Recent works on implicit neural representations have made significant strides. Learning implicit neural surfaces using volume rendering has gained popularity in multi-view reconstruction without 3D supervision. However, accurately…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Decai Chen , Peng Zhang , Ingo Feldmann , Oliver Schreer , Peter Eisert

Neural implicit 3D representations have emerged as a powerful paradigm for reconstructing surfaces from multi-view images and synthesizing novel views. Unfortunately, existing methods such as DVR or IDR require accurate per-pixel object…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Michael Oechsle , Songyou Peng , Andreas Geiger

Given that a conventional laparoscope only provides a two-dimensional (2-D) view, the detection and diagnosis of medical ailments can be challenging. To overcome the visual constraints associated with laparoscopy, the use of laparoscopic…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Khoa Tuan Nguyen , Francesca Tozzi , Nikdokht Rashidian , Wouter Willaert , Joris Vankerschaver , Wesley De Neve

In this paper, we define a new problem of recovering the 3D geometry of an object confined in a transparent enclosure. We also propose a novel method for solving this challenging problem. Transparent enclosures pose challenges of multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Jinguang Tong , Sundaram Muthu , Fahira Afzal Maken , Chuong Nguyen , Hongdong Li

Obtaining high-quality 3D reconstructions of room-scale scenes is of paramount importance for upcoming applications in AR or VR. These range from mixed reality applications for teleconferencing, virtual measuring, virtual room planing, to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Dejan Azinović , Ricardo Martin-Brualla , Dan B Goldman , Matthias Nießner , Justus Thies

Within colorectal cancer diagnostics, conventional colonoscopy techniques face critical limitations, including a limited field of view and a lack of depth information, which can impede the detection of precancerous lesions. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Sierra Bonilla , Shuai Zhang , Dimitrios Psychogyios , Danail Stoyanov , Francisco Vasconcelos , Sophia Bano