English
Related papers

Related papers: Depth estimation of endoscopy using sim-to-real tr…

200 papers

This contribution shows how an appropriate image pre-processing can improve a deep-learning based 3D reconstruction of colon parts. The assumption is that, rather than global image illumination corrections, local under- and over-exposures…

Image and Video Processing · Electrical Eng. & Systems 2023-04-18 Ricardo Espinosa , Carlos Axel Garcia-Vega , Gilberto Ochoa-Ruiz , Dominique Lamarque , Christian Daul

Three-dimensional (3D) scene understanding in colonoscopy presents significant challenges that necessitate automated methods for accurate depth estimation. However, existing depth estimation models for endoscopy struggle with temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Romain Hardy , Tyler Berzin , Pranav Rajpurkar

Visualizing colonoscopy is crucial for medical auxiliary diagnosis to prevent undetected polyps in areas that are not fully observed. Traditional feature-based and depth-based reconstruction approaches usually end up with undesirable…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Zhenhua Wu , Yanlin Jin , Liangdong Qiu , Xiaoguang Han , Xiang Wan , Guanbin Li

We present a computational method for real-time, patient-specific simulation of 2D ultrasound (US) images. The method uses a large number of tracked ultrasound images to learn a function that maps position and orientation of the transducer…

Image and Video Processing · Electrical Eng. & Systems 2020-05-12 Cesare Magnetti , Veronika Zimmer , Nooshin Ghavami , Emily Skelton , Jacqueline Matthew , Karen Lloyd , Jo Hajnal , Julia A. Schnabel , Alberto Gomez

Scanning electron microscopy (SEM) is indispensable in diverse applications ranging from microelectronics to food processing because it provides large depth-of-field images with a resolution beyond the optical diffraction limit. However,…

Depth estimation is of critical interest for scene understanding and accurate 3D reconstruction. Most recent approaches in depth estimation with deep learning exploit geometrical structures of standard sharp images to predict corresponding…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Marcela Carvalho , Bertrand Le Saux , Pauline Trouvé-Peloux , Andrés Almansa , Frédéric Champagnat

In the medical domain, the lack of large training data sets and benchmarks is often a limiting factor for training deep neural networks. In contrast to expensive manual labeling, computer simulations can generate large and fully labeled…

This paper presents a neural network to estimate a detailed depth map of the foreground human in a single RGB image. The result captures geometry details such as cloth wrinkles, which are important in visualization applications. To achieve…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Sicong Tang , Feitong Tan , Kelvin Cheng , Zhaoyang Li , Siyu Zhu , Ping Tan

Scale-aware monocular depth estimation poses a significant challenge in computer-aided endoscopic navigation. However, existing depth estimation methods that do not consider the geometric priors struggle to learn the absolute scale from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Ruofeng Wei , Bin Li , Kai Chen , Yiyao Ma , Yunhui Liu , Qi Dou

Precise camera tracking, high-fidelity 3D tissue reconstruction, and real-time online visualization are critical for intrabody medical imaging devices such as endoscopes and capsule robots. However, existing SLAM (Simultaneous Localization…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Kailing Wang , Chen Yang , Yuehao Wang , Sikuang Li , Yan Wang , Qi Dou , Xiaokang Yang , Wei Shen

This paper presents a novel supervised convolutional neural network architecture, "DUCK-Net", capable of effectively learning and generalizing from small amounts of medical images to perform accurate segmentation tasks. Our model utilizes…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Razvan-Gabriel Dumitru , Darius Peteleaza , Catalin Craciun

Accurate polyp segmentation in colonoscopy is essential for early colorectal cancer detection, yet real-world clinical environments pose persistent challenges such as motion blur, specular reflections, and illumination instability. Most…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Zhuoyu Wu , Wenhui Ou , Lexi Zhang , Pei-Sze Tan , Dongjun Wu , Junhe Zhao , Wenqi Fang , Raphaël C. -W. Phan

This paper proposes a new residual convolutional neural network (CNN) architecture for single image depth estimation. Compared with existing deep CNN based methods, our method achieves much better results with fewer training examples and…

Computer Vision and Pattern Recognition · Computer Science 2017-05-02 Bo Li , Yuchao Dai , Huahui Chen , Mingyi He

This paper is created to explore deep learning models and algorithms that results in highest accuracy in detecting polyp on colonoscopy images. Previous studies implemented deep learning using convolution neural network (CNN) algorithm in…

Image and Video Processing · Electrical Eng. & Systems 2022-03-09 Ariel E. Isidro , Arnel C. Fajardo , Alexander A. Hernandez

Relative location prediction in computed tomography (CT) scan images is a challenging problem. In this paper, a regression model based on one-dimensional convolutional neural networks is proposed to determine the relative location of a CT…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Jiajia Guo , Hongwei Du , Bensheng Qiu , Xiao Liang

Recent advances in robotic learning in simulation have shown impressive results in accelerating learning complex manipulation skills. However, the sim-to-real gap, caused by discrepancies between simulation and reality, poses significant…

Robotics · Computer Science 2025-03-25 Jacinto Colan , Keisuke Sugita , Ana Davila , Yutaro Yamada , Yasuhisa Hasegawa

Ultrasound imaging is pivotal in various medical diagnoses due to its non-invasive nature and safety. In clinical practice, the accuracy and precision of ultrasound image analysis are critical. Recent advancements in deep learning are…

Image and Video Processing · Electrical Eng. & Systems 2024-08-26 Yuhan Song , Nak Young Chong

Modern robotic manipulation primarily relies on visual observations in a 2D color space for skill learning but suffers from poor generalization. In contrast, humans, living in a 3D world, depend more on physical properties-such as distance,…

Modern cameras are equipped with a wide array of sensors that enable recording the geospatial context of an image. Taking advantage of this, we explore depth estimation under the assumption that the camera is geocalibrated, a problem we…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Scott Workman , Hunter Blanton

Monocular depth and pose estimation play an important role in the development of colonoscopy-assisted navigation, as they enable improved screening by reducing blind spots, minimizing the risk of missed or recurrent lesions, and lowering…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Xinwei Ju , Rema Daher , Danail Stoyanov , Sophia Bano , Francisco Vasconcelos
‹ Prev 1 3 4 5 6 7 10 Next ›