English
Related papers

Related papers: Learning-Based Depth and Pose Estimation for Monoc…

200 papers

Deep learning techniques hold promise to develop dense topography reconstruction and pose estimation methods for endoscopic videos. However, currently available datasets do not support effective quantitative benchmarking. In this paper, we…

This paper reports a new continuous 3D loss function for learning depth from monocular images. The dense depth prediction from a monocular image is supervised using sparse LIDAR points, which enables us to leverage available open source…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Minghan Zhu , Maani Ghaffari , Yuanxin Zhong , Pingping Lu , Zhong Cao , Ryan M. Eustice , Huei Peng

Colorectal cancer is the third most common cause of cancer death worldwide. Optical colonoscopy is the gold standard for detecting colorectal cancer; however, about 25 percent of polyps are missed during the procedure. A vision-based…

Image and Video Processing · Electrical Eng. & Systems 2023-01-20 Alwyn Mathew , Ludovic Magerand , Emanuele Trucco , Luigi Manfredi

Monocular depth estimation in endoscopy videos can enable assistive and robotic surgery to obtain better coverage of the organ and detection of various health issues. Despite promising progress on mainstream, natural image depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Akshay Paruchuri , Samuel Ehrenstein , Shuxian Wang , Inbar Fried , Stephen M. Pizer , Marc Niethammer , Roni Sengupta

Estimation of the human pose from a monocular camera has been an emerging research topic in the computer vision community with many applications. Recently, benefited from the deep learning technologies, a significant amount of research…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Wu Liu , Qian Bao , Yu Sun , Tao Mei

The self-supervised learning of depth and pose from monocular sequences provides an attractive solution by using the photometric consistency of nearby frames as it depends much less on the ground-truth data. In this paper, we address the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Tianwei Shen , Lei Zhou , Zixin Luo , Yao Yao , Shiwei Li , Jiahui Zhang , Tian Fang , Long Quan

Depth estimation is a cornerstone of 3D reconstruction and plays a vital role in minimally invasive endoscopic surgeries. However, most current depth estimation networks rely on traditional convolutional neural networks, which are limited…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Bojian Li , Bo Liu , Xinning Yao , Jinghua Yue , Fugen Zhou

One of the key elements of reconstructing a 3D mesh from a monocular video is generating every frame's depth map. However, in the application of colonoscopy video reconstruction, producing good-quality depth estimation is challenging.…

Image and Video Processing · Electrical Eng. & Systems 2021-11-23 Yubo Zhang , Jan-Michael Frahm , Samuel Ehrenstein , Sarah K. McGill , Julian G. Rosenman , Shuxian Wang , Stephen M. Pizer

Colorectal cancer is one of the most common cancers in the world. While colonoscopy is an effective screening technique, navigating an endoscope through the colon to detect polyps is challenging. A 3D map of the observed surfaces could…

This paper tackles the challenges of self-supervised monocular depth estimation in indoor scenes caused by large rotation between frames and low texture. We ease the learning process by obtaining coarse camera poses from monocular sequences…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Chaoqiang Zhao , Matteo Poggi , Fabio Tosi , Lei Zhou , Qiyu Sun , Yang Tang , Stefano Mattoccia

Supervised learning based methods for monocular depth estimation usually require large amounts of extensively annotated training data. In the case of aerial imagery, this ground truth is particularly difficult to acquire. Therefore, in this…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Max Hermann , Boitumelo Ruf , Martin Weinmann , Stefan Hinz

We propose DFPNet -- an unsupervised, joint learning system for monocular Depth, Optical Flow and egomotion (Camera Pose) estimation from monocular image sequences. Due to the nature of 3D scene geometry these three components are coupled.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Dipan Mandal , Abhilash Jain

Recently, the amount of GI tract datasets is introduced more and more by gathering from contests and challenges. The most common task needs to solve that is to classify images from the GI tract into various classes. However, the…

Image and Video Processing · Electrical Eng. & Systems 2023-10-16 Tai Nguyen-D-P

Estimating depth information from endoscopic images is a prerequisite for a wide set of AI-assisted technologies, such as accurate localization and measurement of tumors, or identification of non-inspected areas. As the domain specificity…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Javier Rodríguez-Puigvert , David Recasens , Javier Civera , Rubén Martínez-Cantín

Per-pixel ground-truth depth data is challenging to acquire at scale. To overcome this limitation, self-supervised learning has emerged as a promising alternative for training models to perform monocular depth estimation. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Clément Godard , Oisin Mac Aodha , Michael Firman , Gabriel Brostow

We propose a novel approach to jointly perform 3D shape retrieval and pose estimation from monocular images.In order to make the method robust to real-world image variations, e.g. complex textures and backgrounds, we learn an embedding…

Computer Vision and Pattern Recognition · Computer Science 2019-03-28 Kyaw Zaw Lin , Weipeng Xu , Qianru Sun , Christian Theobalt , Tat-Seng Chua

We present a novel unsupervised learning framework for single view depth estimation using monocular videos. It is well known in 3D vision that enlarging the baseline can increase the depth estimation accuracy, and jointly optimizing a set…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Lipu Zhou , Jiamin Ye , Montiel Abello , Shengze Wang , Michael Kaess

Deep learning has shown to be effective for robust and real-time monocular image relocalisation. In particular, PoseNet is a deep convolutional neural network which learns to regress the 6-DOF camera pose from a single image. It learns to…

Computer Vision and Pattern Recognition · Computer Science 2017-05-24 Alex Kendall , Roberto Cipolla

We present an unsupervised simultaneous learning framework for the task of monocular camera re-localization and depth estimation from unlabeled video sequences. Monocular camera re-localization refers to the task of estimating the absolute…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Shun Taguchi , Noriaki Hirose

We present a generalised self-supervised learning approach for monocular estimation of the real depth across scenes with diverse depth ranges from 1--100s of meters. Existing supervised methods for monocular depth estimation require…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Mertalp Ocal , Armin Mustafa