English
Related papers

Related papers: EndoStreamDepth: Temporally Consistent Monocular D…

200 papers

We present a system that allows for accurate, fast, and robust estimation of camera parameters and depth maps from casual monocular videos of dynamic scenes. Most conventional structure from motion and monocular SLAM techniques assume input…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Zhengqi Li , Richard Tucker , Forrester Cole , Qianqian Wang , Linyi Jin , Vickie Ye , Angjoo Kanazawa , Aleksander Holynski , Noah Snavely

Monocular metric depth estimation (MMDE) is a crucial task to solve for indoor scene reconstruction on edge devices. Despite this importance, existing models are sensitive to factors such as boundary frequency of objects in the scene and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Sanghyun Byun , Jacob Song , Woo Seong Chung

In this work, we address the problem of real-time dense depth estimation from monocular images for mobile underwater vehicles. We formulate a deep learning model that fuses sparse depth measurements from triangulated features to improve the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Luca Ebner , Gideon Billings , Stefan Williams

We present a novel approach for metric dense depth estimation based on the fusion of a single-view image and a sparse, noisy Radar point cloud. The direct fusion of heterogeneous Radar and image data, or their encodings, tends to yield…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Han Li , Yukai Ma , Yaqing Gu , Kewei Hu , Yong Liu , Xingxing Zuo

This paper studies unsupervised monocular depth prediction problem. Most of existing unsupervised depth prediction algorithms are developed for outdoor scenarios, while the depth prediction work in the indoor environment is still very…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Yinglong Feng , Shuncheng Wu , Okan Köpüklü , Xueyang Kang , Federico Tombari

We present a novel approach for estimating depth from a monocular camera as it moves through complex and crowded indoor environments, e.g., a department store or a metro station. Our approach predicts absolute scale depth maps over the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Dongki Jung , Jaehoon Choi , Yonghan Lee , Deokhwa Kim , Changick Kim , Dinesh Manocha , Donghwan Lee

Deep learning techniques hold promise to develop dense topography reconstruction and pose estimation methods for endoscopic videos. However, currently available datasets do not support effective quantitative benchmarking. In this paper, we…

One of the key elements of reconstructing a 3D mesh from a monocular video is generating every frame's depth map. However, in the application of colonoscopy video reconstruction, producing good-quality depth estimation is challenging.…

Image and Video Processing · Electrical Eng. & Systems 2021-11-23 Yubo Zhang , Jan-Michael Frahm , Samuel Ehrenstein , Sarah K. McGill , Julian G. Rosenman , Shuxian Wang , Stephen M. Pizer

Monocular depth estimation (MDE) aims to transform an RGB image of a scene into a pixelwise depth map from the same camera view. It is fundamentally ill-posed due to missing information: any single image can have been taken from many…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Dylan Auty , Krystian Mikolajczyk

Self-supervised monocular depth estimation has gathered notable interest since it can liberate training from dependency on depth annotations. In monocular video training case, recent methods only conduct view synthesis between existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Jinfeng Liu , Lingtong Kong , Bo Li , Zerong Wang , Hong Gu , Jinwei Chen

Monocular visual odometry approaches that purely rely on geometric cues are prone to scale drift and require sufficient motion parallax in successive frames for motion estimation and 3D reconstruction. In this paper, we propose to leverage…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Nan Yang , Rui Wang , Jörg Stückler , Daniel Cremers

Modern visual agents require representations that are general, causal, and physically structured to operate in real-time streaming environments. However, current vision foundation models remain fragmented, specializing narrowly in image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Yibin Yan , Jilan Xu , Shangzhe Di , Haoning Wu , Weidi Xie

Robust three-dimensional scene understanding is now an ever-growing area of research highly relevant in many real-world applications such as autonomous driving and robotic navigation. In this paper, we propose a multi-task learning-based…

Computer Vision and Pattern Recognition · Computer Science 2019-08-16 Amir Atapour-Abarghouei , Toby P. Breckon

Monocular depth inference is a fundamental problem for scene perception of robots. Specific robots may be equipped with a camera plus an optional depth sensor of any type and located in various scenes of different scales, whereas recent…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Haotian Wang , Meng Yang , Nanning Zheng

Recent work has shown that CNN-based depth and ego-motion estimators can be learned using unlabelled monocular videos. However, the performance is limited by unidentified moving objects that violate the underlying static scene assumption in…

Computer Vision and Pattern Recognition · Computer Science 2019-10-04 Jia-Wang Bian , Zhichao Li , Naiyan Wang , Huangying Zhan , Chunhua Shen , Ming-Ming Cheng , Ian Reid

Self-supervised multi-frame monocular depth estimation relies on the geometric consistency between successive frames under the assumption of a static scene. However, the presence of moving objects in dynamic scenes introduces inevitable…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Sungmin Woo , Wonjoon Lee , Woo Jin Kim , Dogyoon Lee , Sangyoun Lee

Unsupervised deep learning methods have shown promising performance for single-image depth estimation. Since most of these methods use binocular stereo pairs for self-supervision, the depth range is generally limited. Small-baseline stereo…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Saad Imran , Muhammad Umar Karim Khan , Sikander Bin Mukarram , Chong-Min Kyung

Monocular depth estimation using Convolutional Neural Networks (CNNs) has shown impressive performance in outdoor driving scenes. However, self-supervised learning of indoor depth from monocular sequences is quite challenging for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Chao Fan , Zhenyu Yin , Yue Li , Feiqing Zhang

This work addresses the task of zero-shot monocular depth estimation. A recent advance in this field has been the idea of utilising Text-to-Image foundation models, such as Stable Diffusion. Foundation models provide a rich and generic…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Denis Zavadski , Damjan Kalšan , Carsten Rother

Recovering temporally consistent 3D human body pose, shape and motion from a monocular video is a challenging task due to (self-)occlusions, poor lighting conditions, complex articulated body poses, depth ambiguity, and limited availability…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Sushovan Chanda , Amogh Tiwari , Lokender Tiwari , Brojeshwar Bhowmick , Avinash Sharma , Hrishav Barua