English
Related papers

Related papers: Consistent Video Depth Estimation

200 papers

Deep learning techniques have enabled rapid progress in monocular depth estimation, but their quality is limited by the ill-posed nature of the problem and the scarcity of high quality datasets. We estimate depth from a single camera by…

Computer Vision and Pattern Recognition · Computer Science 2019-08-15 Rahul Garg , Neal Wadhwa , Sameer Ansari , Jonathan T. Barron

This paper presents an approach that reconstructs a hand-held object from a monocular video. In contrast to many recent methods that directly predict object geometry by a trained network, the proposed approach does not require any learned…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Di Huang , Xiaopeng Ji , Xingyi He , Jiaming Sun , Tong He , Qing Shuai , Wanli Ouyang , Xiaowei Zhou

Despite significant progress made in the past few years, challenges remain for depth estimation using a single monocular image. First, it is nontrivial to train a metric-depth prediction model that can generalize well to diverse scenes…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Wei Yin , Jianming Zhang , Oliver Wang , Simon Niklaus , Simon Chen , Yifan Liu , Chunhua Shen

This paper presents a probabilistic approach for online dense reconstruction using a single monocular camera moving through the environment. Compared to spatial stereo, depth estimation from motion stereo is challenging due to insufficient…

Robotics · Computer Science 2019-03-27 Yonggen Ling , Kaixuan Wang , Shaojie Shen

We present a novel method for simultaneous learning of depth, egomotion, object motion, and camera intrinsics from monocular videos, using only consistency across neighboring video frames as supervision signal. Similarly to prior work, our…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Ariel Gordon , Hanhan Li , Rico Jonschkowski , Anelia Angelova

Recently, convolutional neural networks (CNNs) have shown great success on the task of monocular depth estimation. A fundamental yet unanswered question is: how CNNs can infer depth from a single image. Toward answering this question, we…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Junjie Hu , Yan Zhang , Takayuki Okatani

Learning depth from a single image, as an important issue in scene understanding, has attracted a lot of attention in the past decade. The accuracy of the depth estimation has been improved from conditional Markov random fields,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Lei He , Guanghui Wang , Zhanyi Hu

We propose SelfRecon, a clothed human body reconstruction method that combines implicit and explicit representations to recover space-time coherent geometries from a monocular self-rotating human video. Explicit methods require a predefined…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Boyi Jiang , Yang Hong , Hujun Bao , Juyong Zhang

We present an algorithm to estimate depth in dynamic video scenes. We propose to learn and infer depth in videos from appearance, motion, occlusion boundaries, and geometric context of the scene. Using our method, depth can be estimated…

Computer Vision and Pattern Recognition · Computer Science 2015-10-27 S. Hussain Raza , Omar Javed , Aveek Das , Harpreet Sawhney , Hui Cheng , Irfan Essa

In this work, we enhance a professional end-to-end volumetric video production pipeline to achieve high-fidelity human body reconstruction using only passive cameras. While current volumetric video approaches estimate depth maps using…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Decai Chen , Markus Worchel , Ingo Feldmann , Oliver Schreer , Peter Eisert

Joint camera pose and dense geometry estimation from a set of images or a monocular video remains a challenging problem due to its computational complexity and inherent visual ambiguities. Most dense incremental reconstruction systems…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Kirill Mazur , Gwangbin Bae , Andrew J. Davison

We present a novel method to learn temporally consistent 3D reconstruction of clothed people from a monocular video. Recent methods for 3D human reconstruction from monocular video using volumetric, implicit or parametric human shape…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Akin Caliskan , Armin Mustafa , Adrian Hilton

While learning based depth estimation from images/videos has achieved substantial progress, there still exist intrinsic limitations. Supervised methods are limited by a small amount of ground truth or labeled data and unsupervised methods…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Haofei Xu , Jianmin Zheng , Jianfei Cai , Juyong Zhang

Estimating depth from a single image represents an attractive alternative to more traditional approaches leveraging multiple cameras. In this field, deep learning yielded outstanding results at the cost of needing large amounts of data…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Lorenzo Andraghetti , Panteleimon Myriokefalitakis , Pier Luigi Dovesi , Belen Luque , Matteo Poggi , Alessandro Pieropan , Stefano Mattoccia

We present a self-supervised approach to training convolutional neural networks for dense depth estimation from monocular endoscopy data without a priori modeling of anatomy or shading. Our method only requires monocular endoscopic videos…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Xingtong Liu , Ayushi Sinha , Masaru Ishii , Gregory D. Hager , Austin Reiter , Russell H. Taylor , Mathias Unberath

Monocular image-based 3D reconstruction of faces is a long-standing problem in computer vision. Since image data is a 2D projection of a 3D face, the resulting depth ambiguity makes the problem ill-posed. Most existing methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Ayush Tewari , Florian Bernard , Pablo Garrido , Gaurav Bharaj , Mohamed Elgharib , Hans-Peter Seidel , Patrick Pérez , Michael Zollhöfer , Christian Theobalt

Monocular depth prediction plays a crucial role in understanding 3D scene geometry. Although recent methods have achieved impressive progress in terms of evaluation metrics such as the pixel-wise relative error, most methods neglect the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Wei Yin , Yifan Liu , Chunhua Shen

We present a method for predicting dense depth in scenarios where both a monocular camera and people in the scene are freely moving. Existing methods for recovering depth for dynamic, non-rigid objects from monocular video impose strong…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Zhengqi Li , Tali Dekel , Forrester Cole , Richard Tucker , Noah Snavely , Ce Liu , William T. Freeman

Estimating depth from single RGB images and videos is of widespread interest due to its applications in many areas, including autonomous driving, 3D reconstruction, digital entertainment, and robotics. More than 500 deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Uchitha Rajapaksha , Ferdous Sohel , Hamid Laga , Dean Diepeveen , Mohammed Bennamoun

Learning single image depth estimation model from monocular video sequence is a very challenging problem. In this paper, we propose a novel training loss which enables us to include more images for supervision during the training process.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Zhenwei Luo