English
Related papers

Related papers: Structured Depth Prediction in Challenging Monocul…

200 papers

Although considerable advancements have been attained in self-supervised depth estimation from monocular videos, most existing methods often treat all objects in a video as static entities, which however violates the dynamic nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Xiuzhe Wu , Xiaoyang Lyu , Qihao Huang , Yong Liu , Yang Wu , Ying Shan , Xiaojuan Qi

This paper proposes a new approach for monocular dense 3D reconstruction of a complex dynamic scene from two perspective frames. By applying superpixel over-segmentation to the image, we model a generically dynamic (hence non-rigid) scene…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 Suryansh Kumar , Yuchao Dai , Hongdong Li

We review solutions to the problem of depth estimation, arguably the most important subtask in scene understanding. We focus on the single image depth estimation problem. Due to its properties, the single image depth estimation problem is…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Alican Mertan , Damien Jade Duff , Gozde Unal

360{\deg} cameras can capture complete environments in a single shot, which makes 360{\deg} imagery alluring in many computer vision tasks. However, monocular depth estimation remains a challenge for 360{\deg} data, particularly for high…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Manuel Rey-Area , Mingze Yuan , Christian Richardt

Event cameras are novel sensors that output brightness changes in the form of a stream of asynchronous events instead of intensity frames. Compared to conventional image sensors, they offer significant advantages: high temporal resolution,…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Javier Hidalgo-Carrió , Daniel Gehrig , Davide Scaramuzza

We present a method for predicting dense depth in scenarios where both a monocular camera and people in the scene are freely moving. Existing methods for recovering depth for dynamic, non-rigid objects from monocular video impose strong…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Zhengqi Li , Tali Dekel , Forrester Cole , Richard Tucker , Noah Snavely , Ce Liu , William T. Freeman

We present an end-to-end joint training framework that explicitly models 6-DoF motion of multiple dynamic objects, ego-motion and depth in a monocular camera setup without supervision. Our technical contributions are three-fold. First, we…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Seokju Lee , Sunghoon Im , Stephen Lin , In So Kweon

Depth estimation and 3D object detection are critical for scene understanding but remain challenging to perform with a single image due to the loss of 3D information during image capture. Recent models using deep neural networks have…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Julie Chang , Gordon Wetzstein

With the popularity of monocular videos generated by video sharing and live broadcasting applications, reconstructing and editing dynamic scenes in stationary monocular cameras has become a special but anticipated technology. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Weixing Xie , Xiao Dong , Yong Yang , Qiqin Lin , Jingze Chen , Junfeng Yao , Xiaohu Guo

Self-supervised monocular depth estimation has gathered notable interest since it can liberate training from dependency on depth annotations. In monocular video training case, recent methods only conduct view synthesis between existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Jinfeng Liu , Lingtong Kong , Bo Li , Zerong Wang , Hong Gu , Jinwei Chen

Monocular depth estimation (MDE) aims to transform an RGB image of a scene into a pixelwise depth map from the same camera view. It is fundamentally ill-posed due to missing information: any single image can have been taken from many…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Dylan Auty , Krystian Mikolajczyk

This paper reports a new continuous 3D loss function for learning depth from monocular images. The dense depth prediction from a monocular image is supervised using sparse LIDAR points, which enables us to leverage available open source…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Minghan Zhu , Maani Ghaffari , Yuanxin Zhong , Pingping Lu , Zhong Cao , Ryan M. Eustice , Huei Peng

Three-dimensional (3D) reconstruction from a single image is an ill-posed problem with inherent ambiguities, i.e. scale. Predicting a 3D scene from text description(s) is similarly ill-posed, i.e. spatial arrangements of objects described.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Ziyao Zeng , Daniel Wang , Fengyu Yang , Hyoungseob Park , Yangchao Wu , Stefano Soatto , Byung-Woo Hong , Dong Lao , Alex Wong

There have been attempts to detect 3D objects by fusion of stereo camera images and LiDAR sensor data or using LiDAR for pre-training and only monocular images for testing, but there have been less attempts to use only monocular image…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Curie Kim , Ue-Hwan Kim , Jong-Hwan Kim

Estimating depth from a single RGB images is a fundamental task in computer vision, which is most directly solved using supervised deep learning. In the field of unsupervised learning of depth from a single RGB image, depth is not given…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Shir Gur , Lior Wolf

The field of monocular depth estimation is continually evolving with the advent of numerous innovative models and extensions. However, research on monocular depth estimation methods specifically for underwater scenes remains limited,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Wenxiang Gua , Lin Qia

Recent work in unsupervised multi-object segmentation shows impressive results by predicting motion from a single image despite the inherent ambiguity in predicting motion without the next image. On the other hand, the set of possible…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Sadra Safadoust , Fatma Güney

In this paper, we target at the problem of learning a generalizable dynamic radiance field from monocular videos. Different from most existing NeRF methods that are based on multiple views, monocular videos only contain one view at each…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Fengrui Tian , Shaoyi Du , Yueqi Duan

Depth estimation from a single image is an active research topic in computer vision. The most accurate approaches are based on fully supervised learning models, which rely on a large amount of dense and high-resolution (HR) ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Jialei Xu , Yuanchao Bai , Xianming Liu , Junjun Jiang , Xiangyang Ji

This paper tackles the challenges of self-supervised monocular depth estimation in indoor scenes caused by large rotation between frames and low texture. We ease the learning process by obtaining coarse camera poses from monocular sequences…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Chaoqiang Zhao , Matteo Poggi , Fabio Tosi , Lei Zhou , Qiyu Sun , Yang Tang , Stefano Mattoccia