English
Related papers

Related papers: Seurat: From Moving Points to Depth

200 papers

Monocular depth estimation, enabled by self-supervised learning, is a key technique for 3D perception in computer vision. However, it faces significant challenges in real-world scenarios, which encompass adverse weather variations, motion…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Runze Chen , Haiyong Luo , Fang Zhao , Jingze Yu , Yupeng Jia , Juan Wang , Xuepeng Ma

Monocular depth estimation has become one of the most studied applications in computer vision, where the most accurate approaches are based on fully supervised learning models. However, the acquisition of accurate and large ground truth…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Adrian Johnston , Gustavo Carneiro

We present HaPTIC, an approach that infers coherent 4D hand trajectories from monocular videos. Current video-based hand pose reconstruction methods primarily focus on improving frame-wise 3D pose using adjacent frames rather than studying…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Yufei Ye , Yao Feng , Omid Taheri , Haiwen Feng , Shubham Tulsiani , Michael J. Black

Learning accurate depth is essential to multi-view 3D object detection. Recent approaches mainly learn depth from monocular images, which confront inherent difficulties due to the ill-posed nature of monocular depth learning. Instead of…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Zengran Wang , Chen Min , Zheng Ge , Yinhao Li , Zeming Li , Hongyu Yang , Di Huang

Depth Estimation has wide reaching applications in the field of Computer vision such as target tracking, augmented reality, and self-driving cars. The goal of Monocular Depth Estimation is to predict the depth map, given a 2D monocular RGB…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Mayank Poddar , Akash Mishra , Mohit Kewlani , Haoyang Pei

We present an algorithm for estimating consistent dense depth maps and camera poses from a monocular video. We integrate a learning-based depth prior, in the form of a convolutional neural network trained for single-image depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Johannes Kopf , Xuejian Rong , Jia-Bin Huang

For ego-motion estimation, the feature representation of the scenes is crucial. Previous methods indicate that both the low-level and semantic feature-based methods can achieve promising results. Therefore, the incorporation of hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Xiaochuan Yin , Chengju Liu

Depth estimation is critical for any robotic system. In the past years estimation of depth from monocular images have shown great improvement, however, in the underwater environment results are still lagging behind due to appearance changes…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Shlomi Amitai , Itzik Klein , Tali Treibitz

Monocular object detection and tracking have improved drastically in recent years, but rely on a key assumption: that objects are visible to the camera. Many offline tracking approaches reason about occluded objects post-hoc, by linking…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Tarasha Khurana , Achal Dave , Deva Ramanan

Self-supervised learning of depth map prediction and motion estimation from monocular video sequences is of vital importance -- since it realizes a broad range of tasks in robotics and autonomous vehicles. A large number of research efforts…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Ue-Hwan Kim , Jong-Hwan Kim

As an agent moves through the world, the apparent motion of scene elements is (usually) inversely proportional to their depth. It is natural for a learning agent to associate image patterns with the magnitude of their displacement over…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Huaizu Jiang , Erik Learned-Miller , Gustav Larsson , Michael Maire , Greg Shakhnarovich

Self-supervised monocular depth estimation presents a powerful method to obtain 3D scene information from single camera images, which is trainable on arbitrary image sequences without requiring depth labels, e.g., from a LiDAR sensor. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Marvin Klingner , Jan-Aike Termöhlen , Jonas Mikolajczyk , Tim Fingscheidt

Monocular depth estimation plays a crucial role in 3D recognition and understanding. One key limitation of existing approaches lies in their lack of structural information exploitation, which leads to inaccurate spatial layout,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Tian Chen , Shijie An , Yuan Zhang , Chongyang Ma , Huayan Wang , Xiaoyan Guo , Wen Zheng

Per-pixel ground-truth depth data is challenging to acquire at scale. To overcome this limitation, self-supervised learning has emerged as a promising alternative for training models to perform monocular depth estimation. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Clément Godard , Oisin Mac Aodha , Michael Firman , Gabriel Brostow

Perceiving 3D information is of paramount importance in many applications of computer vision. Recent advances in monocular depth estimation have shown that gaining such knowledge from a single camera input is possible by training deep…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Sai Shyam Chanduri , Zeeshan Khan Suri , Igor Vozniak , Christian Müller

Autonomous cars need continuously updated depth information. Thus far, depth is mostly estimated independently for a single frame at a time, even if the method starts from video input. Our method produces a time series of depth maps, which…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Vaishakh Patil , Wouter Van Gansbeke , Dengxin Dai , Luc Van Gool

In this paper, we present an approach for tracking people in monocular videos, by predicting their future 3D representations. To achieve this, we first lift people to 3D from a single frame in a robust way. This lifting includes information…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Jathushan Rajasegaran , Georgios Pavlakos , Angjoo Kanazawa , Jitendra Malik

The success of monocular depth estimation relies on large and diverse training sets. Due to the challenges associated with acquiring dense ground-truth depth across different environments at scale, a number of datasets with distinct…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 René Ranftl , Katrin Lasinger , David Hafner , Konrad Schindler , Vladlen Koltun

This paper studies unsupervised monocular depth prediction problem. Most of existing unsupervised depth prediction algorithms are developed for outdoor scenarios, while the depth prediction work in the indoor environment is still very…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Yinglong Feng , Shuncheng Wu , Okan Köpüklü , Xueyang Kang , Federico Tombari

The majority of prior monocular depth estimation methods without groundtruth depth guidance focus on driving scenarios. We show that such methods generalize poorly to unseen complex indoor scenes, where objects are cluttered and arbitrarily…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Cho-Ying Wu , Jialiang Wang , Michael Hall , Ulrich Neumann , Shuochen Su