中文
相关论文

相关论文: Learning structure-from-motion from motion

200 篇论文

Unsupervised learning of depth and ego-motion from unlabelled monocular videos has recently drawn great attention, which avoids the use of expensive ground truth in the supervised one. It achieves this by using the photometric errors…

计算机视觉与模式识别 · 计算机科学 2020-11-23 Hualie Jiang , Laiyan Ding , Zhenglong Sun , Rui Huang

Self-supervised learning of depth map prediction and motion estimation from monocular video sequences is of vital importance -- since it realizes a broad range of tasks in robotics and autonomous vehicles. A large number of research efforts…

计算机视觉与模式识别 · 计算机科学 2021-03-24 Ue-Hwan Kim , Jong-Hwan Kim

We present an end-to-end joint training framework that explicitly models 6-DoF motion of multiple dynamic objects, ego-motion and depth in a monocular camera setup without supervision. Our technical contributions are three-fold. First, we…

计算机视觉与模式识别 · 计算机科学 2021-02-05 Seokju Lee , Sunghoon Im , Stephen Lin , In So Kweon

Accurate depth estimation from monocular videos remains challenging due to ambiguities inherent in single-view geometry, as crucial depth cues like stereopsis are absent. However, humans often perceive relative depth intuitively by…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Seokju Cho , Jiahui Huang , Seungryong Kim , Joon-Young Lee

In this paper we formulate structure from motion as a learning problem. We train a convolutional network end-to-end to compute depth and camera motion from successive, unconstrained image pairs. The architecture is composed of multiple…

计算机视觉与模式识别 · 计算机科学 2018-01-18 Benjamin Ummenhofer , Huizhong Zhou , Jonas Uhrig , Nikolaus Mayer , Eddy Ilg , Alexey Dosovitskiy , Thomas Brox

We present an algorithm to estimate depth in dynamic video scenes. We propose to learn and infer depth in videos from appearance, motion, occlusion boundaries, and geometric context of the scene. Using our method, depth can be estimated…

计算机视觉与模式识别 · 计算机科学 2015-10-27 S. Hussain Raza , Omar Javed , Aveek Das , Harpreet Sawhney , Hui Cheng , Irfan Essa

Learning to estimate 3D geometry in a single image by watching unlabeled videos via deep convolutional network has made significant process recently. Current state-of-the-art (SOTA) methods, are based on the learning framework of rigid…

计算机视觉与模式识别 · 计算机科学 2018-08-17 Zhenheng Yang , Peng Wang , Yang Wang , Wei Xu , Ram Nevatia

This paper focuses on self-supervised monocular depth estimation in dynamic scenes trained on monocular videos. Existing methods jointly estimate pixel-wise depth and motion, relying mainly on an image reconstruction loss. Dynamic regions1…

计算机视觉与模式识别 · 计算机科学 2024-04-24 Hoang Chuong Nguyen , Tianyu Wang , Jose M. Alvarez , Miaomiao Liu

We present an algorithm for estimating consistent dense depth maps and camera poses from a monocular video. We integrate a learning-based depth prior, in the form of a convolutional neural network trained for single-image depth estimation,…

计算机视觉与模式识别 · 计算机科学 2021-06-23 Johannes Kopf , Xuejian Rong , Jia-Bin Huang

As processing power has become more available, more human-like artificial intelligences are created to solve image processing tasks that we are inherently good at. As such we propose a model that estimates depth from a monocular image. Our…

计算机视觉与模式识别 · 计算机科学 2019-05-14 Fabian Truetsch , Alfred Schöttl

Monocular dynamic reconstruction is a challenging and long-standing vision problem due to the highly ill-posed nature of the task. Existing approaches depend on templates, are effective only in quasi-static scenes, or fail to model 3D…

计算机视觉与模式识别 · 计算机科学 2025-10-17 Qianqian Wang , Vickie Ye , Hang Gao , Weijia Zeng , Jake Austin , Zhengqi Li , Angjoo Kanazawa

In this paper, we introduce a novel training method for making any monocular depth network learn absolute scale and estimate metric road-scene depth just from regular training data, i.e., driving videos. We refer to this training framework…

计算机视觉与模式识别 · 计算机科学 2024-10-02 Genki Kinoshita , Ko Nishino

The ability to predict depth from a single image - using recent advances in CNNs - is of increasing interest to the vision community. Unsupervised strategies to learning are particularly appealing as they can utilize much larger and varied…

计算机视觉与模式识别 · 计算机科学 2017-12-04 Chaoyang Wang , Jose Miguel Buenaposada , Rui Zhu , Simon Lucey

In this paper, we propose a novel method for monocular depth estimation in dynamic scenes. We first explore the arbitrariness of object's movement trajectory in dynamic scenes theoretically. To overcome the arbitrariness, we use assume that…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Kebin Peng , John Quarles , Kevin Desai

Unsupervised methods have showed promising results on monocular depth estimation. However, the training data must be captured in scenes without moving objects. To push the envelope of accuracy, recent methods tend to increase their model…

计算机视觉与模式识别 · 计算机科学 2023-03-09 Tak-Wai Hui

We present a novel unsupervised learning framework for single view depth estimation using monocular videos. It is well known in 3D vision that enlarging the baseline can increase the depth estimation accuracy, and jointly optimizing a set…

计算机视觉与模式识别 · 计算机科学 2018-12-11 Lipu Zhou , Jiamin Ye , Montiel Abello , Shengze Wang , Michael Kaess

As a flexible passive 3D sensing means, unsupervised learning of depth from monocular videos is becoming an important research topic. It utilizes the photometric errors between the target view and the synthesized views from its adjacent…

计算机视觉与模式识别 · 计算机科学 2021-08-31 Hualie Jiang , Laiyan Ding , Zhenglong Sun , Rui Huang

We propose a monocular depth estimator SC-Depth, which requires only unlabelled videos for training and enables the scale-consistent prediction at inference time. Our contributions include: (i) we propose a geometry consistency loss, which…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Jia-Wang Bian , Huangying Zhan , Naiyan Wang , Zhichao Li , Le Zhang , Chunhua Shen , Ming-Ming Cheng , Ian Reid

Extracting and predicting object structure and dynamics from videos without supervision is a major challenge in machine learning. To address this challenge, we adopt a keypoint-based image representation and learn a stochastic dynamics…

计算机视觉与模式识别 · 计算机科学 2020-03-03 Matthias Minderer , Chen Sun , Ruben Villegas , Forrester Cole , Kevin Murphy , Honglak Lee

Monocular depth estimation has been increasingly adopted in robotics and autonomous driving for its ability to infer scene geometry from a single camera. In self-supervised monocular depth estimation frameworks, the network jointly…

计算机视觉与模式识别 · 计算机科学 2025-09-18 Tae-Wook Um , Ki-Hyeon Kim , Hyun-Duck Choi , Hyo-Sung Ahn