English
Related papers

Related papers: Learning Depth from Monocular Videos Using Synthet…

200 papers

With the rapid growth of video data, text-video retrieval technology has become increasingly important in numerous application scenarios such as recommendation and search. Early text-video retrieval methods suffer from two critical…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jiaao Yu , Mingjie Han , Tao Gong , Jian Zhang , Man Lan

In this paper, we address the problem of monocular depth estimation when only a limited number of training image-depth pairs are available. To achieve a high regression accuracy, the state-of-the-art estimation methods rely on CNNs trained…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Rongrong Ji , Ke Li , Yan Wang , Xiaoshuai Sun , Feng Guo , Xiaowei Guo , Yongjian Wu , Feiyue Huang , Jiebo Luo

The usefulness of deep learning models in robotics is largely dependent on the availability of training data. Manual annotation of training data is often infeasible. Synthetic data is a viable alternative, but suffers from domain gap. We…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Benedikt T. Imbusch , Max Schwarz , Sven Behnke

Unsupervised domain adaptive semantic segmentation (UDA-SS) aims to train a model on the source domain data (e.g., synthetic) and adapt the model to predict target domain data (e.g., real-world) without accessing target annotation data.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Md. Al-Masrur Khan , Zheng Chen , Lantao Liu

Inferring the depth of transparent or mirror (ToM) surfaces represents a hard challenge for either sensors, algorithms, or deep networks. We propose a simple pipeline for learning to estimate depth properly for such surfaces with neural…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Alex Costanzino , Pierluigi Zama Ramirez , Matteo Poggi , Fabio Tosi , Stefano Mattoccia , Luigi Di Stefano

Temporal consistency is the key challenge of video depth estimation. Previous works are based on additional optical flow or camera poses, which is time-consuming. By contrast, we derive consistency with less information. Since videos…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Yiran Wang , Zhiyu Pan , Xingyi Li , Zhiguo Cao , Ke Xian , Jianming Zhang

This paper proposes a self-supervised monocular image-to-depth prediction framework that is trained with an end-to-end photometric loss that handles not only 6-DOF camera motion but also 6-DOF moving object instances. Self-supervision is…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Houssem Boulahbal , Adrian Voicila , Andrew Comport

Data-driven depth estimation methods struggle with the generalization outside their training scenes due to the immense variability of the real-world scenes. This problem can be partially addressed by utilising synthetically generated…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Maxim Maximov , Kevin Galim , Laura Leal-Taixé

In the recent years, many methods demonstrated the ability of neural networks to learn depth and pose changes in a sequence of images, using only self-supervision as the training signal. Whilst the networks achieve good performance, the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Robert McCraith , Lukas Neumann , Andrea Vedaldi

In unsupervised domain adaptation (UDA), a model trained on source data (e.g. synthetic) is adapted to target data (e.g. real-world) without access to target annotation. Most previous UDA methods struggle with classes that have a similar…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Lukas Hoyer , Dengxin Dai , Haoran Wang , Luc Van Gool

Scene segmentation via unsupervised domain adaptation (UDA) enables the transfer of knowledge acquired from source synthetic data to real-world target data, which largely reduces the need for manual pixel-level annotations in the target…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Mu Chen , Zhedong Zheng , Yi Yang

Multi-source unsupervised domain adaptation~(MSDA) aims at adapting models trained on multiple labeled source domains to an unlabeled target domain. In this paper, we propose a novel multi-source domain adaptation framework based on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Jianzhong He , Xu Jia , Shuaijun Chen , Jianzhuang Liu

Deep learning approaches for semantic segmentation rely primarily on supervised learning approaches and require substantial efforts in producing pixel-level annotations. Further, such approaches may perform poorly when applied to unseen…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Ying Chen , Xu Ouyang , Kaiyue Zhu , Gady Agam

This work addresses the unsupervised adaptation of an existing object detector to a new target domain. We assume that a large number of unlabeled videos from this domain are readily available. We automatically obtain labels on the target…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Aruni RoyChowdhury , Prithvijit Chakrabarty , Ashish Singh , SouYoung Jin , Huaizu Jiang , Liangliang Cao , Erik Learned-Miller

Building upon the recent progress in novel view synthesis, we propose its application to improve monocular depth estimation. In particular, we propose a novel training method split in three main steps. First, the prediction results of a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Zuria Bauer , Zuoyue Li , Sergio Orts-Escolano , Miguel Cazorla , Marc Pollefeys , Martin R. Oswald

Real-world vision models in dynamic environments face rapid shifts in domain distributions, leading to decreased recognition performance. Using unlabeled test data, continuous test-time adaptation (CTTA) directly adjusts a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Sarthak Kumar Maharana , Baoming Zhang , Yunhui Guo

We present a method for predicting dense depth in scenarios where both a monocular camera and people in the scene are freely moving. Existing methods for recovering depth for dynamic, non-rigid objects from monocular video impose strong…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Zhengqi Li , Tali Dekel , Forrester Cole , Richard Tucker , Noah Snavely , Ce Liu , William T. Freeman

Remarkable progress has been made in self-supervised monocular depth estimation (SS-MDE) by exploring cross-view consistency, e.g., photometric consistency and 3D point cloud consistency. However, they are very vulnerable to illumination…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Haimei Zhao , Jing Zhang , Zhuo Chen , Bo Yuan , Dacheng Tao

Self-supervised monocular depth estimation holds significant importance in the fields of autonomous driving and robotics. However, existing methods are typically trained and tested on standard datasets, overlooking the impact of various…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Ziyang Song , Ruijie Zhu , Chuxin Wang , Jiacheng Deng , Jianfeng He , Tianzhu Zhang

Synthetic images are one of the most promising solutions to avoid high costs associated with generating annotated datasets to train supervised convolutional neural networks (CNN). However, to allow networks to generalize knowledge from…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Tobias Scheck , Ana Perez Grassi , Gangolf Hirtz