English
Related papers

Related papers: Semantics-Driven Unsupervised Learning for Monocul…

200 papers

For reliable autonomous robot navigation in urban settings, the robot must have the ability to identify semantically traversable terrains in the image based on the semantic understanding of the scene. This reasoning ability is based on…

Robotics · Computer Science 2024-12-30 Yunho Kim , Jeong Hyun Lee , Choongin Lee , Juhyeok Mun , Donghoon Youm , Jeongsoo Park , Jemin Hwangbo

State-of-the-art self-supervised learning approaches for monocular depth estimation usually suffer from scale ambiguity. They do not generalize well when applied on distance estimation for complex projection models such as in fisheye and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Varun Ravi Kumar , Marvin Klingner , Senthil Yogamani , Stefan Milz , Tim Fingscheidt , Patrick Maeder

Self-supervised monocular depth estimation is an attractive solution that does not require hard-to-source depth labels for training. Convolutional neural networks (CNNs) have recently achieved great success in this task. However, their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Chaoqiang Zhao , Youmin Zhang , Matteo Poggi , Fabio Tosi , Xianda Guo , Zheng Zhu , Guan Huang , Yang Tang , Stefano Mattoccia

In this paper, we address the problem of monocular depth estimation when only a limited number of training image-depth pairs are available. To achieve a high regression accuracy, the state-of-the-art estimation methods rely on CNNs trained…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Rongrong Ji , Ke Li , Yan Wang , Xiaoshuai Sun , Feng Guo , Xiaowei Guo , Yongjian Wu , Feiyue Huang , Jiebo Luo

We propose a deep video prediction model conditioned on a single image and an action class. To generate future frames, we first detect keypoints of a moving object and predict future motion as a sequence of keypoints. The input image is…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Yunji Kim , Seonghyeon Nam , In Cho , Seon Joo Kim

Semantic segmentation is a crucial step in many Earth observation tasks. Large quantity of pixel-level annotation is required to train deep networks for semantic segmentation. Earth observation techniques are applied to varieties of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Sudipan Saha , Lichao Mou , Muhammad Shahzad , Xiao Xiang Zhu

Dense depth estimation from a single image is a key problem in computer vision, with exciting applications in a multitude of robotic tasks. Initially viewed as a direct regression problem, requiring annotated labels as supervision at…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Vitor Guizilini , Jie Li , Rares Ambrus , Sudeep Pillai , Adrien Gaidon

Monocular visual localization plays a pivotal role in advanced driver assistance systems and autonomous driving by estimating a vehicle's ego-motion from a single pinhole camera. Nevertheless, conventional monocular visual odometry…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Hui Zhang , Zhiyang Wu , Qianqian Shangguan , Kang An

Unsupervised deep learning methods have shown promising performance for single-image depth estimation. Since most of these methods use binocular stereo pairs for self-supervision, the depth range is generally limited. Small-baseline stereo…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Saad Imran , Muhammad Umar Karim Khan , Sikander Bin Mukarram , Chong-Min Kyung

Event cameras are neuromorphically inspired sensors that sparsely and asynchronously report brightness changes. Their unique characteristics of high temporal resolution, high dynamic range, and low power consumption make them well-suited…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Haitao Meng , Chonghao Zhong , Sheng Tang , Lian JunJia , Wenwei Lin , Zhenshan Bing , Yi Chang , Gang Chen , Alois Knoll

We present a fully data-driven method to compute depth from diverse monocular video sequences that contain large amounts of non-rigid objects, e.g., people. In order to learn reconstruction cues for non-rigid scenes, we introduce a new…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Chaoyang Wang , Simon Lucey , Federico Perazzi , Oliver Wang

Recent co-part segmentation methods mostly operate in a supervised learning setting, which requires a large amount of annotated data for training. To overcome this limitation, we propose a self-supervised deep learning method for co-part…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Aliaksandr Siarohin , Subhankar Roy , Stéphane Lathuilière , Sergey Tulyakov , Elisa Ricci , Nicu Sebe

Self-supervised monocular depth estimation holds significant importance in the fields of autonomous driving and robotics. However, existing methods are typically trained and tested on standard datasets, overlooking the impact of various…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Ziyang Song , Ruijie Zhu , Chuxin Wang , Jiacheng Deng , Jianfeng He , Tianzhu Zhang

This paper presents a semi-supervised learning framework for a customized semantic segmentation task using multiview image streams. A key challenge of the customized task lies in the limited accessibility of the labeled data due to the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Yuan Yao , Hyun Soo Park

Metric depth prediction from monocular videos suffers from bad generalization between datasets and requires supervised depth data for scale-correct training. Self-supervised training using multi-view reconstruction can benefit from large…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Xiaohu Liu , Sascha Hornauer , Fabien Moutarde , Jialiang Lu

Self-supervised monocular depth estimation has emerged as a promising approach since it does not rely on labeled training data. Most methods combine convolution and Transformer to model long-distance dependencies to estimate depth…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Xuezhi Xiang , Yao Wang , Lei Zhang , Denis Ombati , Himaloy Himu , Xiantong Zhen

In recent years, unsupervised deep learning approaches have received significant attention to estimate the depth and visual odometry (VO) from unlabelled monocular image sequences. However, their performance is limited in challenging…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Yasin Almalioglu , Angel Santamaria-Navarro , Benjamin Morrell , Ali-akbar Agha-mohammadi

We present an end-to-end joint training framework that explicitly models 6-DoF motion of multiple dynamic objects, ego-motion and depth in a monocular camera setup without supervision. Our technical contributions are three-fold. First, we…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Seokju Lee , Sunghoon Im , Stephen Lin , In So Kweon

Conventional self-supervised monocular depth prediction methods are based on a static environment assumption, which leads to accuracy degradation in dynamic scenes due to the mismatch and occlusion problems introduced by object motions.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Ziyue Feng , Liang Yang , Longlong Jing , Haiyan Wang , YingLi Tian , Bing Li

Self-supervised monocular depth estimation aims to infer depth information without relying on labeled data. However, the lack of labeled information poses a significant challenge to the model's representation, limiting its ability to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Guodong Sun , Junjie Liu , Mingxuan Liu , Moyun Liu , Yang Zhang