English
Related papers

Related papers: Self-supervised Depth Estimation Leveraging Global…

200 papers

Inferring the depth of images is a fundamental inverse problem within the field of Computer Vision since depth information is obtained through 2D images, which can be generated from infinite possibilities of observed real scenes. Benefiting…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Raul de Queiroz Mendes , Eduardo Godinho Ribeiro , Nicolas dos Santos Rosa , Valdir Grassi

Estimating depth from a single RGB images is a fundamental task in computer vision, which is most directly solved using supervised deep learning. In the field of unsupervised learning of depth from a single RGB image, depth is not given…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Shir Gur , Lior Wolf

Monocular depth estimation is known as an ill-posed task in which objects in a 2D image usually do not contain sufficient information to predict their depth. Thus, it acts differently from other tasks (e.g., classification and segmentation)…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Wencheng Han , Junbo Yin , Jianbing Shen

Previous methods on estimating detailed human depth often require supervised training with `ground truth' depth data. This paper presents a self-supervised method that can be trained on YouTube videos without known depth, which makes…

Computer Vision and Pattern Recognition · Computer Science 2020-05-08 Feitong Tan , Hao Zhu , Zhaopeng Cui , Siyu Zhu , Marc Pollefeys , Ping Tan

In this paper, we propose an end-to-end deep learning network named 3dDepthNet, which produces an accurate dense depth image from a single pair of sparse LiDAR depth and color image for robotics and autonomous driving tasks. Based on the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Rui Xiang , Feng Zheng , Huapeng Su , Zhe Zhang

Monocular depth estimation using Convolutional Neural Networks (CNNs) has shown impressive performance in outdoor driving scenes. However, self-supervised learning of indoor depth from monocular sequences is quite challenging for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Chao Fan , Zhenyu Yin , Yue Li , Feiqing Zhang

Most existing instance segmentation methods only focus on improving performance and are not suitable for real-time scenes such as autonomous driving. This paper proposes a real-time framework that segmenting and detecting 3D objects by…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Shengjie Li , Caiyi Xu , Jianping Xing , Yafei Ning , Yonghong Chen

Depth completion aims at inferring a dense depth image from sparse depth measurement since glossy, transparent or distant surface cannot be scanned properly by the sensor. Most of existing methods directly interpolate the missing depth…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Zhongzhen Luo , Fengjia Zhang , Guoyi Fu , Jiajie Xu

A 360{\deg} perception of scene geometry is essential for automated driving, notably for parking and urban driving scenarios. Typically, it is achieved using surround-view fisheye cameras, focusing on the near-field area around the vehicle.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Varun Ravi Kumar , Marvin Klingner , Senthil Yogamani , Markus Bach , Stefan Milz , Tim Fingscheidt , Patrick Mäder

This paper focuses on self-supervised monocular depth estimation in dynamic scenes trained on monocular videos. Existing methods jointly estimate pixel-wise depth and motion, relying mainly on an image reconstruction loss. Dynamic regions1…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Hoang Chuong Nguyen , Tianyu Wang , Jose M. Alvarez , Miaomiao Liu

Multi-frame depth estimation improves over single-frame approaches by also leveraging geometric relationships between images via feature matching, in addition to learning appearance-based features. In this paper we revisit feature matching…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Vitor Guizilini , Rares Ambrus , Dian Chen , Sergey Zakharov , Adrien Gaidon

We present an algorithm for estimating consistent dense depth maps and camera poses from a monocular video. We integrate a learning-based depth prior, in the form of a convolutional neural network trained for single-image depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Johannes Kopf , Xuejian Rong , Jia-Bin Huang

In this paper, we propose a geometric neural network with edge-aware refinement (GeoNet++) to jointly predict both depth and surface normal maps from a single image. Building on top of two-stream CNNs, GeoNet++ captures the geometric…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Xiaojuan Qi , Zhengzhe Liu , Renjie Liao , Philip H. S. Torr , Raquel Urtasun , Jiaya Jia

Although supervised deep normal estimators have recently shown impressive results on synthetic benchmarks, their performance deteriorates significantly in real-world scenarios due to the domain gap between synthetic and real data. Building…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Jie Zhang , Minghui Nie , Changqing Zou , Jian Liu , Ligang Liu , Junjie Cao

Self-supervised monocular depth estimation (SSMDE) aims to predict the dense depth map of a monocular image, by learning depth from RGB image sequences, eliminating the need for ground-truth depth labels. Although this approach simplifies…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Wonhyeok Choi , Kyumin Hwang , Wei Peng , Minwoo Choi , Sunghoon Im

We propose DeepMapping, a novel registration framework using deep neural networks (DNNs) as auxiliary functions to align multiple point clouds from scratch to a globally consistent frame. We use DNNs to model the highly non-convex mapping…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Li Ding , Chen Feng

The success of deep neural networks generally requires a vast amount of training data to be labeled, which is expensive and unfeasible in scale, especially for video collections. To alleviate this problem, in this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Longlong Jing , Xiaodong Yang , Jingen Liu , Yingli Tian

As 360{\deg} cameras become prevalent in many autonomous systems (e.g., self-driving cars and drones), efficient 360{\deg} perception becomes more and more important. We propose a novel self-supervised learning approach for predicting the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-14 Fu-En Wang , Hou-Ning Hu , Hsien-Tzu Cheng , Juan-Ting Lin , Shang-Ta Yang , Meng-Li Shih , Hung-Kuo Chu , Min Sun

Recent techniques in self-supervised monocular depth estimation are approaching the performance of supervised methods, but operate in low resolution only. We show that high resolution is key towards high-fidelity self-supervised monocular…

Computer Vision and Pattern Recognition · Computer Science 2018-10-04 Sudeep Pillai , Rares Ambrus , Adrien Gaidon

Self-supervised depth estimation has made a great success in learning depth from unlabeled image sequences. While the mappings between image and pixel-wise depth are well-studied in current methods, the correlation between image, depth and…

Computer Vision and Pattern Recognition · Computer Science 2021-02-15 Rui Li , Xiantuo He , Danna Xue , Shaolin Su , Qing Mao , Yu Zhu , Jinqiu Sun , Yanning Zhang