English
Related papers

Related papers: Monocular Differentiable Rendering for Self-Superv…

200 papers

Monocular multi-object detection and localization in 3D space has been proven to be a challenging task. The MoNet3D algorithm is a novel and effective framework that can predict the 3D position of each object in a monocular image and draw a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Xichuan Zhou , Yicong Peng , Chunqiao Long , Fengbo Ren , Cong Shi

In this paper, we propose a monocular 3D object detection framework in the domain of autonomous driving. Unlike previous image-based methods which focus on RGB feature extracted from 2D images, our method solves this problem in the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Xinzhu Ma , Zhihui Wang , Haojie Li , Pengbo Zhang , Xin Fan , Wanli Ouyang

Self-supervised monocular depth estimation has emerged as a promising approach since it does not rely on labeled training data. Most methods combine convolution and Transformer to model long-distance dependencies to estimate depth…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Xuezhi Xiang , Yao Wang , Lei Zhang , Denis Ombati , Himaloy Himu , Xiantong Zhen

Self-supervised learning for monocular depth estimation is widely investigated as an alternative to supervised learning approach, that requires a lot of ground truths. Previous works have successfully improved the accuracy of depth…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Noriaki Hirose , Shun Taguchi , Keisuke Kawano , Satoshi Koide

3D object detection is vital as it would enable us to capture objects' sizes, orientation, and position in the world. As a result, we would be able to use this 3D detection in real-world applications such as Augmented Reality (AR),…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Abonia Sojasingarayar , Ashish Patel

Depth estimation and 3D object detection are critical for scene understanding but remain challenging to perform with a single image due to the loss of 3D information during image capture. Recent models using deep neural networks have…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Julie Chang , Gordon Wetzstein

Although cameras are ubiquitous, robotic platforms typically rely on active sensors like LiDAR for direct 3D perception. In this work, we propose a novel self-supervised monocular depth estimation method combining geometry with a new deep…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Vitor Guizilini , Rares Ambrus , Sudeep Pillai , Allan Raventos , Adrien Gaidon

Perceiving the physical world in 3D is fundamental for self-driving applications. Although temporal motion is an invaluable resource to human vision for detection, tracking, and depth perception, such features have not been thoroughly…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Garrick Brazil , Gerard Pons-Moll , Xiaoming Liu , Bernt Schiele

Monocular 3D object detection is an essential component in autonomous driving while challenging to solve, especially for those occluded samples which are only partially visible. Most detectors consider each 3D object as an independent…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Yongjian Chen , Lei Tai , Kai Sun , Mingyang Li

Estimating accurate 3D locations of objects from monocular images is a challenging problem because of lacking depth. Previous work shows that utilizing the object's keypoint projection constraints to estimate multiple depth candidates…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Yingyan Li , Yuntao Chen , Jiawei He , Zhaoxiang Zhang

While expensive LiDAR and stereo camera rigs have enabled the development of successful 3D object detection methods, monocular RGB-only approaches lag much behind. This work advances the state of the art by introducing MoVi-3D, a novel,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Andrea Simonelli , Samuel Rota Bulò , Lorenzo Porzi , Elisa Ricci , Peter Kontschieder

Monocular 3D scene understanding tasks, such as object size estimation, heading angle estimation and 3D localization, is challenging. Successful modern day methods for 3D scene understanding require the use of a 3D sensor. On the other…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Xinshuo Weng , Kris Kitani

3D object detection is a fundamental and challenging task for 3D scene understanding, and the monocular-based methods can serve as an economical alternative to the stereo-based or LiDAR-based methods. However, accurately detecting objects…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Zhiyu Chong , Xinzhu Ma , Hong Zhang , Yuxin Yue , Haojie Li , Zhihui Wang , Wanli Ouyang

Monocular 3D detection has drawn much attention from the community due to its low cost and setup simplicity. It takes an RGB image as input and predicts 3D boxes in the 3D space. The most challenging sub-task lies in the instance depth…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Liang Peng , Xiaopei Wu , Zheng Yang , Haifeng Liu , Deng Cai

Object localization in 3D space is a challenging aspect in monocular 3D object detection. Recent advances in 6DoF pose estimation have shown that predicting dense 2D-3D correspondence maps between image and object 3D model and then…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Hansheng Chen , Yuyao Huang , Wei Tian , Zhong Gao , Lu Xiong

Per-pixel ground-truth depth data is challenging to acquire at scale. To overcome this limitation, self-supervised learning has emerged as a promising alternative for training models to perform monocular depth estimation. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Clément Godard , Oisin Mac Aodha , Michael Firman , Gabriel Brostow

Monocular 3D object detection aims to detect objects in a 3D physical world from a single camera. However, recent approaches either rely on expensive LiDAR devices, or resort to dense pixel-wise depth estimation that causes prohibitive…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Wentao Bao , Qi Yu , Yu Kong

Monocular 3D object detection continues to attract attention due to the cost benefits and wider availability of RGB cameras. Despite the recent advances and the ability to acquire data at scale, annotation cost and complexity still limit…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Issa Mouawad , Nikolas Brasch , Fabian Manhardt , Federico Tombari , Francesca Odone

Monocular image-based 3D perception has become an active research area in recent years owing to its applications in autonomous driving. Approaches to monocular 3D perception including detection and tracking, however, often yield inferior…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Longlong Jing , Ruichi Yu , Henrik Kretzschmar , Kang Li , Charles R. Qi , Hang Zhao , Alper Ayvaci , Xu Chen , Dillon Cower , Yingwei Li , Yurong You , Han Deng , Congcong Li , Dragomir Anguelov

Detecting and localizing objects in the real 3D space, which plays a crucial role in scene understanding, is particularly challenging given only a monocular image due to the geometric information loss during imagery projection. We propose…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Zengyi Qin , Jinglu Wang , Yan Lu