English
Related papers

Related papers: Self-supervised 3D Object Detection from Monocular…

200 papers

Monocular 3D object detection plays a crucial role in autonomous driving. However, existing monocular 3D detection algorithms depend on 3D labels derived from LiDAR measurements, which are costly to acquire for new datasets and challenging…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Fulong Ma , Xiaoyang Yan , Guoyang Zhao , Xiaojie Xu , Yuxuan Liu , Jun Ma , Ming Liu

Accurate 3D object detection is crucial to autonomous driving. Though LiDAR-based detectors have achieved impressive performance, the high cost of LiDAR sensors precludes their widespread adoption in affordable vehicles. Camera-based…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Yurong You , Cheng Perng Phoo , Carlos Andres Diaz-Ruiz , Katie Z Luo , Wei-Lun Chao , Mark Campbell , Bharath Hariharan , Kilian Q Weinberger

We present MonoPSR, a monocular 3D object detection method that leverages proposals and shape reconstruction. First, using the fundamental relations of a pinhole camera model, detections from a mature 2D object detector are used to generate…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Jason Ku , Alex D. Pon , Steven L. Waslander

Estimating accurate 3D locations of objects from monocular images is a challenging problem because of lacking depth. Previous work shows that utilizing the object's keypoint projection constraints to estimate multiple depth candidates…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Yingyan Li , Yuntao Chen , Jiawei He , Zhaoxiang Zhang

One of the key problems in 3D object detection is to reduce the accuracy gap between methods based on LiDAR sensors and those based on monocular cameras. A recently proposed framework for monocular 3D detection based on Pseudo-Stereo has…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Yuguang Shi

As cameras are increasingly deployed in new application domains such as autonomous driving, performing 3D object detection on monocular images becomes an important task for visual scene understanding. Recent advances on monocular 3D object…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Xiaomeng Chu , Jiajun Deng , Yao Li , Zhenxun Yuan , Yanyong Zhang , Jianmin Ji , Yu Zhang

Although considerable advancements have been attained in self-supervised depth estimation from monocular videos, most existing methods often treat all objects in a video as static entities, which however violates the dynamic nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Xiuzhe Wu , Xiaoyang Lyu , Qihao Huang , Yong Liu , Yang Wu , Ying Shan , Xiaojuan Qi

Monocular 3D object detection is a crucial and challenging task for autonomous driving vehicle, while it uses only a single camera image to infer 3D objects in the scene. To address the difficulty of predicting depth using only pictorial…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Jia-Quan Yu , Soo-Chang Pei

Monocular multi-object detection and localization in 3D space has been proven to be a challenging task. The MoNet3D algorithm is a novel and effective framework that can predict the 3D position of each object in a monocular image and draw a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Xichuan Zhou , Yicong Peng , Chunqiao Long , Fengbo Ren , Cong Shi

Recent advances in self-supervised learning havedemonstrated that it is possible to learn accurate monoculardepth reconstruction from raw video data, without using any 3Dground truth for supervision. However, in robotics…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Robert McCraith , Lukas Neumann , Andrew Zisserman , Andrea Vedaldi

The proposal of Pseudo-Lidar representation has significantly narrowed the gap between visual-based and active Lidar-based 3D object detection. However, current researches exclusively focus on pushing the accuracy improvement of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Haitao Meng , Changcai Li , Gang Chen , Alois Knoll

Localizing objects in 3D space and understanding their associated 3D properties is challenging given only monocular RGB images. The situation is compounded by the loss of depth information during perspective projection. We present Center3D,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Yunlei Tang , Sebastian Dorn , Chiragkumar Savani

Monocular depth estimation has become one of the most studied applications in computer vision, where the most accurate approaches are based on fully supervised learning models. However, the acquisition of accurate and large ground truth…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Adrian Johnston , Gustavo Carneiro

In this work, we propose a novel single-shot and keypoints-based framework for monocular 3D objects detection using only RGB images, called KM3D-Net. We design a fully convolutional model to predict object keypoints, dimension, and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Peixuan Li

We address the problem of 3D object detection from 2D monocular images in autonomous driving scenarios. We propose to lift the 2D images to 3D representations using learned neural networks and leverage existing networks working directly on…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Siddharth Srivastava , Frederic Jurie , Gaurav Sharma

Monocular 3D object detection has attracted great attention for its advantages in simplicity and cost. Due to the ill-posed 2D to 3D mapping essence from the monocular imaging process, monocular 3D object detection suffers from inaccurate…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Zequn Qin , Xi Li

Self-supervised learning for monocular depth estimation is widely investigated as an alternative to supervised learning approach, that requires a lot of ground truths. Previous works have successfully improved the accuracy of depth…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Noriaki Hirose , Shun Taguchi , Keisuke Kawano , Satoshi Koide

Monocular 3D object detection (Mono3D) in mobile settings (e.g., on a vehicle, a drone, or a robot) is an important yet challenging task. Due to the near-far disparity phenomenon of monocular vision and the ever-changing camera pose, it is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Yunsong Zhou , Quan Liu , Hongzi Zhu , Yunzhe Li , Shan Chang , Minyi Guo

Today's state-of-the-art methods for 3D object detection are based on lidar, stereo, or monocular cameras. Lidar-based methods achieve the best accuracy, but have a large footprint, high cost, and mechanically-limited angular sampling…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Frank Julca-Aguilar , Jason Taylor , Mario Bijelic , Fahim Mannan , Ethan Tseng , Felix Heide

Perceiving 3D objects from monocular inputs is crucial for robotic systems, given its economy compared to multi-sensor settings. It is notably difficult as a single image can not provide any clues for predicting absolute depth values.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Tai Wang , Jiangmiao Pang , Dahua Lin