English
Related papers

Related papers: Collaboration Helps Camera Overtake LiDAR in 3D De…

200 papers

In the realm of modern autonomous driving, the perception system is indispensable for accurately assessing the state of the surrounding environment, thereby enabling informed prediction and planning. The key step to this system is related…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Ziying Song , Lin Liu , Feiyang Jia , Yadan Luo , Guoxin Zhang , Lei Yang , Li Wang , Caiyan Jia

Monocular 3D object detection is an essential component in autonomous driving while challenging to solve, especially for those occluded samples which are only partially visible. Most detectors consider each 3D object as an independent…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Yongjian Chen , Lei Tai , Kai Sun , Mingyang Li

A key contributor to recent progress in 3D detection from single images is monocular depth estimation. Existing methods focus on how to leverage depth explicitly, by generating pseudo-pointclouds or providing attention cues for image…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Dennis Park , Jie Li , Dian Chen , Vitor Guizilini , Adrien Gaidon

With the advancement of collaborative perception, the role of aerial-ground collaborative perception, a crucial component, is becoming increasingly important. The demand for collaborative perception across different perspectives to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Yuchao Wang , Peirui Cheng , Pengju Tian , Ziyang Yuan , Liangjin Zhao , Jing Tian , Wensheng Wang , Zhirui Wang , Xian Sun

3D multi-object tracking (MOT) is essential for an autonomous mobile agent to safely navigate a scene. In order to maximize the perception capabilities of the autonomous agent, we aim to develop a 3D MOT framework that fuses camera and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Tara Sadjadpour , Rares Ambrus , Jeannette Bohg

Vision-based bird's-eye-view (BEV) 3D object detection has advanced significantly in autonomous driving by offering cost-effectiveness and rich contextual information. However, existing methods often construct BEV representations by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jicheng Yuan , Manh Nguyen Duc , Qian Liu , Manfred Hauswirth , Danh Le Phuoc

In the field of autonomous driving, 3D object detection is a very important perception module. Although the current SOTA algorithm combines Camera and Lidar sensors, limited by the high price of Lidar, the current mainstream landing schemes…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Kai Lei , Zhan Chen , Shuman Jia , Xiaoteng Zhang

Stereo-based 3D detection aims at detecting 3D object bounding boxes from stereo images using intermediate depth maps or implicit 3D geometry representations, which provides a low-cost solution for 3D perception. However, its performance is…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Xiaoyang Guo , Shaoshuai Shi , Xiaogang Wang , Hongsheng Li

Most real-world 3D sensors such as LiDARs perform fixed scans of the entire environment, while being decoupled from the recognition system that processes the sensor data. In this work, we propose a method for 3D object recognition using…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Siddharth Ancha , Yaadhav Raaj , Peiyun Hu , Srinivasa G. Narasimhan , David Held

Low-cost, vision-centric 3D perception systems for autonomous driving have made significant progress in recent years, narrowing the gap to expensive LiDAR-based methods. The primary challenge in becoming a fully reliable alternative lies in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Philipp Wolters , Johannes Gilg , Torben Teepe , Fabian Herzog , Anouar Laouichi , Martin Hofmann , Gerhard Rigoll

Multimodal sensor fusion methods for 3D object detection have been revolutionizing the autonomous driving research field. Nevertheless, most of these methods heavily rely on dense LiDAR data and accurately calibrated sensors which is often…

Robotics · Computer Science 2023-06-14 Maciej K. Wozniak , Viktor Karefjards , Marko Thiel , Patric Jensfelt

Monocular 3D scene understanding tasks, such as object size estimation, heading angle estimation and 3D localization, is challenging. Successful modern day methods for 3D scene understanding require the use of a 3D sensor. On the other…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Xinshuo Weng , Kris Kitani

Monocular 3D detection (M3D) aims for precise 3D object localization from a single-view image which usually involves labor-intensive annotation of 3D detection boxes. Weakly supervised M3D has recently been studied to obviate the 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Xueying Jiang , Sheng Jin , Lewei Lu , Xiaoqin Zhang , Shijian Lu

Collaborative perception empowers each agent to improve its perceptual ability through the exchange of perceptual messages with other agents. It inherently results in a fundamental trade-off between perception ability and communication…

Information Theory · Computer Science 2024-05-09 Yue Hu , Juntong Peng , Sifei Liu , Junhao Ge , Si Liu , Siheng Chen

Combining LiDAR and Camera-view data has become a common approach for 3D Object Detection. However, previous approaches combine the two input streams at a point-level, throwing away semantic information derived from camera features. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Pranav Gupta , Rishabh Rengarajan , Viren Bankapur , Vedansh Mannem , Lakshit Ahuja , Surya Vijay , Kevin Wang

Recent camera-based 3D object detection is limited by the precision of transforming from image to 3D feature spaces, as well as the accuracy of object localization within the 3D space. This paper aims to address such a fundamental problem…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Chaoqun Wang , Yiran Qin , Zijian Kang , Ningning Ma , Ruimao Zhang

Detecting and localizing glass in 3D environments poses significant challenges for visual perception systems, as the optical properties of glass often hinder conventional sensors from accurately distinguishing glass surfaces. The lack of…

Robotics · Computer Science 2025-09-09 Kai Zhang , Guoyang Zhao , Jianxing Shi , Bonan Liu , Weiqing Qi , Jun Ma

Roadside camera-driven 3D object detection is a crucial task in intelligent transportation systems, which extends the perception range beyond the limitations of vision-centric vehicles and enhances road safety. While previous studies have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Hao Shi , Chengshan Pang , Jiaming Zhang , Kailun Yang , Yuhao Wu , Huajian Ni , Yining Lin , Rainer Stiefelhagen , Kaiwei Wang

While expensive LiDAR and stereo camera rigs have enabled the development of successful 3D object detection methods, monocular RGB-only approaches lag much behind. This work advances the state of the art by introducing MoVi-3D, a novel,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Andrea Simonelli , Samuel Rota Bulò , Lorenzo Porzi , Elisa Ricci , Peter Kontschieder

Unsupervised contrastive learning for indoor-scene point clouds has achieved great successes. However, unsupervised learning point clouds in outdoor scenes remains challenging because previous methods need to reconstruct the whole scene and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Runjian Chen , Yao Mu , Runsen Xu , Wenqi Shao , Chenhan Jiang , Hang Xu , Zhenguo Li , Ping Luo