English
Related papers

Related papers: Multimodal 3D Object Detection on Unseen Domains

200 papers

The fusion of multimodal sensor streams, such as camera, lidar, and radar measurements, plays a critical role in object detection for autonomous vehicles, which base their decision making on these inputs. While existing methods exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Mario Bijelic , Tobias Gruber , Fahim Mannan , Florian Kraus , Werner Ritter , Klaus Dietmayer , Felix Heide

Accurate 3D object detection is vital for automated driving. While lidar sensors are well suited for this task, they are expensive and have limitations in adverse weather conditions. 3+1D imaging radar sensors offer a cost-effective, robust…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Patrick Palmer , Martin Krüger , Stefan Schütte , Richard Altendorfer , Ganesh Adam , Torsten Bertram

LiDAR-based 3D detection has made great progress in recent years. However, the performance of 3D detectors is considerably limited when deployed in unseen environments, owing to the severe domain gap problem. Existing domain adaptive 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Ziyu Li , Jingming Guo , Tongtong Cao , Liu Bingbing , Wankou Yang

3D Object Detectors (3D-OD) are crucial for understanding the environment in many robotic tasks, especially autonomous driving. Including 3D information via Lidar sensors improves accuracy greatly. However, such detectors perform poorly on…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 George Eskandar , Chongzhe Zhang , Abhishek Kaushik , Karim Guirguis , Mohamed Sayed , Bin Yang

3D object detection is a critical task in autonomous driving. Recently multi-modal fusion-based 3D object detection methods, which combine the complementary advantages of LiDAR and camera, have shown great performance improvements over…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Hao Liu , Zhuoran Xu , Dan Wang , Baofeng Zhang , Guan Wang , Bo Dong , Xin Wen , Xinyu Xu

Lidar has become an essential sensor for autonomous driving as it provides reliable depth estimation. Lidar is also the primary sensor used in building 3D maps which can be used even in the case of low-cost systems which do not use Lidar.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-08 B Ravi Kiran , Luis Roldão , Benat Irastorza , Renzo Verastegui , Sebastian Suss , Senthil Yogamani , Victor Talpaert , Alexandre Lepoutre , Guillaume Trehard

In this paper, we focus on exploring the fusion of images and point clouds for 3D object detection in view of the complementary nature of the two modalities, i.e., images possess more semantic information while point clouds specialize in…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Ming Zhu , Chao Ma , Pan Ji , Xiaokang Yang

Point cloud segmentation is a fundamental task in 3D scene understanding. Its progress is constrained by the high cost and time required for dense 3D annotations, making labeled samples difficult to obtain. Beyond annotation scarcity,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Thenukan Pathmanathan , Kanchan Keisham , Thangarajah Akilan

Fully autonomous driving systems require fast detection and recognition of sensitive objects in the environment. In this context, intelligent vehicles should share their sensor data with computing platforms and/or other vehicles, to detect…

Networking and Internet Architecture · Computer Science 2021-04-27 Valentina Rossi , Paolo Testolina , Marco Giordani , Michele Zorzi

Multi-sensor fusion using LiDAR and RGB cameras significantly enhances 3D object detection task. However, conventional LiDAR sensors perform dense, stateless scans, ignoring the strong temporal continuity in real-world scenes. This leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Sara Shoouri , Morteza Tavakoli Taba , Hun-Seok Kim

Detecting dynamic objects and predicting static road information such as drivable areas and ground heights are crucial for safe autonomous driving. Previous works studied each perception task separately, and lacked a collective quantitative…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Di Feng , Yiyang Zhou , Chenfeng Xu , Masayoshi Tomizuka , Wei Zhan

Modern self-driving perception systems have been shown to improve upon processing complementary inputs such as LiDAR with images. In isolation, 2D images have been found to be extremely vulnerable to adversarial attacks. Yet, there have…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 James Tu , Huichen Li , Xinchen Yan , Mengye Ren , Yun Chen , Ming Liang , Eilyan Bitar , Ersin Yumer , Raquel Urtasun

This paper presents a new approach to 3D object detection that leverages the properties of the data obtained by a LiDAR sensor. State-of-the-art detectors use neural network architectures based on assumptions valid for camera images.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Guus Engels , Nerea Aranjuelo , Ignacio Arganda-Carreras , Marcos Nieto , Oihana Otaegui

With the rapid proliferation of autonomous driving, there has been a heightened focus on the research of lidar-based 3D semantic segmentation and object detection methodologies, aiming to ensure the safety of traffic participants. In recent…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Jiahua Xu , Si Zuo , Chenfeng Wei , Wei Zhou

3D object detection using LiDAR data is an indispensable component for autonomous driving systems. Yet, only a few LiDAR-based 3D object detection methods leverage segmentation information to further guide the detection process. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Hamidreza Fazlali , Yixuan Xu , Yuan Ren , Bingbing Liu

3D object detection is a central task for applications such as autonomous driving, in which the system needs to localize and classify surrounding traffic agents, even in the presence of adverse weather. In this paper, we address the problem…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Martin Hahner , Christos Sakaridis , Mario Bijelic , Felix Heide , Fisher Yu , Dengxin Dai , Luc Van Gool

State-of-the-art lidar-based 3D object detection methods rely on supervised learning and large labeled datasets. However, annotating lidar data is resource-consuming, and depending only on supervised learning limits the applicability of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Ekim Yurtsever , Emeç Erçelik , Mingyu Liu , Zhijie Yang , Hanzhen Zhang , Pınar Topçam , Maximilian Listl , Yılmaz Kaan Çaylı , Alois Knoll

Multi-modal 3D object detection models for automated driving have demonstrated exceptional performance on computer vision benchmarks like nuScenes. However, their reliance on densely sampled LiDAR point clouds and meticulously calibrated…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Till Beemelmanns , Quan Zhang , Christian Geller , Lutz Eckstein

The rapid evolution of deep learning and its integration with autonomous driving systems have led to substantial advancements in 3D perception using multimodal sensors. Notably, radar sensors show greater robustness compared to cameras and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Miao Zhang , Sherif Abdulatif , Benedikt Loesch , Marco Altmann , Marius Schwarz , Bin Yang

Detecting objects in 3D space using multiple cameras, known as Multi-Camera 3D Object Detection (MC3D-Det), has gained prominence with the advent of bird's-eye view (BEV) approaches. However, these methods often struggle when faced with…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Hao Lu , Yunpeng Zhang , Qing Lian , Dalong Du , Yingcong Chen