English
Related papers

Related papers: Radar-Camera Sensor Fusion for Joint Object Detect…

200 papers

LiDAR has become a standard sensor for autonomous driving applications as they provide highly precise 3D point clouds. LiDAR is also robust for low-light scenarios at night-time or due to shadows where the performance of cameras is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Khaled El Madawy , Hazem Rashed , Ahmad El Sallab , Omar Nasr , Hanan Kamel , Senthil Yogamani

Autonomous vehicles are conceived to provide safe and secure services by validating the safety standards as indicated by SOTIF-ISO/PAS-21448 (Safety of the intended functionality). Keeping in this context, the perception of the environment…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Shoaib Azam , Farzeen Munir , Moongu Jeon

Multimodal sensor fusion is an essential capability for autonomous robots, enabling object detection and decision-making in the presence of failing or uncertain inputs. While recent fusion methods excel in normal environmental conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Edoardo Palladin , Roland Dietze , Praveen Narayanan , Mario Bijelic , Felix Heide

Autonomous vehicles face major perception and navigation challenges in adverse weather such as rain, fog, and snow, which degrade the performance of LiDAR, RADAR, and RGB camera sensors. While each sensor type offers unique strengths, such…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Nour Alhuda Albashir , Lars Pernickel , Danial Hamoud , Idriss Gouigah , Eren Erdal Aksoy

Advances in autonomous driving are inseparable from sensor fusion. Heterogeneous sensors are widely used for sensor fusion due to their complementary properties, with radar and camera being the most equipped sensors. Intrinsic and extrinsic…

Robotics · Computer Science 2023-07-31 Lei Cheng , Arindam Sengupta , Siyang Cao

LiDAR and cameras are complementary sensors for 3D object detection in autonomous driving. However, it is challenging to explore the unnatural interaction between point clouds and images, and the critical factor is how to conduct feature…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Ziying Song , Haiyue Wei , Lin Bai , Lei Yang , Caiyan Jia

Depth estimation plays a pivotal role in autonomous driving, facilitating a comprehensive understanding of the vehicle's 3D surroundings. Radar, with its robustness to adverse weather conditions and capability to measure distances, has…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Huawei Sun , Zixu Wang , Hao Feng , Julius Ott , Lorenzo Servadei , Robert Wille

Camera and LiDAR serve as informative sensors for accurate and robust autonomous driving systems. However, these sensors often exhibit heterogeneous natures, resulting in distributional modality gaps that present significant challenges for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yiran Yang , Xu Gao , Tong Wang , Xin Hao , Yifeng Shi , Xiao Tan , Xiaoqing Ye , Jingdong Wang

In LiDAR-based 3D detection, history point clouds contain rich temporal information helpful for future prediction. In the same way, history detections should contribute to future detections. In this paper, we propose a detection enhancement…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Xirui Li , Feng Wang , Naiyan Wang , Chao Ma

Localizing objects and estimating their extent in 3D is an important step towards high-level 3D scene understanding, which has many applications in Augmented Reality and Robotics. We present ODAM, a system for 3D Object Detection,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Kejie Li , Daniel DeTone , Steven Chen , Minh Vo , Ian Reid , Hamid Rezatofighi , Chris Sweeney , Julian Straub , Richard Newcombe

We tackle the problem of exploiting Radar for perception in the context of self-driving as Radar provides complementary information to other sensors such as LiDAR or cameras in the form of Doppler velocity. The main challenges of using…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Bin Yang , Runsheng Guo , Ming Liang , Sergio Casas , Raquel Urtasun

Object detection is essential to safe autonomous or assisted driving. Previous works usually utilize RGB images or LiDAR point clouds to identify and localize multiple objects in self-driving. However, cameras tend to fail in bad driving…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Zangwei Zheng , Xiangyu Yue , Kurt Keutzer , Alberto Sangiovanni Vincentelli

We propose a 3D object detection method for autonomous driving by fully exploiting the sparse and dense, semantic and geometry information in stereo imagery. Our method, called Stereo R-CNN, extends Faster R-CNN for stereo inputs to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Peiliang Li , Xiaozhi Chen , Shaojie Shen

In autonomous driving, LiDAR and radar are crucial for environmental perception. LiDAR offers precise 3D spatial sensing information but struggles in adverse weather like fog. Conversely, radar signals can penetrate rain or mist due to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yanlong Yang , Jianan Liu , Tao Huang , Qing-Long Han , Gang Ma , Bing Zhu

Accurate 3D object detection in autonomous driving is critical yet challenging due to occlusions, varying object sizes, and complex urban environments. This paper introduces the KAN-RCBEVDepth method, an innovative approach aimed at…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Zhihao Lai , Chuanhao Liu , Shihui Sheng , Zhiqiang Zhang

Multi-sensor fusion has significant potential in perception tasks for both indoor and outdoor environments. Especially under challenging conditions such as adverse weather and low-light environments, the combined use of millimeter-wave…

Image and Video Processing · Electrical Eng. & Systems 2025-05-23 Tieshuai Song , Jiandong Ye , Ao Guo , Guidong He , Bin Yang

Cameras and 2D laser scanners, in combination, are able to provide low-cost, light-weight and accurate solutions, which make their fusion well-suited for many robot navigation tasks. However, correct data fusion depends on precise…

Robotics · Computer Science 2019-08-02 Michelle Valente , Cyril Joly , Arnaud de La Fortelle

An efficient and accurate traffic monitoring system often takes advantages of multi-sensor detection to ensure the safety of urban traffic, promoting the accuracy and robustness of target detection and tracking. A method for target…

Image and Video Processing · Electrical Eng. & Systems 2024-03-26 Ming Zong , Jiaying Wu , Zhanyu Zhu , Jingen Ni

4D millimeter-wave radar is a promising sensing modality for autonomous driving, yet effective 3D object detection from 4D radar and monocular images remains challenging. Existing fusion approaches either rely on instance proposals lacking…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xiaokai Bai , Chenxu Zhou , Lianqing Zheng , Si-Yuan Cao , Jianan Liu , Xiaohan Zhang , Yiming Li , Zhengzhuang Zhang , Hui-liang Shen

The combination of data from multiple sensors, also known as sensor fusion or data fusion, is a key aspect in the design of autonomous robots. In particular, algorithms able to accommodate sensor fusion techniques enable increased accuracy,…

Robotics · Computer Science 2021-03-26 Li Qingqing , Jorge Peña Queralta , Tuan Nguyen Gia , Zhuo Zou , Tomi Westerlund