English
Related papers

Related papers: Radar Camera Fusion via Representation Learning in…

200 papers

The performance of perception systems developed for autonomous driving vehicles has seen significant improvements over the last few years. This improvement was associated with the increasing use of LiDAR sensors and point cloud data to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yahia Dalbah , Jean Lahoud , Hisham Cholakkal

To accurately estimate locations and velocities of surrounding targets (cars) is crucial for advanced driver assistance systems based on radar sensors. In this paper we derive methods for fusing data from multiple radar sensors in order to…

Signal Processing · Electrical Eng. & Systems 2019-08-08 Bin Zhu , Augusto Ferrante , Johan Karlsson , Mattia Zorzi

Due to the trending need of building autonomous robotic perception system, sensor fusion has attracted a lot of attention amongst researchers and engineers to make best use of cross-modality information. However, in order to build a robotic…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Apoorv Singh

The perception of autonomous vehicles using radars has attracted increased research interest due its ability to operate in fog and bad weather. However, training radar models is hindered by the cost and difficulty of annotating large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yiduo Hao , Sohrab Madani , Junfeng Guan , Mohammed Alloulah , Saurabh Gupta , Haitham Hassanieh

4D automotive radar is indispensable for autonomous driving due to its low cost and robustness, yet its point cloud sparsity challenges 3D object detection. Existing 4D radar-camera fusion methods focus on complex fusion strategies, trading…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Weiyi Xiong , Bing Zhu

Accurate 3D object detection is critical for autonomous driving, necessitating reliable, cost-effective sensors capable of operating in adverse weather conditions. Camera and millimeter-wave radar fusion has emerged as a promising solution;…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Bingyi Liu , Chuanhui Zhu , Hongfei Xue , Jian Teng , Jipeng Liu , Enshu Wang , Penglin Dai , Pu Wang

Cooperative perception enables vehicles to share sensor readings and has become a new paradigm to improve driving safety, where the key enabling technology for realizing this vision is to real-time and accurately align and fuse the…

Robotics · Computer Science 2025-06-03 Zhiqing Luo , Yi Wang , Yingying He , Wei Wang

End-to-end autonomous driving systems promise stronger performance through unified optimization of perception, motion forecasting, and planning. However, vision-based approaches face fundamental limitations in adverse weather conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Philipp Wolters , Johannes Gilg , Torben Teepe , Gerhard Rigoll

In this work, we present an uncertainty-based method for sensor fusion with camera and radar data. The outputs of two neural networks, one processing camera and the other one radar data, are combined in an uncertainty aware manner. To this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Kamil Kowol , Matthias Rottmann , Stefan Bracke , Hanno Gottschalk

Autonomous robots that assist humans in day to day living tasks are becoming increasingly popular. Autonomous mobile robots operate by sensing and perceiving their surrounding environment to make accurate driving decisions. A combination of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Varuna De Silva , Jamie Roche , Ahmet Kondoz

Sensor fusion is crucial for a performant and robust Perception system in autonomous vehicles, but sensor staleness, where data from different sensors arrives with varying delays, poses significant challenges. Temporal misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Meng Fan , Yifan Zuo , Patrick Blaes , Harley Montgomery , Subhasis Das

Autonomous vehicles are conceived to provide safe and secure services by validating the safety standards as indicated by SOTIF-ISO/PAS-21448 (Safety of the intended functionality). Keeping in this context, the perception of the environment…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Shoaib Azam , Farzeen Munir , Moongu Jeon

Autonomous systems require a continuous and dependable environment perception for navigation and decision-making, which is best achieved by combining different sensor types. Radar continues to function robustly in compromised circumstances…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Carsten Ditzel , Klaus Dietmayer

Cooperative perception plays a vital role in extending a vehicle's sensing range beyond its line-of-sight. However, exchanging raw sensory data under limited communication resources is infeasible. Towards enabling an efficient cooperative…

Machine Learning · Computer Science 2021-11-19 Mohamed K. Abdel-Aziz , Cristina Perfecto , Sumudu Samarakoon , Mehdi Bennis , Walid Saad

In automotive systems, a radar is a key component of autonomous driving. Using transmit and reflected radar signal by a target, we can capture the target range and velocity. However, when interference signals exist, noise floor increases…

Signal Processing · Electrical Eng. & Systems 2019-11-13 Jiwoo Mun , Heasung Kim , Jungwoo Lee

We propose DeepFusion, a modular multi-modal architecture to fuse lidars, cameras and radars in different combinations for 3D object detection. Specialized feature extractors take advantage of each modality and can be exchanged easily,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Florian Drews , Di Feng , Florian Faion , Lars Rosenbaum , Michael Ulrich , Claudius Gläser

Our study assesses the adversarial robustness of LiDAR-camera fusion models in 3D object detection. We introduce an attack technique that, by simply adding a limited number of physically constrained adversarial points above a car, can make…

Robotics · Computer Science 2024-01-10 Bo Yang , Xiaoyu Ji , Zizhi Jin , Yushi Cheng , Wenyuan Xu

Cameras and LiDARs are both important sensors for autonomous driving, playing critical roles in 3D object detection. Camera-LiDAR Fusion has been a prevalent solution for robust and accurate driving perception. In contrast to the vast…

Robotics · Computer Science 2024-03-05 Ye Li , Hanjiang Hu , Zuxin Liu , Xiaohao Xu , Xiaonan Huang , Ding Zhao

"This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible." Driver's interaction with a vehicle via automatic gesture recognition is…

Signal Processing · Electrical Eng. & Systems 2024-11-26 Netanel Blumenfeld , Inna Stainvas , Igal Bilik

An autonomous system's perception engine must provide an accurate understanding of the environment for it to make decisions. Deep learning based object detection networks experience degradation in the performance and robustness for small…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Hemant Kumawat , Saibal Mukhopadhyay