English
Related papers

Related papers: Robust sensor fusion against on-vehicle sensor sta…

200 papers

Reliable offroad autonomy requires low-latency, high-accuracy state estimates of pose as well as velocity, which remain viable throughout environments with sub-optimal operating conditions for the utilized perception modalities. As state…

Perception systems for autonomous driving have seen significant advancements in their performance over last few years. However, these systems struggle to show robustness in extreme weather conditions because sensors like lidars and cameras,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Kshitiz Bansal , Keshav Rungta , Dinesh Bharadia

We propose a method for automated synchronization of vehicle sensors useful for the study of multi-modal driver behavior and for the design of advanced driver assistance systems. Multi-sensor decision fusion relies on synchronized data…

Robotics · Computer Science 2016-03-02 Lex Fridman , Daniel E Brown , William Angell , Irman Abdić , Bryan Reimer , Hae Young Noh

Camera and LiDAR serve as informative sensors for accurate and robust autonomous driving systems. However, these sensors often exhibit heterogeneous natures, resulting in distributional modality gaps that present significant challenges for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yiran Yang , Xu Gao , Tong Wang , Xin Hao , Yifeng Shi , Xiao Tan , Xiaoqing Ye , Jingdong Wang

Autonomous Vehicles (AVs) increasingly depend on Multi-Sensor Fusion (MSF) to combine complementary modalities such as cameras and LiDAR for robust perception. While this redundancy is intended to safeguard against single-sensor failures,…

Cryptography and Security · Computer Science 2026-04-24 Shahriar Rahman Khan , Raiful Hasan

Although autonomous vehicles (AVs) are expected to revolutionize transportation, robust perception across a wide range of driving contexts remains a significant challenge. Techniques to fuse sensor data from camera, radar, and lidar sensors…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Arnav Vaibhav Malawade , Trier Mortlock , Mohammad Abdullah Al Faruque

Autonomous racing has rapidly gained research attention. Traditionally, racing cars rely on 2D LiDAR as their primary visual system. In this work, we explore the integration of an event camera with the existing system to provide enhanced…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Zhuyun Zhou , Zongwei Wu , Florian Bolli , Rémi Boutteau , Fan Yang , Radu Timofte , Dominique Ginhac , Tobi Delbruck

We tackle the problem of exploiting Radar for perception in the context of self-driving as Radar provides complementary information to other sensors such as LiDAR or cameras in the form of Doppler velocity. The main challenges of using…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Bin Yang , Runsheng Guo , Ming Liang , Sergio Casas , Raquel Urtasun

Fusing Radar and Lidar sensor data can fully utilize their complementary advantages and provide more accurate reconstruction of the surrounding for autonomous driving systems. Surround Radar/Lidar can provide 360-degree view sampling with…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Wenjing Xie , Tao Hu , Neiwen Ling , Guoliang Xing , Chun Jason Xue , Nan Guan

The multi-modal perception methods are thriving in the autonomous driving field due to their better usage of complementary data from different sensors. Such methods depend on calibration and synchronization between sensors to get accurate…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Zhihang Song , Lihui Peng , Jianming Hu , Danya Yao , Yi Zhang

To accurately estimate locations and velocities of surrounding targets (cars) is crucial for advanced driver assistance systems based on radar sensors. In this paper we derive methods for fusing data from multiple radar sensors in order to…

Signal Processing · Electrical Eng. & Systems 2019-08-08 Bin Zhu , Augusto Ferrante , Johan Karlsson , Mattia Zorzi

In this paper, we propose a novel approach to address the problem of camera and radar sensor fusion for 3D object detection in autonomous vehicle perception systems. Our approach builds on recent advances in deep learning and leverages the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Daniel Dworak , Mateusz Komorkiewicz , Paweł Skruch , Jerzy Baranowski

Radar has stronger adaptability in adverse scenarios for autonomous driving environmental perception compared to widely adopted cameras and LiDARs. Compared with commonly used 3D radars, the latest 4D radars have precise vertical resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Xinyu Zhang , Li Wang , Jian Chen , Cheng Fang , Lei Yang , Ziying Song , Guangqi Yang , Yichen Wang , Xiaofei Zhang , Jun Li , Zhiwei Li , Qingshan Yang , Zhenlin Zhang , Shuzhi Sam Ge

Reliable detection and tracking of surrounding objects are indispensable for comprehensive motion prediction and planning of autonomous vehicles. Due to the limitations of individual sensors, the fusion of multiple sensor modalities is…

Robotics · Computer Science 2023-10-13 Phillip Karle , Felix Fent , Sebastian Huch , Florian Sauerbeck , Markus Lienkamp

A realistic view of the vehicle's surroundings is generally offered by camera sensors, which is crucial for environmental perception. Affordable radar sensors, on the other hand, are becoming invaluable due to their robustness in variable…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Kavin Chandrasekaran , Sorin Grigorescu , Gijs Dubbelman , Pavol Jancura

Sensor fusion is critical to perception systems for task domains such as autonomous driving and robotics. Recently, the Transformer integrated with CNN has demonstrated high performance in sensor fusion for various perception tasks. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Quoc-Vinh Lai-Dang , Jihui Lee , Bumgeun Park , Dongsoo Har

In recent years, multi-modal fusion has attracted a lot of research interest, both in academia, and in industry. Multimodal fusion entails the combination of information from a set of different types of sensors. Exploiting complementary…

Machine Learning · Computer Science 2020-08-27 Siddharth Roheda , Hamid Krim , Benjamin S. Riggan

Multi-modal object detection in autonomous driving has achieved great breakthroughs due to the usage of fusing complementary information from different sensors. The calibration in fusion between sensors such as LiDAR and camera was always…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Zhihang Song , Dingyi Yao , Ruibo Ming , Lihui Peng , Danya Yao , Yi Zhang

The combination of data from multiple sensors, also known as sensor fusion or data fusion, is a key aspect in the design of autonomous robots. In particular, algorithms able to accommodate sensor fusion techniques enable increased accuracy,…

Robotics · Computer Science 2021-03-26 Li Qingqing , Jorge Peña Queralta , Tuan Nguyen Gia , Zhuo Zou , Tomi Westerlund

One of the main paths towards the reduction of traffic accidents is the increase in vehicle safety through driver assistance systems or even systems with a complete level of autonomy. In these types of systems, tasks such as obstacle…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Felipe Manfio Barbosa , Fernando Santos Osório