English
Related papers

Related papers: Multi-Modal Sensor Fusion using Hybrid Attention f…

200 papers

Although multi-view 3D object detection based on the Bird's-Eye-View (BEV) paradigm has garnered widespread attention as an economical and deployment-friendly perception solution for autonomous driving, there is still a performance gap…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Zheng Jiang , Jinqing Zhang , Yanan Zhang , Qingjie Liu , Zhenghui Hu , Baohui Wang , Yunhong Wang

Visual Odometry (VO) estimation is an important source of information for vehicle state estimation and autonomous driving. Recently, deep learning based approaches have begun to appear in the literature. However, in the context of driving,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Nimet Kaygusuz , Oscar Mendez , Richard Bowden

Multimodal sensor fusion is an essential capability for autonomous robots, enabling object detection and decision-making in the presence of failing or uncertain inputs. While recent fusion methods excel in normal environmental conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Edoardo Palladin , Roland Dietze , Praveen Narayanan , Mario Bijelic , Felix Heide

In the domain of autonomous driving, the integration of multi-modal perception techniques based on data from diverse sensors has demonstrated substantial progress. Effectively surpassing the capabilities of state-of-the-art single-modality…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Sheng-Yao Kuan , Jen-Hao Cheng , Hsiang-Wei Huang , Wenhao Chai , Cheng-Yen Yang , Hugo Latapie , Gaowen Liu , Bing-Fei Wu , Jenq-Neng Hwang

Camera-radar fusion offers a robust and cost-effective alternative to LiDAR-based autonomous driving systems by combining complementary sensing capabilities: cameras provide rich semantic cues but unreliable depth, while radar delivers…

Radars and cameras belong to the most frequently used sensors for advanced driver assistance systems and automated driving research. However, there has been surprisingly little research on radar-camera fusion with neural networks. One of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Lukas Stäcker , Shashank Mishra , Philipp Heidenreich , Jason Rambach , Didier Stricker

Fusing the camera and LiDAR information has become a de-facto standard for 3D object detection tasks. Current methods rely on point clouds from the LiDAR sensor as queries to leverage the feature from the image space. However, people…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Tingting Liang , Hongwei Xie , Kaicheng Yu , Zhongyu Xia , Zhiwei Lin , Yongtao Wang , Tao Tang , Bing Wang , Zhi Tang

Reliable 3D object perception is essential in autonomous driving. Owing to its sensing capabilities in all weather conditions, 4D radar has recently received much attention. However, compared to LiDAR, 4D radar provides much sparser point…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Sheng Yang , Tong Zhan , Shichen Qiao , Jicheng Gong , Qing Yang , Jian Wang , Yanfeng Lu

This paper presents a novel multi-modal Multi-Object Tracking (MOT) algorithm for self-driving cars that combines camera and LiDAR data. Camera frames are processed with a state-of-the-art 3D object detector, whereas classical clustering…

Robotics · Computer Science 2024-05-14 Riccardo Pieroni , Simone Specchia , Matteo Corno , Sergio Matteo Savaresi

3D object detection based on LiDAR-camera fusion is becoming an emerging research theme for autonomous driving. However, it has been surprisingly difficult to effectively fuse both modalities without information loss and interference. To…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Guojun Wang , Bin Tian , Yachen Zhang , Long Chen , Dongpu Cao , Jian Wu

Lidars and cameras are critical sensors that provide complementary information for 3D detection in autonomous driving. While prevalent multi-modal methods simply decorate raw lidar point clouds with camera features and feed them directly to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Yingwei Li , Adams Wei Yu , Tianjian Meng , Ben Caine , Jiquan Ngiam , Daiyi Peng , Junyang Shen , Bo Wu , Yifeng Lu , Denny Zhou , Quoc V. Le , Alan Yuille , Mingxing Tan

Modern autonomous driving perception systems utilize complementary multi-modal sensors, such as LiDAR and cameras. Although sensor fusion architectures enhance performance in challenging environments, they still suffer significant…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Konyul Park , Yecheol Kim , Daehun Kim , Jun Won Choi

Autonomous Vehicles (AVs) use multiple sensors to gather information about their surroundings. By sharing sensor data between Connected Autonomous Vehicles (CAVs), the safety and reliability of these vehicles can be improved through a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Donghao Qiao , Farhana Zulkernine

End-to-end autonomous driving has witnessed remarkable progress. However, the extensive deployment of autonomous vehicles has yet to be realized, primarily due to 1) inefficient multi-modal environment perception: how to integrate data from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Dongyang Xu , Haokun Li , Qingfan Wang , Ziying Song , Lei Chen , Hanming Deng

4D millimeter-wave (mmWave) radar has been widely adopted in autonomous driving and robot perception due to its low cost and all-weather robustness. However, point-cloud-based radar representations suffer from information loss due to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Runwei Guan , Jianan Liu , Shaofeng Liang , Fangqiang Ding , Shanliang Yao , Xiaokai Bai , Daizong Liu , Tao Huang , Guoqiang Mao , Hui Xiong

Recent years have witnessed the remarkable progress of 3D multi-modality object detection methods based on the Bird's-Eye-View (BEV) perspective. However, most of them overlook the complementary interaction and guidance between LiDAR and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Xiaotian Li , Baojie Fan , Jiandong Tian , Huijie Fan

Roadside camera-driven 3D object detection is a crucial task in intelligent transportation systems, which extends the perception range beyond the limitations of vision-centric vehicles and enhances road safety. While previous studies have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Hao Shi , Chengshan Pang , Jiaming Zhang , Kailun Yang , Yuhao Wu , Huajian Ni , Yining Lin , Rainer Stiefelhagen , Kaiwei Wang

Multi-sensor fusion-based road segmentation plays an important role in the intelligent driving system since it provides a drivable area. The existing mainstream fusion method is mainly to feature fusion in the image space domain which…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Haoran Li , Yaran Chen , Qichao Zhang , Dongbin Zhao

The rise of autonomous vehicles has significantly increased the demand for robust 3D object detection systems. While cameras and LiDAR sensors each offer unique advantages--cameras provide rich texture information and LiDAR offers precise…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Zitian Wang , Zehao Huang , Yulu Gao , Naiyan Wang , Si Liu

3D perception is a critical problem in autonomous driving. Recently, the Bird-Eye-View (BEV) approach has attracted extensive attention, due to low-cost deployment and desirable vision detection capacity. However, the existing models ignore…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Siran Chen , Yue Ma , Yu Qiao , Yali Wang