English
Related papers

Related papers: DPFT: Dual Perspective Fusion Transformer for Came…

200 papers

Multi-sensor fusion is essential for accurate 3D object detection in self-driving systems. Camera and LiDAR are the most commonly used sensors, and usually, their fusion happens at the early or late stages of 3D detectors with the help of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Javed Ahmad , Alessio Del Bue

Cross-modality fusing complementary information of multispectral remote sensing image pairs can improve the perception ability of detection algorithms, making them more robust and reliable for a wider range of applications, such as…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Qingyun Fang , Zhaokui Wang

3D object detection based on LiDAR-camera fusion is becoming an emerging research theme for autonomous driving. However, it has been surprisingly difficult to effectively fuse both modalities without information loss and interference. To…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Guojun Wang , Bin Tian , Yachen Zhang , Long Chen , Dongpu Cao , Jian Wu

Road terrains play a crucial role in ensuring the driving safety of autonomous vehicles (AVs). However, existing sensors of AVs, including cameras and Lidars, are susceptible to variations in lighting and weather conditions, making it…

Artificial Intelligence · Computer Science 2025-05-19 Rui Wang , Shichun Yang , Yuyi Chen , Zhuoyang Li , Zexiang Tong , Jianyi Xu , Jiayi Lu , Xinjie Feng , Yaoguang Cao

In autonomous driving, camera-radar fusion offers complementary sensing and low deployment cost. Existing methods perform fusion through input mixing, feature map mixing, or query-based feature sampling. We propose a new fusion paradigm,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jialong Wu , Yihan Wang , Matthias Rottmann

Recently, camera-radar fusion-based 3D object detection methods in bird's eye view (BEV) have gained attention due to the complementary characteristics and cost-effectiveness of these sensors. Previous approaches using forward projection…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 In-Jae Lee , Sihwan Hwang , Youngseok Kim , Wonjune Kim , Sanmin Kim , Dongsuk Kum

Accurate perception of dynamic obstacles is essential for autonomous robot navigation in indoor environments. Although sophisticated 3D object detection and tracking methods have been investigated and developed thoroughly in the fields of…

Robotics · Computer Science 2025-03-03 Zhefan Xu , Haoyu Shen , Xinming Han , Hanyu Jin , Kanlong Ye , Kenji Shimada

A good and robust sensor data fusion in diverse weather conditions is a quite challenging task. There are several fusion architectures in the literature, e.g. the sensor data can be fused right at the beginning (Early Fusion), or they can…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Andreas Pfeuffer , Klaus Dietmayer

In the domain of intelligent transportation systems (ITS), collaborative perception has emerged as a promising approach to overcome the limitations of individual perception by enabling multiple agents to exchange information, thus enhancing…

Multiagent Systems · Computer Science 2023-05-04 Ahmed N. Ahmed , Siegfried Mercelis , Ali Anwar

Multi-sensor fusion in autonomous vehicles is becoming more common to offer a more robust alternative for several perception tasks. This need arises from the unique contribution of each sensor in collecting data: camera-radar fusion offers…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Ruan Bispo , Tim Brophy , Reenu Mohandas , Anthony Scanlan , Ciarán Eising

In cooperative perception studies, there is often a trade-off between communication bandwidth and perception performance. While current feature fusion solutions are known for their excellent object detection performance, transmitting the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Deyuan Qu , Qi Chen , Yongqi Zhu , Yihao Zhu , Sergei S. Avedisov , Song Fu , Qing Yang

Current Vehicle-to-Everything (V2X) systems have significantly enhanced 3D object detection using LiDAR and camera data. However, these methods suffer from performance degradation in adverse weather conditions. The weather-robust 4D radar…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xun Huang , Jinlong Wang , Qiming Xia , Siheng Chen , Bisheng Yang , Xin Li , Cheng Wang , Chenglu Wen

Due to the trending need of building autonomous robotic perception system, sensor fusion has attracted a lot of attention amongst researchers and engineers to make best use of cross-modality information. However, in order to build a robotic…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Apoorv Singh

In this paper, we present a Transformer-based architecture for 3D radar object detection that uses a novel Transformer Decoder as the prediction head to directly regress 3D bounding boxes and class scores from radar feature representations.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Changxu Zhang , Zhaoze Wang , Tai Fei , Christopher Grimm , Yi Jin , Claas Tebruegge , Ernst Warsitz , Markus Gardill

Fully autonomous driving systems require fast detection and recognition of sensitive objects in the environment. In this context, intelligent vehicles should share their sensor data with computing platforms and/or other vehicles, to detect…

Networking and Internet Architecture · Computer Science 2021-04-27 Valentina Rossi , Paolo Testolina , Marco Giordani , Michele Zorzi

Sensor fusion is an essential topic in many perception systems, such as autonomous driving and robotics. Transformers-based detection head and CNN-based feature encoder to extract features from raw sensor-data has emerged as one of the best…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Apoorv Singh

LiDAR and camera are two essential sensors for 3D object detection in autonomous driving. LiDAR provides accurate and reliable 3D geometry information while the camera provides rich texture with color. Despite the increasing popularity of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Qi Jiang , Hao Sun , Xi Zhang

Our study assesses the adversarial robustness of LiDAR-camera fusion models in 3D object detection. We introduce an attack technique that, by simply adding a limited number of physically constrained adversarial points above a car, can make…

Robotics · Computer Science 2024-01-10 Bo Yang , Xiaoyu Ji , Zizhi Jin , Yushi Cheng , Wenyuan Xu

The perception of moving objects is crucial for autonomous robots performing collision avoidance in dynamic environments. LiDARs and cameras tremendously enhance scene interpretation but do not provide direct motion information and face…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Matthias Zeller , Vardeep S. Sandhu , Benedikt Mersch , Jens Behley , Michael Heidingsfeld , Cyrill Stachniss

Lidar point cloud distortion from moving object is an important problem in autonomous driving, and recently becomes even more demanding with the emerging of newer lidars, which feature back-and-forth scanning patterns. Accurately estimating…

Robotics · Computer Science 2022-07-05 Wen Yang , Zheng Gong , Baifu Huang , Xiaoping Hong