English
Related papers

Related papers: DGFusion: Dual-guided Fusion for Robust Multi-Moda…

200 papers

In autonomous driving, 3D object detection is essential for accurate perception and reliable decision-making. However, object motion and ego-motion often induce cross-frame spatiotemporal inconsistencies in BEV-based detectors, leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Wenxuan Li , Qin Zou , Shoubing Chen , Chi Chen , Yingyi Yang , Shoubing Chen , Qingxiang Meng

Visible images offer rich texture details, while infrared images emphasize salient targets. Fusing these complementary modalities enhances scene understanding, particularly for advanced vision tasks under challenging conditions. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Beining Xu , Junxian Li

Multimodal camera-LiDAR fusion technology has found extensive application in 3D object detection, demonstrating encouraging performance. However, existing methods exhibit significant performance degradation in challenging scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Sixian Liu , Chen Xu , Qiang Wang , Donghai Shi , Yiwen Li

Promising complementarity exists between the texture features of color images and the geometric information of LiDAR point clouds. However, there still present many challenges for efficient and robust feature fusion in the field of 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Chaokang Jiang , Guangming Wang , Jinxing Wu , Yanzi Miao , Hesheng Wang

In this survey, we first introduce the background of popular sensors used for self-driving, their data properties, and the corresponding object detection algorithms. Next, we discuss existing datasets that can be used for evaluating…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Yingjie Wang , Qiuyu Mao , Hanqi Zhu , Jiajun Deng , Yu Zhang , Jianmin Ji , Houqiang Li , Yanyong Zhang

3D object detection plays an important role in autonomous driving; however, its vulnerability to backdoor attacks has become evident. By injecting ''triggers'' to poison the training dataset, backdoor attacks manipulate the detector's…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Saket S. Chaturvedi , Lan Zhang , Wenbin Zhang , Pan He , Xiaoyong Yuan

In LiDAR-based 3D detection, history point clouds contain rich temporal information helpful for future prediction. In the same way, history detections should contribute to future detections. In this paper, we propose a detection enhancement…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Xirui Li , Feng Wang , Naiyan Wang , Chao Ma

Existing top-performance 3D object detectors typically rely on the multi-modal fusion strategy. This design is however fundamentally restricted due to overlooking the modality-specific useful information and finally hampering the model…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Zeyu Yang , Jiaqi Chen , Zhenwei Miao , Wei Li , Xiatian Zhu , Li Zhang

Accurate and robust 3D object detection is essential for autonomous driving, where fusing data from sensors like LiDAR and camera enhances detection accuracy. However, sensor malfunctions such as corruption or disconnection can degrade…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Reza Sadeghian , Niloofar Hooshyaripour , Chris Joslin , WonSook Lee

An accurate and rapid-response perception system is fundamental for autonomous vehicles to operate safely. 3D object detection methods handle point clouds given by LiDAR sensors to provide accurate depth and position information for each…

Robotics · Computer Science 2020-08-04 Guidong Yang , Simone Mentasti , Mattia Bersani , Yafei Wang , Francesco Braghin , Federico Cheli

Bird's eye view (BEV) representation has emerged as a dominant solution for describing 3D space in autonomous driving scenarios. However, objects in the BEV representation typically exhibit small sizes, and the associated point cloud…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Junbo Yin , Jianbing Shen , Runnan Chen , Wei Li , Ruigang Yang , Pascal Frossard , Wenguan Wang

Sparse query-based paradigms have achieved significant success in multi-view 3D detection for autonomous vehicles. Current research faces challenges in balancing between enlarging receptive fields and reducing interference when aggregating…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Jiasen Wang , Zhenglin Li , Ke Sun , Xianyuan Liu , Yang Zhou

The combination of LiDAR and camera modalities is proven to be necessary and typical for 3D object detection according to recent studies. Existing fusion strategies tend to overly rely on the LiDAR modal in essence, which exploits the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Yang Yang , Weijie Ma , Hao Chen , Linlin Ou , Xinyi Yu

Recent advances in 4D imaging radar have enabled robust perception in adverse weather, while camera sensors provide dense semantic information. Fusing the these complementary modalities has great potential for cost-effective 3D perception.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Xiaozhi Li , Huijun Di , Jian Li , Feng Liu , Wei Liang

Automotive traffic scenes are complex due to the variety of possible scenarios, objects, and weather conditions that need to be handled. In contrast to more constrained environments, such as automated underground trains, automotive…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Felix Nobis , Ehsan Shafiei , Phillip Karle , Johannes Betz , Markus Lienkamp

Most modern multiple object tracking (MOT) systems follow the tracking-by-detection paradigm, consisting of a detector followed by a method for associating detections into tracks. There is a long history in tracking of combining motion and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Mohamed Chaabane , Peter Zhang , J. Ross Beveridge , Stephen O'Hara

4D radars, which provide 3D point cloud data along with Doppler velocity, are attractive components of modern automated driving systems due to their low cost and robustness under adverse weather conditions. However, they provide a…

Robotics · Computer Science 2026-03-13 Siqi Pei , Andras Palffy , Dariu M. Gavrila

Multispectral oriented object detection faces challenges due to both inter-modal and intra-modal discrepancies. Recent studies often rely on transformer-based models to address these issues and achieve cross-modal fusion detection. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Minghang Zhou , Tianyu Li , Chaofan Qiao , Dongyu Xie , Guoqing Wang , Ningjuan Ruan , Lin Mei , Yang Yang

4D automotive radar is indispensable for autonomous driving due to its low cost and robustness, yet its point cloud sparsity challenges 3D object detection. Existing 4D radar-camera fusion methods focus on complex fusion strategies, trading…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Weiyi Xiong , Bing Zhu

Multi-object tracking (MOT) with camera-LiDAR fusion demands accurate results of object detection, affinity computation and data association in real time. This paper presents an efficient multi-modal MOT framework with online joint…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Kemiao Huang , Qi Hao