English
Related papers

Related papers: Co-Fusion4D: Spatio-temporal Collaborative Fusion …

200 papers

Multi-view cooperative perception and multimodal fusion are essential for reliable 3D spatiotemporal understanding in autonomous driving, especially under occlusions, limited viewpoints, and communication delays in V2X scenarios. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Zhenwei Yang , Yibo Ai , Weidong Zhang

Accurate and robust object detection is critical for autonomous driving. Image-based detectors face difficulties caused by low visibility in adverse weather conditions. Thus, radar-camera fusion is of particular interest but presents…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Huawei Sun , Hao Feng , Georg Stettinger , Lorenzo Servadei , Robert Wille

Radars, due to their robustness to adverse weather conditions and ability to measure object motions, have served in autonomous driving and intelligent agents for years. However, Radar-based perception suffers from its unintuitive sensing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Liu Liu , Shuaifeng Zhi , Zhenhua Du , Li Liu , Xinyu Zhang , Kai Huo , Weidong Jiang

Collaborative perception in automated vehicles leverages the exchange of information between agents, aiming to elevate perception results. Previous camera-based collaborative 3D perception methods typically employ 3D bounding boxes or…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Rui Song , Chenwei Liang , Hu Cao , Zhiran Yan , Walter Zimmer , Markus Gross , Andreas Festag , Alois Knoll

More and more research works fuse the LiDAR and camera information to improve the 3D object detection of the autonomous driving system. Recently, a simple yet effective fusion framework has achieved an excellent detection performance,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Yun Zhao , Zhan Gong , Peiru Zheng , Hong Zhu , Shaohua Wu

Camera and LiDAR sensor modalities provide complementary appearance and geometric information useful for detecting 3D objects for autonomous vehicle applications. However, current end-to-end fusion methods are challenging to train and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Anas Mahmoud , Jordan S. K. Hu , Steven L. Waslander

Multimodal sensor fusion has demonstrated remarkable performance improvements over unimodal approaches in 3D object detection for autonomous vehicles. Typically, existing methods transform multimodal data from independent sensors, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Markus Essl , Marta Moscati , Mubashir Noman , Muhammad Zaigham Zaheer , Usman Naseem , Shah Nawaz , Markus Schedl

The synthesis of spatiotemporally coherent 4D content presents fundamental challenges in computer vision, requiring simultaneous modeling of high-fidelity spatial representations and physically plausible temporal dynamics. Current…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Xiaoyan Liu , Kangrui Li , Yuehao Song , Jiaxin Liu

4D millimeter-wave (MMW) radar, which provides both height information and dense point cloud data over 3D MMW radar, has become increasingly popular in 3D object detection. In recent years, radar-vision fusion models have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Haocheng Zhao , Runwei Guan , Taoyu Wu , Ka Lok Man , Limin Yu , Yutao Yue

Multi-sensor modal fusion has demonstrated strong advantages in 3D object detection tasks. However, existing methods that fuse multi-modal features require transforming features into the bird's eye view space and may lose certain…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Chunyong Hu , Hang Zheng , Kun Li , Jianyun Xu , Weibo Mao , Maochun Luo , Lingxuan Wang , Mingxia Chen , Qihao Peng , Kaixuan Liu , Yiru Zhao , Peihan Hao , Minzhe Liu , Kaicheng Yu

Recent advancements in 4D scene reconstruction, particularly those leveraging diffusion priors, have shown promise for novel view synthesis in autonomous driving. However, these methods often process frames independently or in a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Heyu Si , Brandon James Denis , Muyang Sun , Dragos Datcu , Yaoru Li , Xin Jin , Ruiju Fu , Yuliia Tatarinova , Federico Landi , Jie Song , Mingli Song , Qi Guo

Effective feature fusion of multispectral images plays a crucial role in multi-spectral object detection. Previous studies have demonstrated the effectiveness of feature fusion using convolutional neural networks, but these methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Jifeng Shen , Yifei Chen , Yue Liu , Xin Zuo , Heng Fan , Wankou Yang

Accurate detection of obstacles in 3D is an essential task for autonomous driving and intelligent transportation. In this work, we propose a general multimodal fusion framework FusionPainting to fuse the 2D RGB image and 3D point clouds at…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Shaoqing Xu , Dingfu Zhou , Jin Fang , Junbo Yin , Zhou Bin , Liangjun Zhang

Camouflaged Object Detection is challenging due to the high degree of similarity between camouflaged objects and their surrounding backgrounds. Current COD methods mainly rely on edge extraction in the spatial domain and local pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Song Yu , Yang Hu , Haokang Ding , Zhifang Liao , Yucheng Song

Collaborative perception in Internet of Vehicles (IoV) aggregates multi-vehicle observations for broader scene coverage and improved decision-making. However, fusion quality degrades under spatiotemporal heterogeneity from unsynchronized…

Networking and Internet Architecture · Computer Science 2026-02-17 Qiaomei Han , Xianbin Wang , Minghui Liwang , Dusit Niyato

Integrating LiDAR and camera inputs into a unified Bird's-Eye-View (BEV) representation is crucial for enhancing 3D perception capabilities of autonomous vehicles. However, existing methods suffer from spatial misalignment between LiDAR and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Xiang Li , Zhangchi Hu , Xiao Xu , Bin Kong

A robust awareness of how dynamic scenes evolve is essential for Autonomous Driving systems, as they must accurately detect, track, and predict the behaviour of surrounding obstacles. Traditional perception pipelines that rely on modular…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Miguel Antunes-García , Santiago Montiel-Marín , Fabio Sánchez-García , Rodrigo Gutiérrez-Moreno , Rafael Barea , Luis M. Bergasa

Collaborative perception aims to extend sensing coverage and improve perception accuracy by sharing information among multiple agents. However, due to differences in viewpoints and spatial positions, agents often acquire heterogeneous…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Lingzhao Kong , Jiacheng Lin , Siyu Li , Kai Luo , Zhiyong Li , Kailun Yang

Cooperative perception via communication among intelligent traffic agents has great potential to improve the safety of autonomous driving. However, limited communication bandwidth, localization errors and asynchronized capturing time of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Yunshuang Yuan , Monika Sester

Fusing LiDAR and camera information is essential for achieving accurate and reliable 3D object detection in autonomous driving systems. This is challenging due to the difficulty of combining multi-granularity geometric and semantic features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Jiao , Zequn Jie , Shaoxiang Chen , Jingjing Chen , Lin Ma , Yu-Gang Jiang