English
Related papers

Related papers: HeCoFuse: Cross-Modal Complementary V2X Cooperativ…

200 papers

In the rapidly advancing landscape of connected and automated vehicles (CAV), the integration of Vehicle-to-Everything (V2X) communication in traditional fusion systems presents a promising avenue for enhancing vehicle perception.…

Robotics · Computer Science 2024-04-30 Thomas Billington , Ansh Gwash , Aadi Kothari , Lucas Izquierdo , Timothy Talty

Existing data collection methods for traffic operations and control usually rely on infrastructure-based loop detectors or probe vehicle trajectories. Connected and automated vehicles (CAVs) not only can report data about themselves but…

Robotics · Computer Science 2022-08-05 Hanlin Chen , Brian Liu , Xumiao Zhang , Feng Qian , Z. Morley Mao , Yiheng Feng

Multi-modal fusion is a fundamental task for the perception of an autonomous driving system, which has recently intrigued many researchers. However, achieving a rather good performance is not an easy task due to the noisy raw data,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Keli Huang , Botian Shi , Xiang Li , Xin Li , Siyuan Huang , Yikang Li

In recent years, multi-modal fusion has attracted a lot of research interest, both in academia, and in industry. Multimodal fusion entails the combination of information from a set of different types of sensors. Exploiting complementary…

Machine Learning · Computer Science 2020-08-27 Siddharth Roheda , Hamid Krim , Benjamin S. Riggan

While Vehicle-to-Vehicle (V2V) collaboration extends sensing ranges through multi-agent data sharing, its reliability remains severely constrained by ground-level occlusions and the limited perspective of chassis-mounted sensors, which…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xianke Wu , Songlin Bai , Chengxiang Li , Zhiyao Luo , Yulin Tian , Fenghua Zhu , Yisheng Lv , Yonglin Tian

Vehicle-to-everything (V2X) is a popular topic in the field of Autonomous Driving in recent years. Vehicle-infrastructure cooperation (VIC) becomes one of the important research area. Due to the complexity of traffic conditions such as…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Cong Ma , Lei Qiao , Chengkai Zhu , Kai Liu , Zelong Kong , Qing Li , Xueqi Zhou , Yuheng Kan , Wei Wu

Achieving fully autonomous driving with enhanced safety and efficiency relies on vehicle-to-everything cooperative perception, which enables vehicles to share perception data, thereby enhancing situational awareness and overcoming the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Tao Huang , Jianan Liu , Xi Zhou , Dinh C. Nguyen , Mostafa Rahimi Azghadi , Yuxuan Xia , Qing-Long Han , Sumei Sun

Multi-modal 3D object detectors are dedicated to exploring secure and reliable perception systems for autonomous driving (AD).Although achieving state-of-the-art (SOTA) performance on clean benchmark datasets, they tend to overlook the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Ziying Song , Guoxing Zhang , Lin Liu , Lei Yang , Shaoqing Xu , Caiyan Jia , Feiyang Jia , Li Wang

Cooperatively utilizing both ego-vehicle and infrastructure sensor data via V2X communication has emerged as a promising approach for advanced autonomous driving. However, current research mainly focuses on improving individual modules,…

Robotics · Computer Science 2024-12-25 Haibao Yu , Wenxian Yang , Jiaru Zhong , Zhenwei Yang , Siqi Fan , Ping Luo , Zaiqing Nie

The emergence of 6G wireless networks promises to revolutionize vehicular communications by enabling ultra-reliable, low-latency, and high-capacity data exchange. In this context, collaborative perception techniques, where multiple vehicles…

Signal Processing · Electrical Eng. & Systems 2025-06-26 Soheyb Ribouh , Osama Saleem , Mohamed Ababsa

Reliable perception is essential for autonomous driving systems to operate safely under diverse real-world traffic conditions. However, camera- and LiDAR-based perception systems suffer from performance degradation under adverse weather and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yue Sun , Yeqiang Qian , Zhe Wang , Tianhui Li , Chunxiang Wang , Ming Yang

Accurate and robust object detection is critical for autonomous driving. Image-based detectors face difficulties caused by low visibility in adverse weather conditions. Thus, radar-camera fusion is of particular interest but presents…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Huawei Sun , Hao Feng , Georg Stettinger , Lorenzo Servadei , Robert Wille

Multimodal image fusion and object detection are crucial for autonomous driving. While current methods have advanced the fusion of texture details and semantic information, their complex training processes hinder broader applications.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Jiaqing Zhang , Mingxiang Cao , Weiying Xie , Jie Lei , Daixun Li , Wenbo Huang , Yunsong Li , Xue Yang

Collaborative perception (CP) is a promising paradigm for improving situational awareness in autonomous vehicles by overcoming the limitations of single-agent perception. However, most existing approaches assume homogeneous agents, which…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Armin Maleki , Hayder Radha

By sharing intermediate features, collaborative perception extends each agent's sensing beyond standalone limits, but real-world feature modality heterogeneity remains a key barrier to effective fusion. Most existing methods, including…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yang Li , Weize Li , Quan Yuan , Congzhang Shao , Guiyang Luo , Yunqi Ba , Xuanhan Zhu , Xinyuan Ding , Xiaoyuan Fu , Jinglin Li

Recent advances in 4D imaging radar have enabled robust perception in adverse weather, while camera sensors provide dense semantic information. Fusing the these complementary modalities has great potential for cost-effective 3D perception.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Xiaozhi Li , Huijun Di , Jian Li , Feng Liu , Wei Liang

Cooperative perception is challenging for safety-critical autonomous driving applications.The errors in the shared position and pose cause an inaccurate relative transform estimation and disrupt the robust mapping of the Ego vehicle. We…

Multiagent Systems · Computer Science 2023-04-27 Zhiying Song , Fuxi Wen , Hailiang Zhang , Jun Li

In autonomous driving, Vehicle-Infrastructure Cooperative 3D Object Detection (VIC3D) makes use of multi-view cameras from both vehicles and traffic infrastructure, providing a global vantage point with rich semantic context of road…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Zhe Wang , Siqi Fan , Xiaoliang Huo , Tongda Xu , Yan Wang , Jingjing Liu , Yilun Chen , Ya-Qin Zhang

Cooperative 3D perception via Vehicle-to-Everything communication is a promising paradigm for enhancing autonomous driving, offering extended sensing horizons and occlusion resolution. However, the practical deployment of existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Jiahao Wang , Zikun Xu , Yuner Zhang , Zhongwei Jiang , Chenyang Lu , Shuocheng Yang , Yuxuan Wang , Jiaru Zhong , Chuang Zhang , Shaobing Xu , Jianqiang Wang

Multi-agent collaborative perception could significantly upgrade the perception performance by enabling agents to share complementary information with each other through communication. It inevitably results in a fundamental trade-off…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Yue Hu , Shaoheng Fang , Zixing Lei , Yiqi Zhong , Siheng Chen