English

VALISENS: A Validated Innovative Multi-Sensor System for Cooperative Automated Driving

Robotics 2026-01-26 v2 Computer Vision and Pattern Recognition

Abstract

Reliable perception remains a key challenge for Connected Automated Vehicles (CAVs) in complex real-world environments, where varying lighting conditions and adverse weather degrade sensing performance. While existing multi-sensor solutions improve local robustness, they remain constrained by limited sensing range, line-of-sight occlusions, and sensor failures on individual vehicles. This paper introduces VALISENS, a validated cooperative perception system that extends multi-sensor fusion beyond a single vehicle through Vehicle-to-Everything (V2X)-enabled collaboration between Connected Automated Vehicles (CAVs) and intelligent infrastructure. VALISENS integrates onboard and roadside LiDARs, radars, RGB cameras, and thermal cameras within a unified multi-agent perception framework. Thermal cameras enhances the detection of Vulnerable Road Users (VRUs) under challenging lighting conditions, while roadside sensors reduce occlusions and expand the effective perception range. In addition, an integrated sensor monitoring module continuously assesses sensor health and detects anomalies before system degradation occurs. The proposed system is implemented and evaluated in a dedicated real-world testbed. Experimental results show that VALISENS improves pedestrian situational awareness by up to 18% compared with vehicle-only sensing, while the sensor monitoring module achieves over 97% accuracy, demonstrating its effectiveness and its potential to support future Cooperative Intelligent Transport Systems (C-ITS) applications.

Keywords

Cite

@article{arxiv.2505.06980,
  title  = {VALISENS: A Validated Innovative Multi-Sensor System for Cooperative Automated Driving},
  author = {Lei Wan and Prabesh Gupta and Andreas Eich and Marcel Kettelgerdes and Hannan Ejaz Keen and Michael Klöppel-Gersdorf and Alexey Vinel},
  journal= {arXiv preprint arXiv:2505.06980},
  year   = {2026}
}

Comments

8 pages, 5 figures, submitted to IEEE VNC

R2 v1 2026-06-28T23:28:40.126Z