English

Lost in Fog: Sensor Perturbations Expose Reasoning Fragility in Driving VLAs

Robotics 2026-05-21 v1 Artificial Intelligence

Abstract

Interpretable autonomous driving planners depend not only on generating explanations, but also on those explanations remaining reliable under real-world sensor degradation. In this paper we present a controlled perturbation study of Vision-Language-Action (VLA) robustness in autonomous driving, evaluating Alpamayo R1 (10B parameters) across 1,996 scenarios under eight sensor perturbations (Gaussian noise at four intensities, two lighting extremes, and two fog levels; 18,000{\sim}18{,}000 inference trials). We find that reasoning consistency is a high-fidelity indicator of trajectory reliability: when Chain-of-Causation (CoC) explanations change after perturbation, trajectory deviation spikes 5.3×5.3{\times} (21.8m vs 4.1m), with r ⁣= ⁣0.99r\!=\!0.99 across attack types and rpb ⁣= ⁣0.53r_{pb}\!=\!0.53 per-sample (Cohen's d ⁣= ⁣1.12d\!=\!1.12). A controlled ablation provides evidence that enabling CoC generation is associated with improved trajectory accuracy (11.8% on average across conditions; p<0.0001p < 0.0001) under matched inference settings. Over the tested noise range (σ{10,30,50,70}\sigma \in \{10, 30, 50, 70\}), degradation is approximately linear (R2 ⁣= ⁣0.957R^2\!=\!0.957), while standard input preprocessing defenses provide only marginal relief. Together, these results establish CoC consistency as a quantitative proxy for planning safety and motivate reasoning-based runtime monitoring for safer VLA deployment.

Keywords

Cite

@article{arxiv.2605.21446,
  title  = {Lost in Fog: Sensor Perturbations Expose Reasoning Fragility in Driving VLAs},
  author = {Abhinaw Priyadershi and Jelena Frtunikj},
  journal= {arXiv preprint arXiv:2605.21446},
  year   = {2026}
}