English

Deterministic World Models for Verification of Closed-loop Vision-based Systems

Computer Vision and Pattern Recognition 2026-04-03 v2 Machine Learning

Abstract

Verifying closed-loop vision-based control systems remains a fundamental challenge due to the high dimensionality of images and the difficulty of modeling visual environments. While generative models are increasingly used as camera surrogates in verification, their reliance on stochastic latent variables introduces unnecessary overapproximation error. To address this bottleneck, we propose a Deterministic World Model (DWM) that maps system states directly to generative images, effectively eliminating uninterpretable latent variables to ensure precise input bounds. The DWM is trained with a dual-objective loss function that combines pixel-level reconstruction accuracy with a control difference loss to maintain behavioral consistency with the real system. We integrate DWM into a verification pipeline utilizing Star-based reachability analysis (StarV) and employ conformal prediction to derive rigorous statistical bounds on the trajectory deviation between the world model and the actual vision-based system. Experiments on standard benchmarks show that our approach yields significantly tighter reachable sets and better verification performance than a latent-variable baseline.

Keywords

Cite

@article{arxiv.2512.08991,
  title  = {Deterministic World Models for Verification of Closed-loop Vision-based Systems},
  author = {Yuang Geng and Zhuoyang Zhou and Zhongzheng Zhang and Siyuan Pan and Hoang-Dung Tran and Ivan Ruchkin},
  journal= {arXiv preprint arXiv:2512.08991},
  year   = {2026}
}

Comments

Significantly revised version with additional experiments and updated results. Submitted to EMSOFT 2026

R2 v1 2026-07-01T08:17:42.363Z