What's Really Different with AI? -- A Behavior-based Perspective on System Safety for Automated Driving Systems
Abstract
Assuring safety for ``AI-based'' systems is one of the current challenges in safety engineering. For automated driving systems, in particular, further assurance challenges result from the open context that the systems need to operate in after deployment. The current standardization and regulation landscape for ``AI-based'' systems is becoming ever more complex, as standards and regulations are being released at high frequencies. This position paper seeks to provide guidance for making qualified arguments which standards should meaningfully be applied to (``AI-based'') automated driving systems. Furthermore, we argue for clearly differentiating sources of risk between AI-specific and general uncertainties related to the open context. In our view, a clear conceptual separation can help to exploit commonalities that can close the gap between system-level and AI-specific safety analyses, while ensuring the required rigor for engineering safe ``AI-based'' systems.
Cite
@article{arxiv.2507.20685,
title = {What's Really Different with AI? -- A Behavior-based Perspective on System Safety for Automated Driving Systems},
author = {Marcus Nolte and Nayel Fabian Salem and Olaf Franke and Jan Heckmann and Christoph Höhmann and Georg Stettinger and Markus Maurer},
journal= {arXiv preprint arXiv:2507.20685},
year = {2025}
}
Comments
8 pages, 1 figure, 1 table, to be published in 2025 IEEE International Automated Vehicle Validation Conference (IAVVC)