English
Related papers

Related papers: Offline Runtime Verification of Safety Requirement…

200 papers

Neural networks are increasingly used in safety-critical applications such as robotics and autonomous vehicles. However, the deployment of neural-network-controlled systems (NNCSs) raises significant safety concerns. Many recent advances…

Robotics · Computer Science 2024-08-19 Frank Yang , Sinong Simon Zhan , Yixuan Wang , Chao Huang , Qi Zhu

The emergent behaviour of autonomous robotic swarms poses a significant challenge to their safety assurance. Assurance tasks encompass adherence to standards, certification processes, and the execution of verification and validation (V&V)…

When autonomous vehicles encounter untrained scenarios, ensuring safety hinges on effective safety verification to prevent accidents stemming from unexpected model decisions. Reachability analysis, a method of safety verification, offers…

Systems and Control · Electrical Eng. & Systems 2025-12-05 Lingxiang Fan , Linxuan He , Haoyuan Ji , Shuo Feng

In this paper, we present a framework that uses acoustic side-channel analysis (ASCA) to monitor and verify whether a robot correctly executes its intended commands. We develop and evaluate a machine-learning-based workflow verification…

Cryptography and Security · Computer Science 2025-10-31 Zeynep Yasemin Erdogan , Shishir Nagaraja , Chuadhry Mujeeb Ahmed , Ryan Shah

The automobile Real-Time Operating System (RTOS) is hard to design and implement due to its real time features and increasing complexity. Some automobile RTOS standards are released aiming at unifying the software architecture of vehicle…

Software Engineering · Computer Science 2017-11-27 Xiaoran Zhu , Min Zhang , Jian Guo

Modern SoC design relies on the ability to separately verify IP blocks relative to their own specifications. Formal verification (FV) using SystemVerilog Assertions (SVA) is an effective method to exhaustively verify blocks at unit-level.…

Hardware Architecture · Computer Science 2021-04-12 Marcelo Orenes-Vera , Aninda Manocha , David Wentzlaff , Margaret Martonosi

Vision-language models remain susceptible to multimodal jailbreaks and over-refusal because safety hinges on both visual evidence and user intent, while many alignment pipelines supervise only the final response. To address this, we present…

Machine Learning · Computer Science 2026-03-04 Zixuan Xu , Tiancheng He , Huahui Yi , Kun Wang , Xi Chen , Gongli Xi , Qiankun Li , Kang Li , Yang Liu , Zhigang Zeng

Safety critical avionics software is a natural application area for formal verification. This is reflected in the formal method's inclusion into the certification guideline DO-178C and its formal methods supplement DO-333. Airbus and…

Software Engineering · Computer Science 2015-08-20 Frank Dordowsky

Regulatory approval and safety guarantees for autonomous vehicles facing frequent functional updates and complex software stacks, including artificial intelligence, are a challenging topic. This paper proposes a concept and guideline for…

Systems and Control · Electrical Eng. & Systems 2020-05-19 Tim Stahl , Matthis Eicher , Johannes Betz , Frank Diermeyer

Industrial cyber-physical systems are hybrid systems with strict safety requirements. Despite not having a formal semantics, most of these systems are modeled using Stateflow/Simulink for mainly two reasons: (1) it is easier to model, test,…

Logic in Computer Science · Computer Science 2018-06-26 Nima Roohi , Ramneet Kaur , James Weimer , Oleg Sokolsky , Insup Lee

Challenges related to automated driving are no longer focused on just the construction of such automated vehicles (AVs), but in assuring the safety of their operation. Recent advances in Level 3 and Level 4 autonomous driving have motivated…

Systems and Control · Electrical Eng. & Systems 2022-05-09 Tong Zhao , Ekim Yurtsever , Joel Paulson , Giorgio Rizzoni

Safety-critical distributed cyber-physical systems (CPSs) have been found in a wide range of applications. Notably, they have displayed a great deal of utility in intelligent transportation, where autonomous vehicles communicate and…

Multiagent Systems · Computer Science 2019-09-20 Hoang-Dung Tran , Luan Viet Nguyen , Patrick Musau , Weiming Xiang , Taylor T. Johnson

We present a new approach to automated scenario-based testing of the safety of autonomous vehicles, especially those using advanced artificial intelligence-based components, spanning both simulation-based evaluation as well as testing in…

Systems and Control · Electrical Eng. & Systems 2020-07-14 Daniel J. Fremont , Edward Kim , Yash Vardhan Pant , Sanjit A. Seshia , Atul Acharya , Xantha Bruso , Paul Wells , Steve Lemke , Qiang Lu , Shalin Mehta

In this work, we address the problem of formal safety verification for stochastic cyber-physical systems (CPS) equipped with ReLU neural network (NN) controllers. Our goal is to find the set of initial states from where, with a…

Systems and Control · Electrical Eng. & Systems 2021-03-10 Shiqi Sun , Yan Zhang , Xusheng Luo , Panagiotis Vlantis , Miroslav Pajic , Michael M. Zavlanos

Runtime verification (RV) consists in dynamically verifying that the event traces generated by single runs of a system under scrutiny (SUS) are compliant with the formal specification of its expected properties. RML (Runtime Monitoring…

Logic in Computer Science · Computer Science 2020-09-02 Davide Ancona , Angelo Ferrando , Viviana Mascardi

The current verification flow of complex systems uses different engines synergistically: virtual prototyping, formal verification, simulation, emulation and FPGA prototyping. However, none is able to verify a complete architecture.…

Logic in Computer Science · Computer Science 2018-02-12 Tomas Grimm , Djones Lettnin , Michael Hübner

Safety verification for autonomous vehicles (AVs) and ground robots is crucial for ensuring reliable operation given their uncertain environments. Formal language tools provide a robust and sound method to verify safety rules for such…

Robotics · Computer Science 2025-01-24 Aditya Parameshwaran , Yue Wang

Chatbots have become integral to various application domains, including those with safety-critical considerations. As a result, there is a pressing need for methods that ensure chatbots consistently adhere to expected, safe behaviours. In…

Artificial Intelligence · Computer Science 2024-11-22 Andrea Gatti , Viviana Mascardi , Angelo Ferrando

We present an approach for the verification and validation (V&V) of robot assistants in the context of human-robot interactions (HRI), to demonstrate their trustworthiness through corroborative evidence of their safety and functional…

The kind of closed-loop verification likely to be required for autonomous vehicle (AV) safety testing is beyond the reach of traditional test methodologies and discrete verification. Validation puts the autonomous vehicle system to the test…

Machine Learning · Computer Science 2020-05-29 Hyun Jae Cho , Madhur Behl