English
Related papers

Related papers: Monitoring with Verified Guarantees

200 papers

To accurately make adaptation decisions, a self-adaptive system needs precise means to analyze itself at runtime. To this end, runtime verification can be used in the feedback loop to check that the managed system satisfies its requirements…

Software Engineering · Computer Science 2023-03-30 Marc Carwehl , Thomas Vogel , Genaína Nunes Rodrigues , Lars Grunske

Formal verification provides assurances that a probabilistic system satisfies its specification--conditioned on the system model being aligned with reality. We propose alignment monitoring to watch that this assumption is justified. We…

Logic in Computer Science · Computer Science 2025-08-04 Thomas A. Henzinger , Konstantin Kueffner , Vasu Singh , I Sun

Stream-based runtime monitors are used in safety-critical applications such as Unmanned Aerial Systems (UAS) to compute comprehensive statistics and logical assessments of system health that provide the human operator with critical…

Formal Languages and Automata Theory · Computer Science 2022-05-26 Jan Baumeister , Bernd Finkbeiner , Stefan Gumhold , Malte Schledjewski

Runtime monitoring is commonly used to detect the violation of desired properties in safety critical cyber-physical systems by observing its executions. Bauer et al. introduced an influential framework for monitoring Linear Temporal Logic…

Formal Languages and Automata Theory · Computer Science 2022-09-13 Corto Mascle , Daniel Neider , Maximilian Schwenger , Paulo Tabuada , Alexander Weinert , Martin Zimmermann

Context and motivation: The development and operation of critical software that contains machine learning (ML) models requires diligence and established processes. Especially the training data used during the development of ML models have…

Software Engineering · Computer Science 2023-02-01 Hans-Martin Heyn , Eric Knauss , Iswarya Malleswaran , Shruthi Dinakaran

Runtime verification is a computing analysis paradigm based on observing a system at runtime (to check its expected behaviour) by means of monitors generated from formal specifications. Distributed runtime verification is runtime…

Software Engineering · Computer Science 2019-08-29 Giorgio Audrito , Ferruccio Damiani , Volker Stolz , Mirko Viroli

Runtime verification (RV) consists in dynamically verifying that the event traces generated by single runs of a system under scrutiny (SUS) are compliant with the formal specification of its expected properties. RML (Runtime Monitoring…

Logic in Computer Science · Computer Science 2020-09-02 Davide Ancona , Angelo Ferrando , Viviana Mascardi

Distributed systems are notoriously difficult to understand and analyze in order to assert their correction w.r.t. given properties. They often exhibit a huge number of different behaviors, as soon as the active entities (peers, agents,…

Formal Languages and Automata Theory · Computer Science 2012-08-13 Volker Diekert , Anca Muscholl

Adversarial robustness verification is essential for ensuring the safe deployment of Large Language Models (LLMs) in runtime-critical applications. However, formal verification techniques remain computationally infeasible for modern LLMs…

Machine Learning · Computer Science 2025-07-25 Natan Levy , Adiel Ashrov , Guy Katz

Robotic systems used in safety-critical industrial situations often rely on modular software architectures, and increasingly include autonomous components. Verifying that these modular robotic systems behave as expected requires approaches…

Logic in Computer Science · Computer Science 2023-12-01 Matt Luckcuck , Marie Farrell , Angelo Ferrando , Rafael C. Cardoso , Louise A. Dennis , Michael Fisher

As machine learning (ML) components become increasingly integrated into software systems, the emphasis on the ethical or responsible aspects of their use has grown significantly. This includes building ML-based systems that adhere to…

Software Engineering · Computer Science 2023-10-11 Hira Naveed

Stream-based runtime monitoring frameworks are safety assurance tools that check the runtime behavior of a system against a formal specification. This tutorial provides a hands-on introduction to RTLola, a real-time monitoring toolkit for…

Logic in Computer Science · Computer Science 2025-01-28 Jan Baumeister , Bernd Finkbeiner , Florian Kohn , Frederik Scheerer

Neural certificates have emerged as a powerful tool in cyber-physical systems control, providing witnesses of correctness. These certificates, such as barrier functions, often learned alongside control policies, once verified, serve as…

Symbolic Computation · Computer Science 2025-07-17 Thomas A. Henzinger , Konstantin Kueffner , Emily Yu

We present an approach for verifying systems at runtime. Our approach targets distributed systems whose components communicate with monitors over unreliable channels, where messages can be delayed, reordered, or even lost. Furthermore, our…

Logic in Computer Science · Computer Science 2019-09-26 David Basin , Felix Klaedtke , Eugen Zalinescu

This study carries forward the line of enquiry that seeks to characterize precisely which security policies are enforceable by runtime monitors. In this regard, Basin et al.\ recently refined the structure that helps distinguish between…

Cryptography and Security · Computer Science 2015-08-27 Raphaël Khoury , Sylvain Hallé

Runtime monitors that are specified in a stream-based monitoring language tend to be easier to understand, maintain, and reuse than those written in a standard programming language. Because of their formal semantics, such specification…

Formal Languages and Automata Theory · Computer Science 2020-11-30 Jan Baumeister , Bernd Finkbeiner , Matthis Kruse , Maximilian Schwenger

We develop a data-driven approach for runtime safety monitoring in flight testing, where pilots perform maneuvers on aircraft with uncertain parameters. Because safety violations can arise unexpectedly as a result of these uncertainties,…

Machine Learning · Computer Science 2025-11-27 Aaron O. Feldman , D. Isaiah Harp , Joseph Duncan , Mac Schwager

High-accurate machine learning (ML) image classifiers cannot guarantee that they will not fail at operation. Thus, their deployment in safety-critical applications such as autonomous vehicles is still an open issue. The use of fault…

Artificial Intelligence · Computer Science 2021-10-05 Raul Sena Ferreira , Jean Arlat , Jeremie Guiochet , Hélène Waeselynck

Runtime monitoring is an essential part of guaranteeing the safety of cyber-physical systems. Recently, runtime monitoring frameworks based on formal specification languages gained momentum. These languages provide valuable abstractions for…

Programming Languages · Computer Science 2023-11-15 Bernd Finkbeiner , Florian Kohn , Malte Schledjewski

We discuss the problem of runtime verification of an instrumented program that misses to emit and to monitor some events. These gaps can occur when a monitoring overhead control mechanism is introduced to disable the monitor of an…

Logic in Computer Science · Computer Science 2013-08-27 Ezio Bartocci , Radu Grosu