English
Related papers

Related papers: Combining Cost-Constrained Runtime Monitors for AI…

200 papers

In the era of Cyber Physical Systems, designers need to offer support for run-time adaptivity considering different constraints, including the internal status of the system. This work presents a run-time monitoring approach, based on the…

Hardware Architecture · Computer Science 2021-03-02 Tiziana Fanni , Daniel Madronal , Claudio Rubattu , Carlo Sau , Francesca Palumbo , Eduardo Juarez , Maxime Pelcat , Cesar Sanz , Luigi Raffo

Post-deployment monitoring of artificial intelligence (AI) systems in health care is essential to ensure their safety, quality, and sustained benefit-and to support governance decisions about which systems to update, modify, or…

An important real-world application of multi-robot systems is multi-robot patrolling (MRP), where robots must carry out the activity of going through an area at regular intervals. Motivations for MRP include the detection of anomalies that…

Robotics · Computer Science 2024-09-23 Zachary R. Madin , Jonathan Lawry , Edmund R. Hunt

As autonomous agents become more capable of performing real-world tasks, distinguishing scheming behavior from benign task pursuit may become a central AI control problem. Existing monitors often rely on chain-of-thought access or internal…

Computation and Language · Computer Science 2026-05-29 Aditya Sinha , Akshat Naik , Victor Gillioz , Simon Storf , Kilian Merkelbach , Rich Barton-Cooper , Axel Højmark , Marius Hobbhahn

Runtime verification offers scalable solutions to improve the safety and reliability of systems. However, systems that require verification or monitoring by a third party to ensure compliance with a specification might contain sensitive…

Cryptography and Security · Computer Science 2025-05-15 Thomas A. Henzinger , Mahyar Karimi , K. S. Thejaswini

Runtime Verification is a lightweight formal verification technique. It is used to verify at runtime whether the system under analysis behaves as expected. The expected behaviour is usually formally specified by means of properties, which…

Logic in Computer Science · Computer Science 2021-10-26 Angelo Ferrando , Rafael C. Cardoso

Ensuring the functional safety of motion planning modules in autonomous vehicles remains a critical challenge, especially when dealing with complex or learning-based software. Online verification has emerged as a promising approach to…

Robotics · Computer Science 2025-07-11 Korbinian Moller , Rafael Neher , Marvin Seegert , Johannes Betz

Reducing cycle time is a recurrent concern in the field of business process management. Depending on the process, various interventions may be triggered to reduce the cycle time of a case, for example, using a faster shipping service in an…

Machine Learning · Computer Science 2021-09-16 Zahra Dasht Bozorgi , Irene Teinemaa , Marlon Dumas , Marcello La Rosa , Artem Polyvyanyy

Consider a target being tracked by a cognitive radar network. If the target can intercept noisy radar emissions, how can it detect coordination in the radar network? By 'coordination' we mean that the radar emissions satisfy Pareto…

Signal Processing · Electrical Eng. & Systems 2023-04-19 Luke Snow , Vikram Krishnamurthy

Computer vision algorithms are known to be extremely sensitive to the environmental conditions in which the data is captured, e.g., lighting conditions and target density. Tuning of parameters or choosing a completely new algorithm is often…

Computer Vision and Pattern Recognition · Computer Science 2016-05-24 Shu Zhang , Qi Zhu , Amit Roy-Chowdhury

Some applications require an assurance that certain criteria are violated with only low probability. An alert is generated when the current course of action is likely to violate assurance criteria and the alert results in corrective action.…

At the port-of-entry containers are inspected through a specific sequence of sensor stations to detect the presence of nuclear materials, biological and chemical agents, and other illegal cargo. The inspection policy, which includes the…

Optimization and Control · Mathematics 2015-05-21 Christina M. Young , Mingyu Li , Yada Zhu , Minge Xie , Elsayed A. Elsayed , Tsvetan Asamov

In formal verification, runtime monitoring consists of observing the execution of a system in order to decide as quickly as possible whether or not it satisfies a given property. We consider monitoring in a distributed setting, for…

Software Engineering · Computer Science 2024-10-02 Léo Henry , Thierry Jéron , Nicolas Markey , Victor Roussanaly

Runtime monitoring is essential to ensure the safety of ML applications in safety-critical domains. However, current research is fragmented, with independent methods emerging from different communities. In this paper, we propose a unified…

Machine Learning · Computer Science 2026-04-30 Mathieu Dario , Florent Chenevier , Kévin Delmas , Joris Guerin , Jérémie Guiochet

Runtime enforcement refers to the theories, techniques, and tools for enforcing correct behavior with respect to a formal specification of systems at runtime. In this paper, we are interested in techniques for constructing runtime enforcers…

Artificial Intelligence · Computer Science 2022-08-31 Bettina Könighofer , Roderick Bloem , Rüdiger Ehlers , Christian Pek

There is a growing interest in the use of video sensor networks in surveillance applications in order to detect intruders with low cost. The essential concern of such networks is whether or not a specified target can pass or intrude the…

Cryptography and Security · Computer Science 2017-02-09 Jacques M. Bahi , Christophe Guyeux , Abdallah Makhoul , Congduc Pham

In the very last years, cybersecurity attacks have increased at an unprecedented pace, becoming ever more sophisticated and costly. Their impact has involved both private/public companies and critical infrastructures. At the same time, due…

Cryptography and Security · Computer Science 2023-09-25 Filippo Sobrero , Beatrice Clavarezza , Daniele Ucci , Federica Bisio

OpenAI (2025) showed that training against a chain of thought (CoT) monitor can cause obfuscated CoTs, which contain bad behavior the monitor cannot detect. They proposed to keep CoTs monitorable by training only against output monitors…

Machine Learning · Computer Science 2025-11-18 Jacob Drori , Luke Marks , Bryce Woodworth , Alex Cloud , Alexander Matt Turner

As AI systems become more capable and widely deployed as agents, ensuring their safe operation becomes critical. AI control offers one approach to mitigating the risk from untrusted AI agents by monitoring their actions and intervening or…

Artificial Intelligence · Computer Science 2025-11-06 Jon Kutasov , Chloe Loughridge , Yuqi Sun , Henry Sleight , Buck Shlegeris , Tyler Tracy , Joe Benton

We consider scenarios where a worker robot, who may be unaware of the human's exact expectations, may have the incentive to deviate from a preferred plan (e.g. safe but costly) when a human supervisor is not monitoring it. On the other…

Artificial Intelligence · Computer Science 2022-04-13 Zahra Zahedi , Sailik Sengupta , Subbarao Kambhampati