English
Related papers

Related papers: Learning Run-time Safety Monitors for Machine Lear…

200 papers

Development of new machine learning models is typically done on manually curated data sets, making them unsuitable for evaluating the models' performance during operations, where the evaluation needs to be performed automatically on…

Machine Learning · Computer Science 2021-10-15 Awalin Sopan , Konstantin Berlin

Deep Reinforcement Learning (DRL) has made significant advancements in various fields, such as autonomous driving, healthcare, and robotics, by enabling agents to learn optimal policies through interactions with their environments. However,…

Machine Learning · Computer Science 2026-02-06 Amirhossein Zolfagharian , Manel Abdellatif , Lionel C. Briand , Ramesh S

Given the widespread use of safety-critical applications in the automotive field, it is crucial to ensure the Functional Safety (FuSa) of circuits and components within automotive systems. The Analog and Mixed-Signal (AMS) circuits…

Machine learning (ML) algorithms generate a continuous stream of success stories from various domains and enable many novel applications in safety-critical systems. With the advent of autonomous driving, ML algorithms are being used in the…

Machine Learning · Computer Science 2021-01-20 Krystian Radlak , Michał Szczepankiewicz , Tim Jones , Piotr Serwa

Ensuring safety in autonomous systems with vision-based control remains a critical challenge due to the high dimensionality of image inputs and the fact that the relationship between true system state and its visual manifestation is…

Robotics · Computer Science 2025-11-12 Xinhang Ma , Junlin Wu , Hussein Sibai , Yiannis Kantaros , Yevgeniy Vorobeychik

Machine learning (ML) techniques are increasingly applied to decision-making and control problems in Cyber-Physical Systems among which many are safety-critical, e.g., chemical plants, robotics, autonomous vehicles. Despite the significant…

Systems and Control · Electrical Eng. & Systems 2019-09-12 Xiaozhe Gu , Arvind Easwaran

Machine learning algorithms increasingly influence our decisions and interact with us in all parts of our daily lives. Therefore, just as we consider the safety of power plants, highways, and a variety of other engineered socio-technical…

Computers and Society · Computer Science 2017-08-23 Kush R. Varshney , Homa Alemzadeh

The advent of end-to-end autonomy stacks - often lacking interpretable intermediate modules - has placed an increased burden on ensuring that the final output, i.e., the motion plan, is safe in order to validate the safety of the entire…

Distributed systems are notoriously difficult to understand and analyze in order to assert their correction w.r.t. given properties. They often exhibit a huge number of different behaviors, as soon as the active entities (peers, agents,…

Formal Languages and Automata Theory · Computer Science 2012-08-13 Volker Diekert , Anca Muscholl

Autonomous systems are emerging in many application domains. With the recent advancements in artificial intelligence and machine learning, sensor technology, perception algorithms and robotics, scenarios previously requiring strong human…

Cryptography and Security · Computer Science 2023-12-05 Mohammad Hamad , Sebastian Steinhorst

Machine learning sensors represent a paradigm shift for the future of embedded machine learning applications. Current instantiations of embedded machine learning (ML) suffer from complex integration, lack of modularity, and privacy and…

As Vision-Language Models (VLMs) demonstrate increasing capabilities across real-world applications such as code generation and chatbot assistance, ensuring their safety has become paramount. Unlike traditional Large Language Models (LLMs),…

Artificial Intelligence · Computer Science 2025-06-23 Peiyuan Tang , Haojie Xin , Xiaodong Zhang , Jun Sun , Qin Xia , Zijiang Yang

Mining is rapidly evolving into an AI driven cyber physical ecosystem where safety and operational reliability depend on robust perception, trustworthy distributed intelligence, and continuous monitoring of miners and equipment. However,…

Cryptography and Security · Computer Science 2026-02-13 Md Sazedur Rahman , Mizanur Rahman Jewel , Sanjay Madria

Machine learning models are widely recognized for their strong performance in forecasting. To keep that performance in streaming data settings, they have to be monitored and frequently re-trained. This can be done with machine learning…

Econometrics · Economics 2025-04-24 Yu Jeffrey Hu , Jeroen Rombouts , Ines Wilms

Medical Cyber-physical Systems (MCPS) are vulnerable to accidental or malicious faults that can target their controllers and cause safety hazards and harm to patients. This paper proposes a combined model and data-driven approach for…

Artificial Intelligence · Computer Science 2021-04-14 Xugui Zhou , Bulbul Ahmed , James H. Aylor , Philip Asare , Homa Alemzadeh

With increasingly sophisticated cyber-adversaries able to access a wider repertoire of mechanisms to implant malware such as ransomware, CPU/GPU keyloggers, and stealthy kernel rootkits, there is an urgent need for techniques to detect and…

Cryptography and Security · Computer Science 2025-01-23 Farshad Khorrami , Ramesh Karri , Prashanth Krishnamurthy

Autonomous vehicles require reliable hazard detection. However, primary sensor systems may miss near-field obstacles, resulting in safety risks. Although a dedicated fast-reacting near-field monitoring system can mitigate this, it typically…

Systems and Control · Electrical Eng. & Systems 2025-07-22 Junnan Pan , Prodromos Sotiriadis , Vladislav Nenchev , Ferdinand Englberger

This paper reports on the integration of runtime monitoring into fully-electric aircraft designed by Volocopter, a German aircraft manufacturer of electric multi-rotor helicopters. The runtime monitor recognizes hazardous situations and…

Software Engineering · Computer Science 2024-04-19 Jan Baumeister , Bernd Finkbeiner , Florian Kohn , Florian Löhr , Guido Manfredi , Sebastian Schirmer , Christoph Torens

Quality control is an essential operation in manufacturing, ensuring products meet the necessary standards of quality, safety, and reliability. Traditional methods, such as visual inspections, measurements, and statistical techniques, help…

Signal Processing · Electrical Eng. & Systems 2026-03-13 Sukumaran Rajasekaran , Ebru Turanoglu Bekar , Kanika Gandhi , Sabino Francesco Roselli , Mohan Rajashekarappa

LLM-based software engineering agents are increasingly used in real-world development tasks, often with access to sensitive data or security-critical codebases. Such agents could intentionally sabotage these codebases if they were…