English
Related papers

Related papers: Learning-Based Synthesis of Safety Controllers

200 papers

Finite turn-based safety games have been used for very different problems such as the synthesis of linear temporal logic (LTL), the synthesis of schedulers for computer systems running on multiprocessor platforms, and also for the…

Logic in Computer Science · Computer Science 2014-05-08 Gilles Geeraerts , Joël Goossens , Amélie Stainer

Designing hierarchical reinforcement learning algorithms that exhibit safe behaviour is not only vital for practical applications but also, facilitates a better understanding of an agent's decisions. We tackle this problem in the options…

Artificial Intelligence · Computer Science 2021-07-01 Arushi Jain , Khimya Khetarpal , Doina Precup

We consider the problem of synthesizing safe-by-design control strategies for semi-autonomous systems. Our aim is to address situations when safety cannot be guaranteed solely by the autonomous, controllable part of the system and a certain…

Systems and Control · Computer Science 2016-12-15 Jana Tumova , Dimos V. Dimarogonas

In typical reinforcement learning (RL), the environment is assumed given and the goal of the learning is to identify an optimal policy for the agent taking actions through its interactions with the environment. In this paper, we extend this…

Artificial Intelligence · Computer Science 2019-10-25 Haifeng Zhang , Jun Wang , Zhiming Zhou , Weinan Zhang , Ying Wen , Yong Yu , Wenxin Li

Designing controllers that accomplish tasks while guaranteeing safety constraints remains a significant challenge. We often want an agent to perform well in a nominal task, such as environment exploration, while ensuring it can avoid unsafe…

Systems and Control · Electrical Eng. & Systems 2025-06-04 Azra Begzadić , Nikhil Uday Shinde , Sander Tonkens , Dylan Hirsch , Kaleb Ugalde , Michael C. Yip , Jorge Cortés , Sylvia Herbert

Reinforcement learning algorithms discover policies that maximize reward, but do not necessarily guarantee safety during learning or execution phases. We introduce a new approach to learn optimal policies while enforcing properties…

Logic in Computer Science · Computer Science 2017-09-05 Mohammed Alshiekh , Roderick Bloem , Ruediger Ehlers , Bettina Könighofer , Scott Niekum , Ufuk Topcu

Amidst the growing demand for implementing advanced control and decision-making algorithms|to enhance the reliability, resilience, and stability of power systems|arises a crucial concern regarding the safety of employing machine learning…

Systems and Control · Electrical Eng. & Systems 2025-07-25 Amr S. Mohamed , Emily Nguyen , Deepa Kundur

Learning controllers merely based on a performance metric has been proven effective in many physical and non-physical tasks in both control theory and reinforcement learning. However, in practice, the controller must guarantee some notion…

Systems and Control · Electrical Eng. & Systems 2020-11-24 Arash Mehrjou , Mohammad Ghavamzadeh , Bernhard Schölkopf

We introduce a novel learning-based approach to synthesize safe and robust controllers for autonomous Cyber-Physical Systems and, at the same time, to generate challenging tests. This procedure combines formal methods for model verification…

Systems and Control · Electrical Eng. & Systems 2021-03-29 Luca Bortolussi , Francesca Cairoli , Ginevra Carbone , Francesco Franchina , Enrico Regolin

This paper introduces a sampling-based strategy synthesis algorithm for nondeterministic hybrid systems with complex continuous dynamics under temporal and reachability constraints. We model the evolution of the hybrid system as a…

Systems and Control · Electrical Eng. & Systems 2023-12-27 Qi Heng Ho , Zachary N. Sunberg , Morteza Lahijanian

Safe and optimal controller synthesis for switched-controlled hybrid systems, which combine differential equations and discrete changes of the system's state, is known to be intricately hard. Reinforcement learning has been leveraged to…

Logic in Computer Science · Computer Science 2023-12-15 Asger Horn Brorholt , Peter Gjøl Jensen , Kim Guldstrand Larsen , Florian Lorber , Christian Schilling

Safe reinforcement learning is a promising path toward applying reinforcement learning algorithms to real-world problems, where suboptimal behaviors may lead to actual negative consequences. In this work, we focus on the setting where…

Machine Learning · Computer Science 2022-02-17 Garrett Thomas , Yuping Luo , Tengyu Ma

Safety is one of the main challenges in applying reinforcement learning to realistic environmental tasks. To ensure safety during and after training process, existing methods tend to adopt overly conservative policy to avoid unsafe…

Machine Learning · Computer Science 2023-06-27 Xiao Zhang , Hai Zhang , Hongtu Zhou , Chang Huang , Di Zhang , Chen Ye , Junqiao Zhao

Multi-dimensional mean-payoff and energy games provide the mathematical foundation for the quantitative study of reactive systems, and play a central role in the emerging quantitative theory of verification and synthesis. In this work, we…

Computer Science and Game Theory · Computer Science 2014-11-04 Krishnendu Chatterjee , Mickael Randour , Jean-François Raskin

In this paper, we present a safe deep reinforcement learning system for automated driving. The proposed framework leverages merits of both rule-based and learning-based approaches for safety assurance. Our safety system consists of two…

Systems and Control · Electrical Eng. & Systems 2020-04-24 Ali Baheri , Subramanya Nageshrao , H. Eric Tseng , Ilya Kolmanovsky , Anouck Girard , Dimitar Filev

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

The steadily increasing level of automation in human-centred systems demands rigorous design methods for analysing and controlling interactions between humans and automated components, especially in safety-critical applications. The…

Human-Computer Interaction · Computer Science 2025-11-19 Mehrnoush Hajnorouzi , Astrid Rakow , Martin Fränzle

Synthesis from linear temporal logic (LTL) specifications provides assured controllers for systems operating in stochastic and potentially adversarial environments. Automatic synthesis tools, however, require a model of the environment to…

Artificial Intelligence · Computer Science 2026-04-07 Alper Kamil Bozkurt , Yu Wang , Michael M. Zavlanos , Miroslav Pajic

This paper presents a novel approach to learning from demonstration that enables robots to autonomously execute complex tasks in dynamic environments. We model latent tasks as probabilistic formal languages and introduce a tailored reactive…

Robotics · Computer Science 2026-01-12 Kandai Watanabe , Nicholas Renninger , Sriram Sankaranarayanan , Morteza Lahijanian

In this paper, a synergistic combination of deep reinforcement learning and hierarchical game theory is proposed as a modeling framework for behavioral predictions of drivers in highway driving scenarios. The need for a modeling framework…

Multiagent Systems · Computer Science 2020-03-26 Berat Mert Albaba , Yildiray Yildiz