English
Related papers

Related papers: Learning-Based Synthesis of Safety Controllers

200 papers

The design of tracking controllers that closely follow a reference trajectory while ensuring safety and robustness against disturbances is a challenging problem in the control of autonomous systems. In this work, we propose a neural…

Systems and Control · Electrical Eng. & Systems 2025-12-01 Yuezhu Xu , Mohamed Serry , Jun Liu , S. Sivaranjani

This paper studies two important signal processing aspects of equilibrium behavior in non-cooperative games arising in social networks, namely, reinforcement learning and detection of equilibrium play. The first part of the paper presents a…

Computer Science and Game Theory · Computer Science 2015-01-07 Omid Namvar Gharehshiran , William Hoiles , Vikram Krishnamurthy

There is a growing interest in building autonomous systems that interact with complex environments. The difficulty associated with obtaining an accurate model for such environments poses a challenge to the task of assessing and guaranteeing…

Systems and Control · Electrical Eng. & Systems 2020-02-07 Yuxiao Chen , Sumanth Dathathri , Tung Phan-Minh , Richard M. Murray

Graph learning algorithms have attained state-of-the-art performance on many graph analysis tasks such as node classification, link prediction, and clustering. It has, however, become hard to track the field's burgeoning progress. One…

Machine Learning · Computer Science 2022-04-05 Anton Tsitsulin , Benedek Rozemberczki , John Palowitch , Bryan Perozzi

We consider the automatic online synthesis of black-box test cases from functional requirements specified as automata for reactive implementations. The goal of the tester is to reach some given state, so as to satisfy a coverage criterion,…

Artificial Intelligence · Computer Science 2024-07-30 Ocan Sankur , Thierry Jéron , Nicolas Markey , David Mentré , Reiya Noguchi

Model mismatches prevail in real-world applications. Ensuring safety for systems with uncertain dynamic models is critical. However, existing robust safe controllers may not be realizable when control limits exist. And existing methods use…

Robotics · Computer Science 2023-03-08 Tianhao Wei , Shucheng Kang , Weiye Zhao , Changliu Liu

This paper seeks to combine differential game theory with the actor-critic-identifier architecture to determine forward-in-time, approximate optimal controllers for formation tracking in multi-agent systems, where the agents have uncertain…

Systems and Control · Computer Science 2017-07-25 Rushikesh Kamalapurkar , Justin R. Klotz , Patrick Walters , Warren E. Dixon

Infinite-duration games with disturbances extend the classical framework of infinite-duration games, which captures the reactive synthesis problem, with a discrete measure of resilience against non-antagonistic external influence. This…

Computer Science and Game Theory · Computer Science 2020-07-09 Daniel Neider , Patrick Totzke , Martin Zimmermann

This paper studies a two-player game with a quantitative surveillance requirement on an adversarial target moving in a discrete state space and a secondary objective to maximize short-term visibility of the environment. We impose the…

Robotics · Computer Science 2019-11-19 Suda Bharadwaj , Louis Ly , Bo Wu , Richard Tsai , Ufuk Topcu

The ability to learn and execute optimal control policies safely is critical to realization of complex autonomy, especially where task restarts are not available and/or the systems are safety-critical. Safety requirements are often…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Moad Abudia , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

We present an approach for synthesizing reactive robot motion plans, based on compilation to Syntax-Guided Synthesis (SyGuS) specifications. Our method reduces the motion planning problem to the problem of synthesizing a function that can…

Programming Languages · Computer Science 2016-11-24 Sarah Chasins , Julie L. Newcomb

Graph games played by two players over finite-state graphs are central in many problems in computer science. In particular, graph games with $\omega$-regular winning conditions, specified as parity objectives, which can express properties…

Logic in Computer Science · Computer Science 2018-03-20 Tomáš Brázdil , Krishnendu Chatterjee , Jan Křetínský , Viktor Toman

Reinforcement learning (RL) has shown impressive success in exploring high-dimensional environments to learn complex tasks, but can often exhibit unsafe behaviors and require extensive environment interaction when exploration is…

Machine Learning · Computer Science 2021-09-22 Albert Wilcox , Ashwin Balakrishna , Brijen Thananjeyan , Joseph E. Gonzalez , Ken Goldberg

Decision-making for autonomous driving is challenging, considering the complex interactions among multiple traffic agents (e.g., autonomous vehicles (AVs), human drivers, and pedestrians) and the computational load needed to evaluate these…

Systems and Control · Electrical Eng. & Systems 2023-11-13 Mushuang Liu , Ilya Kolmanovsky , H. Eric Tseng , Suzhou Huang , Dimitar Filev , Anouck Girard

In this paper, we consider supervisory control of stochastic discrete event systems (SDESs) under linear temporal logic specifications. Applying the bounded synthesis, we reduce the supervisor synthesis into a problem of satisfying a safety…

Systems and Control · Electrical Eng. & Systems 2022-04-12 Ryohei Oura , Toshimitsu Ushio , Ami Sakakibara

Safe deployment of autonomous robots in diverse scenarios requires agents that are capable of efficiently adapting to new environments while satisfying constraints. In this work, we propose a practical and theoretically-justified approach…

Robotics · Computer Science 2022-02-17 Thomas Lew , Apoorva Sharma , James Harrison , Andrew Bylard , Marco Pavone

We introduce a class of learning problems where the agent is presented with a series of tasks. Intuitively, if there is relation among those tasks, then the information gained during execution of one task has value for the execution of…

Machine Learning · Computer Science 2012-09-06 Christos Dimitrakakis

Training a model-free reinforcement learning agent requires allowing the agent to sufficiently explore the environment to search for an optimal policy. In safety-constrained environments, utilizing unsupervised exploration or a non-optimal…

Artificial Intelligence · Computer Science 2024-08-05 Erfan Entezami , Mahsa Sahebdel , Dhawal Gupta

We propose a simple, practical and intuitive approach to improve the performance of a conventional controller in uncertain environments using deep reinforcement learning while maintaining safe operation. Our approach is motivated by the…

Systems and Control · Electrical Eng. & Systems 2021-10-07 Tom Staessens , Tom Lefebvre , Guillaume Crevecoeur

Reinforcement learning (RL) is a general framework for adaptive control, which has proven to be efficient in many domains, e.g., board games, video games or autonomous vehicles. In such problems, an agent faces a sequential decision-making…

Machine Learning · Computer Science 2020-06-16 Olivier Buffet , Olivier Pietquin , Paul Weng