English
Related papers

Related papers: Risk-Awareness in Learning Neural Controllers for …

200 papers

Control Barrier Functions (CBFs) provide an elegant framework for constraining nonlinear control system dynamics to remain within an invariant subset of a designated safe set. However, identifying a CBF that balances performance-by…

Machine Learning · Computer Science 2024-11-05 Lakshmideepakreddy Manda , Shaoru Chen , Mahyar Fazlyab

We present a novel method for imitation learning for control requirements expressed using Signal Temporal Logic (STL). More concretely we focus on the problem of training a neural network to imitate a complex controller. The learning…

Robotics · Computer Science 2024-03-26 Thao Dang , Alexandre Donzé , Inzemamul Haque , Nikolaos Kekatos , Indranil Saha

In this work, we present a novel robustness measure for continuous-time stochastic trajectories with respect to Signal Temporal Logic (STL) specifications. We show the soundness of the measure and develop a monitor for reasoning about…

Formal Languages and Automata Theory · Computer Science 2023-05-30 Roland B. Ilyes , Qi Heng Ho , Morteza Lahijanian

This paper addresses the problem of learning control policies for mobile robots, modeled as unknown Markov Decision Processes (MDPs), that are tasked with temporal logic missions, such as sequencing, coverage, or surveillance. The MDP…

Robotics · Computer Science 2022-07-13 Yiannis Kantaros

Signal Temporal Logic (STL) is expressive formal language that specifies spatio-temporal requirements in robotics. Its quantitative robustness semantics can be easily integrated with optimization-based control frameworks. However, STL…

Robotics · Computer Science 2026-03-10 Tianhao Wu , Yiwei Lyu

Learning reliably safe autonomous control is one of the core problems in trustworthy autonomy. However, training a controller that can be formally verified to be safe remains a major challenge. We introduce a novel approach for learning…

Machine Learning · Computer Science 2024-11-19 Junlin Wu , Huan Zhang , Yevgeniy Vorobeychik

Using control barrier functions (CBFs) as safety filters provides a computationally inexpensive yet effective method for constructing controllers in safety-critical applications. However, using CBFs requires the construction of a valid CBF,…

Systems and Control · Electrical Eng. & Systems 2024-02-15 Bolun Dai , Prashanth Krishnamurthy , Farshad Khorrami

A promising approach to optimal control of nonlinear systems involves iteratively linearizing the system and solving an optimization problem at each time instant to determine the optimal control input. Since this approach relies on online…

Optimization and Control · Mathematics 2025-01-30 Anran Li , John P. Swensen , Mehdi Hosseinzadeh

Signal Temporal Logic (STL) is a powerful framework for describing the complex temporal and logical behaviour of the dynamical system. Numerous studies have attempted to employ reinforcement learning to learn a controller that enforces STL…

Systems and Control · Electrical Eng. & Systems 2023-12-05 Naman Saxena , Gorantla Sandeep , Pushpak Jagtap

Reinforcement learning (RL) commonly relies on scalar rewards with limited ability to express temporal, conditional, or safety-critical goals, and can lead to reward hacking. Temporal logic expressible via the more general class of…

Artificial Intelligence · Computer Science 2025-11-26 Dominik Wagner , Leon Witzman , Luke Ong

Safe learning of control policies remains challenging, both in optimal control and reinforcement learning. In this article, we consider safe learning of parametrized predictive controllers that operate with incomplete information about the…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Sebastian Hirt , Maik Pfefferkorn , Rolf Findeisen

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

Robust controllers ensure stability in feedback loops designed under uncertainty but at the cost of performance. Model uncertainty in time-invariant systems can be reduced by recently proposed learning-based methods, which improve the…

Systems and Control · Electrical Eng. & Systems 2023-01-18 Alexander von Rohr , Friedrich Solowjow , Sebastian Trimpe

Recently, there has been a surge in interest in safe and robust techniques within reinforcement learning (RL). Current notions of risk in RL fail to capture the potential for systemic failures such as abrupt stoppages from system failures…

Systems and Control · Computer Science 2019-10-09 David Mguni

This study addresses the challenge of ensuring safe spacecraft proximity operations, focusing on collision avoidance between a chaser spacecraft and a complex-geometry target spacecraft under disturbances. To ensure safety in such…

Systems and Control · Electrical Eng. & Systems 2025-07-21 Hang Zhou , Tao Meng , Kun Wang , Chengrui Shi , Renhao Mao , Weijia Wang , Jiakun Lei

This work studies the planning problem for robotic systems under both quantifiable and unquantifiable uncertainty. The objective is to enable the robotic systems to optimally fulfill high-level tasks specified by Linear Temporal Logic (LTL)…

Robotics · Computer Science 2025-02-28 Pian Yu , Yong Li , David Parker , Marta Kwiatkowska

Control barrier functions (CBFs) have been demonstrated as an effective method for safety-critical control of autonomous systems. Although CBFs are simple to deploy, their design remains challenging, motivating the development of…

Robotics · Computer Science 2026-03-10 Bojan Derajić , Sebastian Bernhard , Wolfgang Hönig

The problem of safely learning and controlling a dynamical system - i.e., of stabilizing an originally (partially) unknown system while ensuring that it does not leave a prescribed 'safe set' - has recently received tremendous attention in…

Systems and Control · Electrical Eng. & Systems 2023-10-10 Jafar Abbaszadeh Chekan , Cedric Langbort

We study the constrained linear quadratic regulator with unknown dynamics, addressing the tension between safety and exploration in data-driven control techniques. We present a framework which allows for system identification through…

Optimization and Control · Mathematics 2019-07-09 Sarah Dean , Stephen Tu , Nikolai Matni , Benjamin Recht

A challenging problem for autonomous systems is to synthesize a reactive controller that conforms to a set of given correctness properties. Linear temporal logic (LTL) provides a formal language to specify the desired behavioral properties…

Formal Languages and Automata Theory · Computer Science 2019-10-08 Rayna Dimitrova , Mahsa Ghasemi , Ufuk Topcu