English
Related papers

Related papers: Safety-Constrained Learning and Control using Scar…

200 papers

In this work, an adaptive predictive control scheme for linear systems with unknown parameters and bounded additive disturbances is proposed. In contrast to related adaptive control approaches that robustly consider the parametric…

Systems and Control · Electrical Eng. & Systems 2025-03-03 Johannes Teutsch , Christopher Narr , Sebastian Kerz , Dirk Wollherr , Marion Leibold

This work studies the design of safe control policies for large-scale non-linear systems operating in uncertain environments. In such a case, the robust control framework is a principled approach to safety that aims to maximize the…

Systems and Control · Computer Science 2019-03-04 Edouard Leurent , Yann Blanco , Denis Efimov , Odalric-Ambrym Maillard

Modern nonlinear control theory seeks to endow systems with properties such as stability and safety, and has been deployed successfully across various domains. Despite this success, model uncertainty remains a significant challenge in…

Systems and Control · Electrical Eng. & Systems 2021-04-02 Andrew J. Taylor , Victor D. Dorobantu , Sarah Dean , Benjamin Recht , Yisong Yue , Aaron D. Ames

While reinforcement learning algorithms have had great success in the field of autonomous navigation, they cannot be straightforwardly applied to the real autonomous systems without considering the safety constraints. The later are crucial…

Robotics · Computer Science 2023-07-28 Brian Angulo , Gregory Gorbov , Aleksandr Panov , Konstantin Yakovlev

In this paper, we solve the problem of finding a certified control policy that drives a robot from any given initial state and under any bounded disturbance to the desired reference trajectory, with guarantees on the convergence or bounds…

Robotics · Computer Science 2020-11-26 Dawei Sun , Susmit Jha , Chuchu Fan

Offline Reinforcement learning is commonly used for sequential decision-making in domains such as healthcare and education, where the rewards are known and the transition dynamics $T$ must be estimated on the basis of batch data. A key…

Machine Learning · Computer Science 2023-08-10 Leo Benac , Sonali Parbhoo , Finale Doshi-Velez

Constrained reinforcement learning is to maximize the expected reward subject to constraints on utilities/costs. However, the training environment may not be the same as the test one, due to, e.g., modeling error, adversarial attack,…

Machine Learning · Computer Science 2022-09-16 Yue Wang , Fei Miao , Shaofeng Zou

This paper introduces a method of identifying a maximal set of safe strategies from data for stochastic systems with unknown dynamics using barrier certificates. The first step is learning the dynamics of the system via Gaussian process…

Machine Learning · Computer Science 2024-05-07 Rayan Mazouz , John Skovbekk , Frederik Baymler Mathiesen , Eric Frew , Luca Laurenti , Morteza Lahijanian

The applicability of reinforcement learning (RL) algorithms in real-world domains often requires adherence to safety constraints, a need difficult to address given the asymptotic nature of the classic RL optimization objective. In contrast…

Machine Learning · Computer Science 2021-04-15 Moritz A. Zanger , Karam Daaboul , J. Marius Zöllner

Control barrier certificates have proven effective in formally guaranteeing the safety of the control systems. However, designing a control barrier certificate is a time-consuming and computationally expensive endeavor that requires expert…

Systems and Control · Electrical Eng. & Systems 2024-05-28 Alireza Nadali , Ashutosh Trivedi , Majid Zamani

Learning-based control has recently shown great efficacy in performing complex tasks for various applications. However, to deploy it in real systems, it is of vital importance to guarantee the system will stay safe. Control Barrier…

Systems and Control · Electrical Eng. & Systems 2024-09-05 Fernando Castañeda , Jason J. Choi , Wonsuhk Jung , Bike Zhang , Claire J. Tomlin , Koushil Sreenath

This work proposed an efficient learning-based framework to learn feedback control policies from human teleoperated demonstrations, which achieved obstacle negotiation, staircase traversal, slipping control and parcel delivery for a tracked…

Robotics · Computer Science 2021-08-11 Jiacheng Gu , Zhibin Li

We propose a hierarchical learning architecture for predictive control in unknown environments. We consider a constrained nonlinear dynamical system and assume the availability of state-input trajectories solving control tasks in different…

Systems and Control · Electrical Eng. & Systems 2020-07-16 Charlott Vallon , Francesco Borrelli

Safe deployment of autonomous robots in diverse scenarios requires agents that are capable of efficiently adapting to new environments while satisfying constraints. In this work, we propose a practical and theoretically-justified approach…

Robotics · Computer Science 2022-02-17 Thomas Lew , Apoorva Sharma , James Harrison , Andrew Bylard , Marco Pavone

Guaranteeing safe behavior on complex autonomous systems -- from cars to walking robots -- is challenging due to the inherently high dimensional nature of these systems and the corresponding complex models that may be difficult to determine…

Systems and Control · Electrical Eng. & Systems 2023-03-07 Tamas G. Molnar , Aaron D. Ames

Learning to make decisions from observed data in dynamic environments remains a problem of fundamental importance in a number of fields, from artificial intelligence and robotics, to medicine and finance. This paper concerns the problem of…

Machine Learning · Statistics 2018-06-04 Jack Umenberger , Thomas B. Schön

Safety and stability are common requirements for robotic control systems; however, designing safe, stable controllers remains difficult for nonlinear and uncertain models. We develop a model-based learning approach to synthesize robust…

Systems and Control · Electrical Eng. & Systems 2021-10-08 Charles Dawson , Zengyi Qin , Sicun Gao , Chuchu Fan

Discovering the underlying dynamics of complex systems from data is an important practical topic. Constrained optimization algorithms are widely utilized and lead to many successes. Yet, such purely data-driven methods may bring about…

Dynamical Systems · Mathematics 2023-05-17 Nan Chen , Yinling Zhang

This paper presents a novel model-reference reinforcement learning control method for uncertain autonomous surface vehicles. The proposed control combines a conventional control method with deep reinforcement learning. With the conventional…

Systems and Control · Electrical Eng. & Systems 2021-06-17 Qingrui Zhang , Wei Pan , Vasso Reppa

Mobile robot navigation in dynamic human environments requires policies that balance adaptability to diverse behaviors with compliance to safety constraints. We hypothesize that integrating data-driven rewards with rule-based objectives…