English
Related papers

Related papers: Learning-based Model Predictive Control for Safe E…

200 papers

Learning has propelled the cutting edge of performance in robotic control to new heights, allowing robots to operate with high performance in conditions that were previously unimaginable. The majority of the work, however, assumes that the…

Robotics · Computer Science 2018-03-13 Christopher D. McKinnon , Angela P. Schoellig

This paper proposes a safe reinforcement learning (RL) framework based on forward-invariance-induced action-space design. The control problem is cast as a Markov decision process, but instead of relying on runtime shielding or penalty-based…

Systems and Control · Electrical Eng. & Systems 2026-04-10 Chieh Tsai , Muhammad Junayed Hasan Zahed , Salim Hariri , Hossein Rastgoftar

Reinforcement learning (RL) is a promising approach. However, success is limited to real-world applications, because ensuring safe exploration and facilitating adequate exploitation is a challenge for controlling robotic systems with…

Robotics · Computer Science 2022-08-29 Mingyu Cai , Cristian-Ioan Vasile

Soft robotic manipulators offer operational advantage due to their compliant and deformable structures. However, their inherently nonlinear dynamics presents substantial challenges. Traditional analytical methods often depend on simplifying…

Robotics · Computer Science 2024-10-28 Uljad Berdica , Matthew Jackson , Niccolò Enrico Veronese , Jakob Foerster , Perla Maiolino

Control tasks with safety requirements under high levels of model uncertainty are increasingly common. Machine learning techniques are frequently used to address such tasks, typically by leveraging model error bounds to specify robust…

Robotics · Computer Science 2025-06-13 Alexandre Capone , Ryan Cosner , Aaaron Ames , Sandra Hirche

Model-based reinforcement learning attempts to use an available or learned model to improve the data efficiency of reinforcement learning. This work proposes a one-step lookback approach that jointly learns the deep incremental model and…

Robotics · Computer Science 2025-02-28 Cong Li

The transfer of reinforcement learning (RL) techniques into real-world applications is challenged by safety requirements in the presence of physical limitations. Most RL methods, in particular the most popular algorithms, do not support…

Systems and Control · Computer Science 2021-05-18 Kim P. Wabersich , Melanie N. Zeilinger

In safety-critical applications, autonomous agents may need to learn in an environment where mistakes can be very costly. In such settings, the agent needs to behave safely not only after but also while learning. To achieve this, existing…

Machine Learning · Computer Science 2021-01-22 Matteo Turchetta , Andrey Kolobov , Shital Shah , Andreas Krause , Alekh Agarwal

Ensuring safety under unknown and stochastic dynamics remains a significant challenge in reinforcement learning (RL). In this paper, we propose a model predictive control (MPC)-based safe RL framework, called Probabilistic Ensembles with…

Systems and Control · Electrical Eng. & Systems 2026-04-09 Ali Umut Kaypak , Prashanth Krishnamurthy , Farshad Khorrami

Training sophisticated agents for optimal decision-making under uncertainty has been key to the rapid development of modern autonomous systems across fields. Notably, model-free reinforcement learning (RL) has enabled decision-making agents…

Machine Learning · Computer Science 2025-07-21 Thomas Banker , Ali Mesbah

Using reinforcement learning to learn control policies is a challenge when the task is complex with potentially long horizons. Ensuring adequate but safe exploration is also crucial for controlling physical systems. In this paper, we use…

Machine Learning · Computer Science 2019-03-26 Xiao Li , Calin Belta

This paper presents a novel approach to reinforcement learning (RL) for control systems that provides probabilistic stability guarantees using finite data. Leveraging Lyapunov's method, we propose a probabilistic stability theorem that…

Machine Learning · Computer Science 2026-03-03 Minghao Han , Lixian Zhang , Chenliang Liu , Zhipeng Zhou , Jun Wang , Wei Pan

Learning-based controllers are often purposefully kept out of real-world applications due to concerns about their safety and reliability. We explore how state-of-the-art world models in Model-Based Reinforcement Learning can be utilized…

Robotics · Computer Science 2025-03-05 Fabian Domberg , Georg Schildbach

Model predictive control allows to provide high performance and safety guarantees in the form of constraint satisfaction. These properties, however, can be satisfied only if the underlying model, used for prediction, of the controlled…

Systems and Control · Electrical Eng. & Systems 2021-02-25 Michael Maiworm , Daniel Limon , Rolf Findeisen

The discipline of automatic control is making increased use of concepts that originate from the domain of machine learning. Herein, reinforcement learning (RL) takes an elevated role, as it is inherently designed for sequential decision…

Systems and Control · Electrical Eng. & Systems 2024-12-04 Maximilian Schenke , Shalbus Bukarov

This paper studies the constrained/safe reinforcement learning (RL) problem with sparse indicator signals for constraint violations. We propose a model-based approach to enable RL agents to effectively explore the environment with unknown…

Artificial Intelligence · Computer Science 2021-03-09 Zuxin Liu , Hongyi Zhou , Baiming Chen , Sicheng Zhong , Martial Hebert , Ding Zhao

We study the problem of learning safe control policies that are also effective; i.e., maximizing the probability of satisfying a linear temporal logic (LTL) specification of a task, and the discounted reward capturing the (classic) control…

Robotics · Computer Science 2026-04-07 Alper Kamil Bozkurt , Yu Wang , Miroslav Pajic

When deploying machine learning algorithms in the real world, guaranteeing safety is an essential asset. Existing safe learning approaches typically consider continuous variables, i.e., regression tasks. However, in practice, robotic…

Machine Learning · Computer Science 2024-01-12 Dominik Baumann , Thomas B. Schön

Although recent model-free reinforcement learning algorithms have been shown to be capable of mastering complicated decision-making tasks, the sample complexity of these methods has remained a hurdle to utilizing them in many real-world…

Machine Learning · Computer Science 2020-04-21 Saeed Moazami , Peggy Doerschuk

We propose a computationally efficient Learning Model Predictive Control (LMPC) scheme for constrained optimal control of a class of nonlinear systems where the state and input can be reconstructed using lifted outputs. For the considered…

Optimization and Control · Mathematics 2021-01-19 Siddharth H. Nair , Ugo Rosolia , Francesco Borrelli