English
Related papers

Related papers: Data-driven Economic NMPC using Reinforcement Lear…

200 papers

Reinforcement learning (RL) often necessitates a meticulous Markov Decision Process (MDP) design tailored to each task. This work aims to address this challenge by proposing a systematic approach to behavior synthesis and control for…

Robotics · Computer Science 2024-10-18 Jean-Pierre Sleiman , Mayank Mittal , Marco Hutter

In financial applications, reinforcement learning (RL) agents are commonly trained on historical data, where their actions do not influence prices. However, during deployment, these agents trade in live markets where their own transactions…

Machine Learning · Computer Science 2026-01-27 Shaocong Ma , Heng Huang

We propose an iterative approach for designing Robust Learning Model Predictive Control (LMPC) policies for a class of nonlinear systems with additive, unmodelled dynamics. The nominal dynamics are assumed to be difference flat, i.e., the…

Systems and Control · Electrical Eng. & Systems 2023-03-23 Siddharth H. Nair , Francesco Borrelli

Existing Maximum-Entropy (MaxEnt) Reinforcement Learning (RL) methods for continuous action spaces are typically formulated based on actor-critic frameworks and optimized through alternating steps of policy evaluation and policy…

Machine Learning · Computer Science 2024-10-29 Chen-Hao Chao , Chien Feng , Wei-Fang Sun , Cheng-Kuang Lee , Simon See , Chun-Yi Lee

The optimal dispatch of energy storage systems (ESSs) presents formidable challenges due to the uncertainty introduced by fluctuations in dynamic prices, demand consumption, and renewable-based energy generation. By exploiting the…

Systems and Control · Electrical Eng. & Systems 2023-07-27 Shengren Hou , Edgar Mauricio Salazar Duque , Peter Palensky , Pedro P. Vergara

In this paper we describe a new conceptual framework that connects approximate Dynamic Programming (DP), Model Predictive Control (MPC), and Reinforcement Learning (RL). This framework centers around two algorithms, which are designed…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Dimitri P. Bertsekas

We present differentiable predictive control (DPC), a method for learning constrained neural control policies for linear systems with probabilistic performance guarantees. We employ automatic differentiation to obtain direct policy…

Systems and Control · Electrical Eng. & Systems 2022-01-28 Jan Drgona , Aaron Tuor , Draguna Vrabie

We consider the problem of optimal trajectory tracking for unknown systems. A novel data-enabled predictive control (DeePC) algorithm is presented that computes optimal and safe control policies using real-time feedback driving the unknown…

Optimization and Control · Mathematics 2019-03-19 Jeremy Coulson , John Lygeros , Florian Dörfler

Initial DR studies mainly adopt model predictive control and thus require accurate models of the control problem (e.g., a customer behavior model), which are to a large extent uncertain for the EV scenario. Hence, model-free approaches,…

Machine Learning · Computer Science 2018-11-30 Nasrin Sadeghianpourhamami , Johannes Deleu , Chris Develder

Data-driven Model Predictive Control (MPC) has lately been the core research subject in the field of control theory. The combination of an optimal control framework with deep learning paradigms opens up the possibility to accurately track…

Systems and Control · Electrical Eng. & Systems 2026-04-17 Johannes Kübel , Henrik Krauss , Jinjie Li , Moju Zhao

Deriving precise system dynamic models through traditional numerical methods is often a challenging endeavor. The performance of Model Predictive Control is heavily contingent on the accuracy of the system dynamic model. Consequently, this…

Systems and Control · Electrical Eng. & Systems 2023-11-14 Shuai Niu , Qing Sun , Minrui Fei , Xuqian Ju

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots

We present a methodology to learn explicit Model Predictive Control (eMPC) laws from sample data points with tunable complexity. The learning process is cast in a special Neural Network setting where the coefficients of two linear layers…

Systems and Control · Electrical Eng. & Systems 2019-11-26 E. T. Maddalena , C. G. da S. Moraes , G. Waltrich , C. N. Jones

One of the main challenges in modern control applications, particularly in robot and vehicle motion control, is achieving accurate, fast, and safe movement. To address this, optimal control policies have been developed to enforce safety…

A supervised learning framework is proposed to approximate a model predictive controller (MPC) with reduced computational complexity and guarantees on stability and constraint satisfaction. The framework can be used for a wide class of…

Systems and Control · Computer Science 2018-06-13 Michael Hertneck , Johannes Köhler , Sebastian Trimpe , Frank Allgöwer

Data-enabled predictive control (DeePC) leverages system measurements in characterizing system dynamics for optimal control. The performance of DeePC relies on optimizing its hyperparameters, especially in noisy systems where the optimal…

Optimization and Control · Mathematics 2025-06-02 Jinbao Wang , Shiliang Zhang , Jun Liu , Xuehui Ma , Haolin Liu

Learning-based model predictive control (MPC) is an approach designed to reduce the computational cost of MPC. In this paper, a constrained deep neural network (DNN) design is proposed to learn MPC policy for nonlinear systems. Using…

Systems and Control · Electrical Eng. & Systems 2023-03-30 Farshid Asadi

Electronic Control Units (ECUs) have played a pivotal role in transforming motorcars of yore into the modern vehicles we see on our roads today. They actively regulate the actuation of individual components and thus determine the…

Machine Learning · Computer Science 2026-04-09 Andreas Kampmeier , Kevin Badalian , Lucas Koch , Sung-Yong Lee , Jakob Andert

This paper investigates the reinforcement learning (RL) based disturbance rejection control for uncertain nonlinear systems having non-simple nominal models. An extended state observer (ESO) is first designed to estimate the system state…

Dynamical Systems · Mathematics 2020-11-25 Maopeng Ran , Juncheng Li , Lihua Xie

Industrial embedded systems are typically used to execute simple control algorithms due to their low computational resources. Despite these limitations, the implementation of advanced control techniques such as Model Predictive Control…

Systems and Control · Electrical Eng. & Systems 2025-11-06 Victor Gracia , Pablo Krupa , Filiberto Fele , Teodoro Alamo