English
Related papers

Related papers: MPC-based Reinforcement Learning for Economic Prob…

200 papers

In this paper, we present the use of Model Predictive Control (MPC) based on Reinforcement Learning (RL) to find the optimal policy for a multi-agent battery storage system. A time-varying prediction of the power price and production-demand…

Systems and Control · Electrical Eng. & Systems 2021-06-08 A. Bahari Kordabad , W. Cai , S. Gros

Model predictive control (MPC) is a powerful tool for controlling complex nonlinear systems under constraints, but often struggles with model uncertainties and the design of suitable cost functions. To address these challenges, we discuss…

Systems and Control · Electrical Eng. & Systems 2024-10-08 Sebastian Hirt , Andreas Höhl , Johannes Pohlodek , Joachim Schaeffer , Maik Pfefferkorn , Richard D. Braatz , Rolf Findeisen

Model predictive control (MPC) is pervasive in research and industry. However, designing the cost function and the constraints of the MPC to maximize closed-loop performance remains an open problem. To achieve optimal tuning, we propose a…

Optimization and Control · Mathematics 2024-12-02 Riccardo Zuliani , Efe C. Balta , John Lygeros

We consider the problem of optimal charging/discharging of a bank of heterogenous battery units, driven by stochastic electricity generation and demand processes. The batteries in the battery bank may differ with respect to their…

Machine Learning · Computer Science 2021-09-16 Vivek Deulkar , Jayakrishnan Nair

Model predictive control (MPC) is widely used in industries but implementing it poses challenges due to hardware or time constraints. A promising solution is to approximate the MPC policy using function approximators like neural networks.…

Optimization and Control · Mathematics 2026-05-08 Chenchen Zhou , Yi Cao , Shuang-hua Yang

Model Predictive Control has been recently proposed as policy approximation for Reinforcement Learning, offering a path towards safe and explainable Reinforcement Learning. This approach has been investigated for Q-learning and actor-critic…

Systems and Control · Electrical Eng. & Systems 2020-04-06 Sebastien Gros , Mario Zanon

Model predictive control (MPC) provides a useful means for controlling systems with constraints, but suffers from the computational burden of repeatedly solving an optimization problem in real time. Offline (explicit) solutions for MPC…

Systems and Control · Electrical Eng. & Systems 2022-09-14 Daniel Tabas , Baosen Zhang

The combination of policy search and deep neural networks holds the promise of automating a variety of decision-making tasks. Model Predictive Control (MPC) provides robust solutions to robot control tasks by making use of a dynamical model…

Robotics · Computer Science 2021-05-11 Yunlong Song , Davide Scaramuzza

In this paper we present a novel methodology for leveraging Receding Horizon Control (RHC), also known as Model Predictive Control (MPC) strategies for distributed battery storage in a planning problem using a Benders decomposition…

Systems and Control · Computer Science 2017-08-28 Philipp Fortenbacher , Andreas Ulbig , Göran Andersson

Markov Decision Processes (MDPs) offer a fairly generic and powerful framework to discuss the notion of optimal policies for dynamic systems, in particular when the dynamics are stochastic. However, computing the optimal policy of an MDP…

Systems and Control · Electrical Eng. & Systems 2024-07-24 Dirk Reinhardt , Akhil S. Anand , Shambhuraj Sawant , Sebastien Gros

Model Predictive Control (MPC) is an enabling technology in applications requiring controlling physical processes in an optimized way under constraints on inputs and outputs. However, in MPC closed-loop performance is pushed to the limits…

Optimization and Control · Mathematics 2019-05-06 Dario Piga , Marco Forgione , Simone Formentin , Alberto Bemporad

Model Predictive Control (MPC) has been demonstrated to be effective in continuous control tasks. When a world model and a value function are available, planning a sequence of actions ahead of time leads to a better policy. Existing methods…

Machine Learning · Computer Science 2025-04-07 Yuhang Wang , Hanwei Guo , Sizhe Wang , Long Qian , Xuguang Lan

Model predictive control (MPC) is an effective method for controlling robotic systems, particularly autonomous aerial vehicles such as quadcopters. However, application of MPC can be computationally demanding, and typically requires…

Machine Learning · Computer Science 2016-02-17 Tianhao Zhang , Gregory Kahn , Sergey Levine , Pieter Abbeel

Tuning parameters in model predictive control (MPC) presents significant challenges, particularly when there is a notable discrepancy between the controller's predictions and the actual behavior of the closed-loop plant. This mismatch may…

Systems and Control · Electrical Eng. & Systems 2024-10-11 Sebastian Hirt , Andreas Höhl , Joachim Schaeffer , Johannes Pohlodek , Richard D. Braatz , Rolf Findeisen

We propose and analyze a real-time model predictive control (MPC) scheme that utilizes stored data to improve its performance by learning the value function online with stability guarantees. For linear and nonlinear systems, a learning…

Optimization and Control · Mathematics 2020-09-23 Lukas Schwenkel , Meriem Gharbi , Sebastian Trimpe , Christian Ebenbauer

We present foundations for using Model Predictive Control (MPC) as a differentiable policy class for reinforcement learning in continuous state and action spaces. This provides one way of leveraging and combining the advantages of…

Machine Learning · Computer Science 2019-10-15 Brandon Amos , Ivan Dario Jimenez Rodriguez , Jacob Sacks , Byron Boots , J. Zico Kolter

Reinforcement learning (RL) and model predictive control (MPC) each offer distinct advantages and limitations when applied to control problems in power and energy systems. Despite various studies on these methods, benchmarks remain lacking…

Systems and Control · Electrical Eng. & Systems 2024-07-23 Mohamad Fares El Hajj Chehade , Young-ho Cho , Sandeep Chinchali , Hao Zhu

Model-based policy optimization often struggles with inaccurate system dynamics models, leading to suboptimal closed-loop performance. This challenge is especially evident in Model Predictive Control (MPC) policies, which rely on the model…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Riccardo Zuliani , Efe C. Balta , John Lygeros

We present a methodology to deploy the stochastic policy gradient method, using actor-critic techniques, when the optimal policy is approximated using a parametric optimization problem, allowing one to enforce safety via hard constraints.…

Systems and Control · Electrical Eng. & Systems 2024-09-23 Sebastien Gros , Mario Zanon

Reinforcement Learning (RL) has demonstrated a huge potential in learning optimal policies without any prior knowledge of the process to be controlled. Model Predictive Control (MPC) is a popular control technique which is able to deal with…

Systems and Control · Computer Science 2019-04-10 Mario Zanon , Sébastien Gros , Alberto Bemporad
‹ Prev 1 2 3 10 Next ›