English
Related papers

Related papers: On Building Myopic MPC Policies using Supervised L…

200 papers

Reinforcement Learning (RL) has demonstrated a huge potential in learning optimal policies without any prior knowledge of the process to be controlled. Model Predictive Control (MPC) is a popular control technique which is able to deal with…

Systems and Control · Computer Science 2019-04-10 Mario Zanon , Sébastien Gros , Alberto Bemporad

A robust adaptive model predictive control (MPC) algorithm is presented for linear, time invariant systems with unknown dynamics and subject to bounded measurement noise. The system is characterized by an impulse response model, which is…

Systems and Control · Electrical Eng. & Systems 2019-11-21 Anilkumar Parsi , Andrea Iannelli , Mingzhou Yin , Mohammad Khosravi , Roy S. Smith

Model predictive control (MPC) is a method to formulate the optimal scheduling problem for grid flexibilities in a mathematical manner. The resulting time-constrained optimization problem can be re-solved in each optimization time step…

Systems and Control · Electrical Eng. & Systems 2021-08-20 Steven de Jongh , Sina Steinle , Anna Hlawatsch , Felicitas Mueller , Michael Suriyah , Thomas Leibfried

Reinforcement learning (RL) and model predictive control (MPC) offer complementary strengths, yet combining them at scale remains computationally challenging. We propose soft MPCritic, an RL-MPC framework that learns in (soft) value space…

Machine Learning · Computer Science 2026-04-03 Thomas Banker , Nathan P. Lawrence , Ali Mesbah

In control applications there is often a compromise that needs to be made with regards to the complexity and performance of the controller and the computational resources that are available. For instance, the typical hardware platform in…

Systems and Control · Electrical Eng. & Systems 2020-11-30 Eivind Bøhn , Sebastien Gros , Signe Moe , Tor Arne Johansen

Model predictive control (MPC) is a popular control method that has proved effective for robotics, among other fields. MPC performs re-planning at every time step. Re-planning is done with a limited horizon per computational and real-time…

Robotics · Computer Science 2017-03-22 Aviv Tamar , Garrett Thomas , Tianhao Zhang , Sergey Levine , Pieter Abbeel

While MPC enables nonlinear feedback control by solving an optimal control problem at each timestep, the computational burden tends to be significantly large, making it difficult to optimize a policy within the control period. To address…

Robotics · Computer Science 2024-10-10 Mitsuki Morita , Satoshi Yamamori , Satoshi Yagi , Norikazu Sugimoto , Jun Morimoto

Model predictive control (MPC) is a powerful technique for solving dynamic control tasks. In this paper, we show that there exists a close connection between MPC and online learning, an abstract theoretical framework for analyzing online…

Robotics · Computer Science 2019-10-10 Nolan Wagener , Ching-An Cheng , Jacob Sacks , Byron Boots

Optimal control provides a principled framework for transforming dynamical system models into intelligent decision-making, yet classical computational approaches are often too expensive for real-time deployment in dynamic or uncertain…

Optimization and Control · Mathematics 2026-01-01 Wuzhe Xu , Jiequn Han , Rongjie Lai

We propose a plan online and learn offline (POLO) framework for the setting where an agent, with an internal model, needs to continually act and learn in the world. Our work builds on the synergistic relationship between local model-based…

Machine Learning · Computer Science 2019-01-29 Kendall Lowrey , Aravind Rajeswaran , Sham Kakade , Emanuel Todorov , Igor Mordatch

Model Predictive Control (MPC) is a successful control methodology, which is applied to increasingly complex systems. However, real-time feasibility of MPC can be challenging for complex systems, certainly when an (extremely) large number…

Systems and Control · Electrical Eng. & Systems 2024-10-25 S. A. N. Nouwens , B. de Jager , M. M. Paulides , W. P. M. H. Heemels

Many robotics domains use some form of nonconvex model predictive control (MPC) for planning, which sets a reduced time horizon, performs trajectory optimization, and replans at every step. The actual task typically requires a much longer…

Robotics · Computer Science 2021-06-11 Avik Jain , Lawrence Chan , Daniel S. Brown , Anca D. Dragan

A dual adaptive model predictive control (MPC) algorithm is presented for linear, time-invariant systems subject to bounded disturbances and parametric uncertainty in the state-space matrices. Online set-membership identification is…

Systems and Control · Electrical Eng. & Systems 2021-02-23 Anilkumar Parsi , Andrea Iannelli , Roy S. Smith

This paper shows that the optimal policy and value functions of a Markov Decision Process (MDP), either discounted or not, can be captured by a finite-horizon undiscounted Optimal Control Problem (OCP), even if based on an inexact model.…

Systems and Control · Electrical Eng. & Systems 2023-02-08 Arash Bahari Kordabad , Mario Zanon , Sebastien Gros

Offline model-based optimization (MBO) seeks to discover high-performing designs using only a fixed dataset of past evaluations. Most existing methods rely on learning a surrogate model via regression and implicitly assume that good…

Machine Learning · Computer Science 2026-03-05 Shen-Huan Lyu , Rong-Xi Tan , Ke Xue , Yi-Xiao He , Yu Huang , Qingfu Zhang , Chao Qian

Learning-based model predictive control (MPC) is an approach designed to reduce the computational cost of MPC. In this paper, a constrained deep neural network (DNN) design is proposed to learn MPC policy for nonlinear systems. Using…

Systems and Control · Electrical Eng. & Systems 2023-03-30 Farshid Asadi

Model predictive control (MPC) achieves stability and constraint satisfaction for general nonlinear systems, but requires computationally expensive online optimization. This paper studies approximations of such MPC controllers via neural…

Systems and Control · Electrical Eng. & Systems 2025-11-07 Henrik Hose , Johannes Köhler , Melanie N. Zeilinger , Sebastian Trimpe

We study the problem of online learning in predictive control of an unknown linear dynamical system with time varying cost functions which are unknown apriori. Specifically, we study the online learning problem where the control algorithm…

Machine Learning · Computer Science 2022-11-01 Deepan Muthirayan , Jianjun Yuan , Dileep Kalathil , Pramod P. Khargonekar

Learning-based predictive control is a promising alternative to optimization-based MPC. However, efficiently learning the optimal control policy, the optimal value function, or the Q-function requires suitable function approximators. Often,…

Systems and Control · Electrical Eng. & Systems 2023-04-14 Dieter Teichrib , Moritz Schulze Darup

The reinforcement learning (RL) and model predictive control (MPC) communities have developed vast ecosystems of theoretical approaches and computational tools for solving optimal control problems. Given their conceptual similarities but…

Machine Learning · Computer Science 2025-09-04 Nathan P. Lawrence , Thomas Banker , Ali Mesbah