English
Related papers

Related papers: On Building Myopic MPC Policies using Supervised L…

200 papers

Reinforcement learning can acquire complex behaviors from high-level specifications. However, defining a cost function that can be optimized effectively and encodes the correct task is challenging in practice. We explore how inverse optimal…

Machine Learning · Computer Science 2016-05-30 Chelsea Finn , Sergey Levine , Pieter Abbeel

Feedback control synthesis for large-scale particle systems is reviewed in the framework of model predictive control (MPC). The high-dimensional character of collective dynamics hampers the performance of traditional MPC algorithms based on…

Optimization and Control · Mathematics 2024-02-27 Giacomo Albi , Sara Bicego , Michael Herty , Yuyang Huang , Dante Kalise , Chiara Segala

We present an Imitation Learning approach for the control of dynamical systems with a known model. Our policy search method is guided by solutions from MPC. Typical policy search methods of this kind minimize a distance metric between the…

Robotics · Computer Science 2020-02-18 Jan Carius , Farbod Farshidian , Marco Hutter

Model predictive control (MPC) is a powerful trajectory optimization control technique capable of controlling complex nonlinear systems while respecting system constraints and ensuring safe operation. The MPC's capabilities come at the cost…

Systems and Control · Electrical Eng. & Systems 2021-02-23 Eivind Bøhn , Sebastien Gros , Signe Moe , Tor Arne Johansen

We introduce a constrained optimization method for policy gradient reinforcement learning, which uses a virtual trust region to regulate each policy update. In addition to using the proximity of one single old policy as the normal trust…

Machine Learning · Computer Science 2022-09-19 Hung Le , Thommen Karimpanal George , Majid Abdolshah , Dung Nguyen , Kien Do , Sunil Gupta , Svetha Venkatesh

We present differentiable predictive control (DPC) as a deep learning-based alternative to the explicit model predictive control (MPC) for unknown nonlinear systems. In the DPC framework, a neural state-space model is learned from…

Systems and Control · Electrical Eng. & Systems 2021-07-27 Jan Drgona , Karol Kis , Aaron Tuor , Draguna Vrabie , Martin Klauco

The problem of achieving a good trade-off in Stochastic Model Predictive Control between the competing goals of improving the average performance and reducing conservativeness, while still guaranteeing recursive feasibility and low…

Optimization and Control · Mathematics 2016-06-21 Matthias Lorenzen , Frank Allgöwer , Fabrizio Dabbene , Roberto Tempo

This paper proposes an off-line algorithm, called Recurrent Model Predictive Control (RMPC), to solve general nonlinear finite-horizon optimal control problems. Unlike traditional Model Predictive Control (MPC) algorithms, it can make full…

Systems and Control · Electrical Eng. & Systems 2021-02-24 Zhengyu Liu , Jingliang Duan , Wenxuan Wang , Shengbo Eben Li , Yuming Yin , Ziyu Lin , Qi Sun , Bo Cheng

Recent work in Offline Reinforcement Learning (RL) has shown that a unified Transformer trained under a masked auto-encoding objective can effectively capture the relationships between different modalities (e.g., states, actions, rewards)…

Machine Learning · Computer Science 2025-02-07 Kehan Wen , Yutong Hu , Yao Mu , Lei Ke

Imitation learning is a control design paradigm that seeks to learn a control policy reproducing demonstrations from expert agents. By substituting expert demonstrations for optimal behaviours, the same paradigm leads to the design of…

Machine Learning · Computer Science 2024-12-20 Dharmesh Tailor , Dario Izzo

We propose a computationally efficient Learning Model Predictive Control (LMPC) scheme for constrained optimal control of a class of nonlinear systems where the state and input can be reconstructed using lifted outputs. For the considered…

Optimization and Control · Mathematics 2021-01-19 Siddharth H. Nair , Ugo Rosolia , Francesco Borrelli

Offline reinforcement learning (RL) refers to the problem of learning policies entirely from a large batch of previously collected data. This problem setting offers the promise of utilizing such datasets to acquire policies without any…

Machine Learning · Computer Science 2020-11-24 Tianhe Yu , Garrett Thomas , Lantao Yu , Stefano Ermon , James Zou , Sergey Levine , Chelsea Finn , Tengyu Ma

We study the offline data-driven sequential decision making problem in the framework of Markov decision process (MDP). In order to enhance the generalizability and adaptivity of the learned policy, we propose to evaluate each policy by a…

Statistics Theory · Mathematics 2021-11-11 Zhengling Qi , Peng Liao

The cost of the power distribution infrastructures is driven by the peak power encountered in the system. Therefore, the distribution network operators consider billing consumers behind a common transformer in the function of their peak…

Systems and Control · Electrical Eng. & Systems 2022-04-01 Wenqi Cai , Hossein N. Esfahani , Arash B. Kordabad , Sébastien Gros

The recent increase in data availability and reliability has led to a surge in the development of learning-based model predictive control (MPC) frameworks for robot systems. Despite attaining substantial performance improvements over their…

Robotics · Computer Science 2023-08-02 Kong Yao Chee , Thales C. Silva , M. Ani Hsieh , George J. Pappas

Model-predictive-control (MPC) offers an optimal control technique to establish and ensure that the total operation cost of multi-energy systems remains at a minimum while fulfilling all system constraints. However, this method presumes an…

Model predictive control (MPC) is pervasive in research and industry. However, designing the cost function and the constraints of the MPC to maximize closed-loop performance remains an open problem. To achieve optimal tuning, we propose a…

Optimization and Control · Mathematics 2024-12-02 Riccardo Zuliani , Efe C. Balta , John Lygeros

Suboptimal model predictive control is a technique that can reduce the computational cost of model predictive control (MPC) by exploiting its robustness to incomplete optimization. Instead of solving the optimal control problem exactly,…

Systems and Control · Computer Science 2019-05-08 Dominic Liao-McPherson , Marco Nicotra , Ilya Kolmanovsky

In the realm of control systems, model predictive control (MPC) has exhibited remarkable potential; however, its reliance on accurate models and substantial computational resources has hindered its broader application, especially within…

Systems and Control · Electrical Eng. & Systems 2025-04-14 Amin Vahidi-Moghaddam , Kaian Chen , Kaixiang Zhang , Zhaojian Li , Yan Wang , Kai Wu

We study the budget allocation problem in online marketing campaigns that utilize previously collected offline data. We first discuss the long-term effect of optimizing marketing budget allocation decisions in the offline setting. To…

Machine Learning · Computer Science 2023-09-07 Tianchi Cai , Jiyan Jiang , Wenpeng Zhang , Shiji Zhou , Xierui Song , Li Yu , Lihong Gu , Xiaodong Zeng , Jinjie Gu , Guannan Zhang