English
Related papers

Related papers: Model Predictive Control-Guided Reinforcement Lear…

200 papers

Reinforcement Learning (RL) is a method for learning decision-making tasks that could enable robots to learn and adapt to their situation on-line. For an RL algorithm to be practical for robotic control tasks, it must learn in very few…

Artificial Intelligence · Computer Science 2015-03-19 Todd Hester , Michael Quinlan , Peter Stone

Deep reinforcement learning (RL) has been endowed with high expectations in tackling challenging manipulation tasks in an autonomous and self-directed fashion. Despite the significant strides made in the development of reinforcement…

Robotics · Computer Science 2023-04-27 Zhenshan Bing , Aleksandr Mavrichev , Sicong Shen , Xiangtong Yao , Kejia Chen , Kai Huang , Alois Knoll

We propose an approach to design a Model Predictive Controller (MPC) for constrained Linear Time Invariant systems performing an iterative task. The system is subject to an additive disturbance, and the goal is to learn to satisfy state and…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Monimoy Bujarbaruah , Akhil Shetty , Kameshwar Poolla , Francesco Borrelli

We study unconstrained and constrained linear quadratic problems and investigate the suboptimality of the model predictive control (MPC) method applied to such problems. Considering MPC as an approximate scheme for solving the related fixed…

Optimization and Control · Mathematics 2023-06-06 Yuchao Li , Aren Karapetyan , John Lygeros , Karl H. Johansson , Jonas Mårtensson

Iterative learning control (ILC) improves the performance of a repetitive system by learning from previous trials. ILC can be combined with Model Predictive Control (MPC) to mitigate non-repetitive disturbances, thus improving overall…

Systems and Control · Electrical Eng. & Systems 2025-03-26 Riccardo Zuliani , Efe C. Balta , Alisa Rupenyan , John Lygeros

We present a model predictive control (MPC) formulation to directly optimize economic criteria for linear constrained systems subject to disturbances and uncertain model parameters. The proposed formulation combines a certainty equivalent…

Systems and Control · Electrical Eng. & Systems 2024-09-11 Maximilian Degner , Raffaele Soloperto , Melanie N. Zeilinger , John Lygeros , Johannes Köhler

One major issue in learning-based model predictive control (MPC) for autonomous driving is the contradiction between the system model's prediction accuracy and computation efficiency. The more situations a system model covers, the more…

Robotics · Computer Science 2023-04-11 Kang Zhao , Jianru Xue , Xiangning Meng , Gengxin Li , Mengsen Wu

In this paper, we introduce a new class of parameterized controllers, drawing inspiration from Model Predictive Control (MPC). The controller resembles a Quadratic Programming (QP) solver of a linear MPC problem, with the parameters of the…

Systems and Control · Electrical Eng. & Systems 2024-04-10 Yiwen Lu , Zishuo Li , Yihan Zhou , Na Li , Yilin Mo

We propose a demonstration-efficient strategy to compress a computationally expensive Model Predictive Controller (MPC) into a more computationally efficient representation based on a deep neural network and Imitation Learning (IL). By…

Robotics · Computer Science 2021-09-27 Andrea Tagliabue , Dong-Ki Kim , Michael Everett , Jonathan P. How

Model-based reinforcement learning (RL) has shown great promise due to its sample efficiency, but still struggles with long-horizon sparse-reward tasks, especially in offline settings where the agent learns from a fixed dataset. We…

Machine Learning · Computer Science 2024-05-17 Rohan Chitnis , Yingchen Xu , Bobak Hashemi , Lucas Lehnert , Urun Dogan , Zheqing Zhu , Olivier Delalleau

Partially-observable problems pose a trade-off between reducing costs and gathering information. They can be solved optimally by planning in belief space, but that is often prohibitively expensive. Model-predictive control (MPC) takes the…

Machine Learning · Computer Science 2023-04-21 Baris Kayalibay , Atanas Mirchev , Ahmed Agha , Patrick van der Smagt , Justin Bayer

In this paper, we present a robust adaptive model predictive control (MPC) scheme for linear systems subject to parametric uncertainty and additive disturbances. The proposed approach provides a computationally efficient formulation with…

Systems and Control · Electrical Eng. & Systems 2020-03-12 Johannes Köhler , Elisa Andina , Raffaele Soloperto , Matthias A. Müller , Frank Allgöwer

In this paper we present a framework for risk-sensitive model predictive control (MPC) of linear systems affected by stochastic multiplicative uncertainty. Our key innovation is to consider a time-consistent, dynamic risk evaluation of the…

Optimization and Control · Mathematics 2018-04-26 Sumeet Singh , Yin-Lam Chow , Anirudha Majumdar , Marco Pavone

This paper presents an uncertainty compensation-based robust adaptive model predictive control (MPC) framework for linear systems with both matched and unmatched nonlinear uncertainties subject to both state and input constraints. In…

Systems and Control · Electrical Eng. & Systems 2024-09-27 Ran Tao , Pan Zhao , Ilya Kolmanovsky , Naira Hovakimyan

We present a mechanism for socially efficient implementation of model predictive control (MPC) algorithms for load frequency control (LFC) in the presence of self-interested power generators. Specifically, we consider a situation in which…

Optimization and Control · Mathematics 2016-08-18 Takashi Tanaka , Vijay Gupta

In this paper, we propose a novel reference-free iterative learning model predictive control (MPC). In the proposed method, a certificate function based on the concept of Control Lyapunov Barrier Function (CLBF) is learned using data…

Systems and Control · Electrical Eng. & Systems 2025-07-21 Wataru Hashimoto , Kazumune Hashimoto , Masako Kishida , Shigemasa Takai

Portfolio management is a fundamental problem in finance. It involves periodic reallocations of assets to maximize the expected returns within an appropriate level of risk exposure. Deep reinforcement learning (RL) has been considered a…

Computational Finance · Quantitative Finance 2022-10-05 Hui Niu , Siyuan Li , Jian Li

Decarbonisation is driving dramatic growth in renewable power generation. This increases uncertainty in the load to be served by power plants and makes their efficient scheduling, known as the unit commitment (UC) problem, more difficult.…

Systems and Control · Electrical Eng. & Systems 2022-12-12 Cormac O'Malley , Patrick de Mars , Luis Badesa , Goran Strbac

Model predictive control (MPC) is a popular control method that has proved effective for robotics, among other fields. MPC performs re-planning at every time step. Re-planning is done with a limited horizon per computational and real-time…

Robotics · Computer Science 2017-03-22 Aviv Tamar , Garrett Thomas , Tianhao Zhang , Sergey Levine , Pieter Abbeel

A major challenge in modern reinforcement learning (RL) is efficient control of dynamical systems from high-dimensional sensory observations. Learning controllable embedding (LCE) is a promising approach that addresses this challenge by…

Machine Learning · Computer Science 2020-06-25 Brandon Cui , Yinlam Chow , Mohammad Ghavamzadeh