English
Related papers

Related papers: Temporal Difference Learning for Model Predictive …

200 papers

Recent advances in latent space dynamics model from pixels show promising progress in vision-based model predictive control (MPC). However, executing MPC in real time can be challenging due to its intensive computational cost in each…

Machine Learning · Computer Science 2023-02-07 Weiyao Wang , Marin Kobilarov , Gregory D. Hager

Temporal difference (TD) methods constitute a class of methods for learning predictions in multi-step prediction problems, parameterized by a recency factor lambda. Currently the most important application of these methods is to temporal…

Artificial Intelligence · Computer Science 2008-02-03 P. Cichosz

This paper presents a data-driven Model Predictive Control (MPC) for energy-efficient urban road driving for connected, automated vehicles. The proposed MPC aims to minimize total energy consumption by controlling the vehicle's longitudinal…

Systems and Control · Electrical Eng. & Systems 2024-07-30 Eunhyek Joa , Eric Yongkeun Choi , Francesco Borrelli

Recent success in deep reinforcement learning for continuous control has been dominated by model-free approaches which, unlike model-based approaches, do not suffer from representational limitations in making assumptions about the world…

Machine Learning · Computer Science 2019-05-07 Muhammad Burhan Hafez , Cornelius Weber , Matthias Kerzel , Stefan Wermter

Partially-observable problems pose a trade-off between reducing costs and gathering information. They can be solved optimally by planning in belief space, but that is often prohibitively expensive. Model-predictive control (MPC) takes the…

Machine Learning · Computer Science 2023-04-21 Baris Kayalibay , Atanas Mirchev , Ahmed Agha , Patrick van der Smagt , Justin Bayer

Inspired by the success of the Transformer architecture in natural language processing and computer vision, we investigate the use of Transformers in Reinforcement Learning (RL), specifically in modeling the environment's dynamics using…

Machine Learning · Computer Science 2024-11-19 Mostafa Kotb , Cornelius Weber , Muhammad Burhan Hafez , Stefan Wermter

Data-driven model predictive control (MPC) has demonstrated significant potential for improving robot control performance in the presence of model uncertainties. However, existing approaches often require extensive offline data collection…

Robotics · Computer Science 2025-10-10 Yu Mei , Xinyu Zhou , Shuyang Yu , Vaibhav Srivastava , Xiaobo Tan

Model-based reinforcement learning (RL) has shown great promise due to its sample efficiency, but still struggles with long-horizon sparse-reward tasks, especially in offline settings where the agent learns from a fixed dataset. We…

Machine Learning · Computer Science 2024-05-17 Rohan Chitnis , Yingchen Xu , Bobak Hashemi , Lucas Lehnert , Urun Dogan , Zheqing Zhu , Olivier Delalleau

Learning-based control methods typically assume stationary system dynamics, an assumption often violated in real-world systems due to drift, wear, or changing operating conditions. We study reinforcement learning for control under…

Machine Learning · Computer Science 2026-04-03 Klemens Iten , Bruce Lee , Chenhao Li , Lenart Treven , Andreas Krause , Bhavya Sukhija

An important issue in model-based control design is that an accurate dynamic model of the system is generally nonlinear, complex, and costly to obtain. This limits achievable control performance in practice. Gaussian process (GP) based…

Systems and Control · Electrical Eng. & Systems 2022-11-08 Yuhan Liu , Pengyu Wang , Roland Tóth

Model predictive control (MPC) is a powerful, optimization-based approach for controlling dynamical systems. However, the computational complexity of online optimization can be problematic on embedded devices. Especially, when we need to…

Controller design faces a trade-off between robustness and performance, and the reliability of linear controllers has caused many practitioners to focus on the former. However, there is renewed interest in improving system performance to…

Optimization and Control · Mathematics 2012-08-07 Anil Aswani , Humberto Gonzalez , S. Shankar Sastry , Claire Tomlin

Model Predictive Control (MPC) is a versatile approach capable of accommodating diverse control requirements that holds significant promise for a broad spectrum of industrial applications. Noteworthy challenges associated with MPC include…

Systems and Control · Electrical Eng. & Systems 2025-04-28 Ryuta Moriyasu , Sho Kawaguchi , Kenji Kashima

We consider the problem of data-driven predictive control for an unknown discrete-time linear time-periodic (LTP) system of known period. Our proposed strategy generalizes both Data-enabled Predictive Control (DeePC) and Subspace Predictive…

Systems and Control · Electrical Eng. & Systems 2022-09-13 Ruiqi Li , John W. Simpson-Porco , Stephen L. Smith

In this work, we propose a novel learning-based model predictive control (MPC) framework for motion planning and control of urban self-driving. In this framework, instantaneous references and cost functions of online MPC are learned from…

Robotics · Computer Science 2024-02-29 Yubin Wang , Zengqi Peng , Yusen Xie , Yulin Li , Hakim Ghazzai , Jun Ma

In this paper, we leverage the rapid advances in imitation learning, a topic of intense recent focus in the Reinforcement Learning (RL) literature, to develop new sample complexity results and performance guarantees for data-driven Model…

Optimization and Control · Mathematics 2022-10-18 Kwangjun Ahn , Zakaria Mhammedi , Horia Mania , Zhang-Wei Hong , Ali Jadbabaie

Model-based Reinforcement Learning (MBRL) allows data-efficient learning which is required in real world applications such as robotics. However, despite the impressive data-efficiency, MBRL does not achieve the final performance of…

Machine Learning · Computer Science 2019-08-19 Zhang-Wei Hong , Joni Pajarinen , Jan Peters

Data-enabled predictive control (DeePC) has emerged as a powerful technique to control complex systems without the need for extensive modeling efforts. However, relying solely on offline collected data trajectories to represent the system…

Systems and Control · Electrical Eng. & Systems 2025-08-06 Sebastian Zieglmeier , Mathias Hudoba de Badyn , Narada D. Warakagoda , Thomas R. Krogstad , Paal Engelstad

Model predictive control (MPC) has been applied to many platforms in robotics and autonomous systems for its capability to predict a system's future behavior while incorporating constraints that a system may have. To enhance the performance…

Robotics · Computer Science 2024-07-08 Ran Tao , Sheng Cheng , Xiaofeng Wang , Shenlong Wang , Naira Hovakimyan

Model Predictive Control (MPC) is a powerful control strategy for power electronics, but it highly relies on manually-derived and topology-specific analytical models, which is labor-intensive and time-consuming in practical designs. To…

Systems and Control · Electrical Eng. & Systems 2025-12-16 Jialin Zheng , Haoyu Wang , Yangbin Zeng , Han Xu , Di Mou , Hong Li , Patrick Wheeler , Sergio Vazquez , Leopoldo G. Franquelo