English
Related papers

Related papers: Residual MPC: Blending Reinforcement Learning with…

200 papers

In this paper, we present the use of Model Predictive Control (MPC) based on Reinforcement Learning (RL) to find the optimal policy for a multi-agent battery storage system. A time-varying prediction of the power price and production-demand…

Systems and Control · Electrical Eng. & Systems 2021-06-08 A. Bahari Kordabad , W. Cai , S. Gros

Reinforcement learning (RL) often necessitates a meticulous Markov Decision Process (MDP) design tailored to each task. This work aims to address this challenge by proposing a systematic approach to behavior synthesis and control for…

Robotics · Computer Science 2024-10-18 Jean-Pierre Sleiman , Mayank Mittal , Marco Hutter

Effective planning in model-based reinforcement learning (MBRL) and model-predictive control (MPC) relies on the accuracy of the learned dynamics model. In many instances of MBRL and MPC, this model is assumed to be stationary and is…

Machine Learning · Computer Science 2026-05-27 Yizhou Huang , Kevin Xie , Homanga Bharadhwaj , Florian Shkurti

The objective of this paper is to present a novel intelligent train control system for virtual coupling in railroads based on a Learning Model Predictive Control (LMPC). Virtual coupling is an emerging railroad technology that reduces the…

Optimization and Control · Mathematics 2025-07-04 Miguel A. Vaquero-Serrano , Francesco Borrelli , Jesus Felez

A robust Learning Model Predictive Controller (LMPC) for uncertain systems performing iterative tasks is presented. At each iteration of the control task the closed-loop state, input and cost are stored and used in the controller design.…

Systems and Control · Electrical Eng. & Systems 2021-07-06 Ugo Rosolia , Xiaojing Zhang , Francesco Borrelli

We study finite-horizon budget allocation as a closed-loop economic control problem and evaluate receding-horizon Model Predictive Control (MPC) relative to reactive budgeting policies. Budgets are allocated periodically under execution…

Systems and Control · Electrical Eng. & Systems 2026-05-01 Nilavra Pathak , Smriti Shyamal , Prasant Mhasker , Christopher Swartz

The efficient operation of greenhouses is essential for enhancing crop yield while minimizing energy costs. This paper investigates a control strategy that integrates Reinforcement Learning (RL) and Model Predictive Control (MPC) to…

Systems and Control · Electrical Eng. & Systems 2025-06-17 Salim Msaad , Murray Harraway , Robert D. McAllister

This work presents a distributed algorithm for resolving cooperative multi-vehicle conflicts in highly constrained spaces. By formulating the conflict resolution problem as a Multi-Agent Reinforcement Learning (RL) problem, we can train a…

Robotics · Computer Science 2023-02-06 Xu Shen , Francesco Borrelli

Recent work in Offline Reinforcement Learning (RL) has shown that a unified Transformer trained under a masked auto-encoding objective can effectively capture the relationships between different modalities (e.g., states, actions, rewards)…

Machine Learning · Computer Science 2025-02-07 Kehan Wen , Yutong Hu , Yao Mu , Lei Ke

While MPC enables nonlinear feedback control by solving an optimal control problem at each timestep, the computational burden tends to be significantly large, making it difficult to optimize a policy within the control period. To address…

Robotics · Computer Science 2024-10-10 Mitsuki Morita , Satoshi Yamamori , Satoshi Yagi , Norikazu Sugimoto , Jun Morimoto

Preference-based Reinforcement Learning (PbRL) provides a way to learn high-performance policies in environments where the reward signal is hard to specify, avoiding heuristic and time-consuming reward design. However, PbRL can suffer from…

Machine Learning · Computer Science 2025-07-02 Chenyang Cao , Miguel Rogel-García , Mohamed Nabail , Xueqian Wang , Nicholas Rhinehart

We develop a three-component Model Predictive Control (MPC) algorithm to achieve output-reference tracking with prescribed performance for continuous-time nonlinear systems. One component is so-called funnel MPC, which achieves reference…

Optimization and Control · Mathematics 2025-02-18 Lukas Lanza , Dario Dennstädt , Thomas Berger , Karl Worthmann

Sampling-based Model Predictive Control (MPC) is a flexible control framework that can reason about non-smooth dynamics and cost functions. Recently, significant work has focused on the use of machine learning to improve the performance of…

Robotics · Computer Science 2022-12-07 Jacob Sacks , Byron Boots

Model predictive control (MPC) is a popular control method that has proved effective for robotics, among other fields. MPC performs re-planning at every time step. Re-planning is done with a limited horizon per computational and real-time…

Robotics · Computer Science 2017-03-22 Aviv Tamar , Garrett Thomas , Tianhao Zhang , Sergey Levine , Pieter Abbeel

This paper presents a novel approach that combines the advantages of both model-based and learning-based frameworks to achieve robust locomotion. The residual modules are integrated with each corresponding part of the model-based framework,…

Robotics · Computer Science 2025-07-25 Min-Gyu Kim , Dongyun Kang , Hajun Kim , Hae-Won Park

Model predictive control (MPC) provides a useful means for controlling systems with constraints, but suffers from the computational burden of repeatedly solving an optimization problem in real time. Offline (explicit) solutions for MPC…

Systems and Control · Electrical Eng. & Systems 2022-09-14 Daniel Tabas , Baosen Zhang

How can a robot safely navigate around people with complex motion patterns? Deep Reinforcement Learning (DRL) in simulation holds some promise, but much prior work relies on simulators that fail to capture the nuances of real human motion.…

Robotics · Computer Science 2025-02-17 James R. Han , Hugues Thomas , Jian Zhang , Nicholas Rhinehart , Timothy D. Barfoot

The recent increase in data availability and reliability has led to a surge in the development of learning-based model predictive control (MPC) frameworks for robot systems. Despite attaining substantial performance improvements over their…

Robotics · Computer Science 2023-08-02 Kong Yao Chee , Thales C. Silva , M. Ani Hsieh , George J. Pappas

Model Predictive Control (MPC) is an optimal control algorithm with strong stability and robustness guarantees. Despite its popularity in robotics and industrial applications, the main challenge in deploying MPC is its high computation…

Systems and Control · Electrical Eng. & Systems 2024-12-31 Camilo Gonzalez , Houshyar Asadi , Lars Kooijman , Chee Peng Lim

Reinforcement learning (RL) has enabled advances in humanoid robot locomotion, yet most learning frameworks do not account for mechanical intelligence embedded in parallel actuation mechanisms due to limitations in simulator support for…

Robotics · Computer Science 2025-11-03 Yusuke Tanaka , Alvin Zhu , Quanyou Wang , Yeting Liu , Dennis Hong
‹ Prev 1 4 5 6 7 8 10 Next ›