English
Related papers

Related papers: MPC4RL -- A Software Package for Reinforcement Lea…

200 papers

Economic model predictive control (EMPC) is a promising methodology for optimal operation of dynamical processes that has been shown to improve process economics considerably. However, EMPC performance relies heavily on the accuracy of the…

Systems and Control · Electrical Eng. & Systems 2021-05-10 Khalid Alhazmi , Fahad Albalawi , S. Mani Sarathy

In this work, we propose a novel learning-based model predictive control (MPC) framework for motion planning and control of urban self-driving. In this framework, instantaneous references and cost functions of online MPC are learned from…

Robotics · Computer Science 2024-02-29 Yubin Wang , Zengqi Peng , Yusen Xie , Yulin Li , Hakim Ghazzai , Jun Ma

We propose a hybrid reinforcement learning (RL) and model predictive control (MPC) framework for mixed-integer optimal control, where discrete variables enter the cost and dynamics but not the constraints. Existing hierarchical approaches…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Joschua Wüthrich , Romir Damle , Giona Fieni , Melanie N. Zeilinger , Christopher H. Onder , Andrea Carron

In control applications there is often a compromise that needs to be made with regards to the complexity and performance of the controller and the computational resources that are available. For instance, the typical hardware platform in…

Systems and Control · Electrical Eng. & Systems 2020-11-30 Eivind Bøhn , Sebastien Gros , Signe Moe , Tor Arne Johansen

In this paper, we leverage the rapid advances in imitation learning, a topic of intense recent focus in the Reinforcement Learning (RL) literature, to develop new sample complexity results and performance guarantees for data-driven Model…

Optimization and Control · Mathematics 2022-10-18 Kwangjun Ahn , Zakaria Mhammedi , Horia Mania , Zhang-Wei Hong , Ali Jadbabaie

State-of-the-art model-based Reinforcement Learning (RL) approaches either use gradient-free, population-based methods for planning, learned policy networks, or a combination of policy networks and planning. Hybrid approaches that combine…

Machine Learning · Computer Science 2026-05-25 Jonathan Spieler , Sven Behnke

Model Predictive Control (MPC) is attracting tremendous attention in the autonomous driving task as a powerful control technique. The success of an MPC controller strongly depends on an accurate internal dynamics model. However, the static…

Machine Learning · Computer Science 2023-04-28 Yuan Zhang , Joschka Boedecker , Chuxuan Li , Guyue Zhou

A key open challenge in agile quadrotor flight is how to combine the flexibility and task-level generality of model-free reinforcement learning (RL) with the structure and online replanning capabilities of model predictive control (MPC),…

Robotics · Computer Science 2026-01-21 Angel Romero , Elie Aljalbout , Yunlong Song , Davide Scaramuzza

Reinforcement learning (RL) and model predictive control (MPC) each offer distinct advantages and limitations when applied to control problems in power and energy systems. Despite various studies on these methods, benchmarks remain lacking…

Systems and Control · Electrical Eng. & Systems 2024-07-23 Mohamad Fares El Hajj Chehade , Young-ho Cho , Sandeep Chinchali , Hao Zhu

A common setting of reinforcement learning (RL) is a Markov decision process (MDP) in which the environment is a stochastic discrete-time dynamical system. Whereas MDPs are suitable in such applications as video-games or puzzles, physical…

Robotics · Computer Science 2022-11-29 Pavel Osinenko , Dmitrii Dobriborsci , Grigory Yaremenko , Georgiy Malaniya

Reinforcement Learning (RL) is a powerful tool to perform data-driven optimal control without relying on a model of the system. However, RL struggles to provide hard guarantees on the behavior of the resulting control scheme. In contrast,…

Systems and Control · Computer Science 2020-09-18 Sébastien Gros , Mario Zanon

We consider the problem of designing an algorithm to allow a car to autonomously merge on to a highway from an on-ramp. Two broad classes of techniques have been proposed to solve motion planning problems in autonomous driving: Model…

Robotics · Computer Science 2021-09-29 Joseph Lubars , Harsh Gupta , Sandeep Chinchali , Liyun Li , Adnan Raja , R. Srikant , Xinzhou Wu

Reinforcement learning (RL) is a versatile framework for optimizing long-term goals. Although many real-world problems can be formalized with RL, learning and deploying a performant RL policy requires a system designed to address several…

Modern engineering systems, such as autonomous vehicles, flexible robotics, and intelligent aerospace platforms, require controllers that are robust to uncertainties, adaptive to environmental changes, and safety-aware under real-time…

Robotics · Computer Science 2025-12-16 Patrick Kostelac , Xuerui Wang , Anahita Jamshidnejad

Cooperative control of groups of autonomous vehicles (AVs), i.e., platoons, is a promising direction to improving the efficiency of autonomous transportation systems. In this context, distributed co-optimization of both vehicle speed and…

Systems and Control · Electrical Eng. & Systems 2026-01-27 Samuel Mallick , Gianpietro Battocletti , Dimitris Boskos , Azita Dabiri , Bart De Schutter

Process control is widely discussed in the manufacturing process, especially for semiconductor manufacturing. Due to unavoidable disturbances in manufacturing, different process controllers are proposed to realize variation reduction. Since…

Systems and Control · Electrical Eng. & Systems 2021-10-25 Yanrong Li , Juan Du , Wei Jiang

Reinforcement learning (RL) and model predictive control (MPC) offer complementary strengths, yet combining them at scale remains computationally challenging. We propose soft MPCritic, an RL-MPC framework that learns in (soft) value space…

Machine Learning · Computer Science 2026-04-03 Thomas Banker , Nathan P. Lawrence , Ali Mesbah

The recent increase in data availability and reliability has led to a surge in the development of learning-based model predictive control (MPC) frameworks for robot systems. Despite attaining substantial performance improvements over their…

Robotics · Computer Science 2023-08-02 Kong Yao Chee , Thales C. Silva , M. Ani Hsieh , George J. Pappas

Model predictive control (MPC) is a powerful trajectory optimization control technique capable of controlling complex nonlinear systems while respecting system constraints and ensuring safe operation. The MPC's capabilities come at the cost…

Systems and Control · Electrical Eng. & Systems 2021-02-23 Eivind Bøhn , Sebastien Gros , Signe Moe , Tor Arne Johansen

PC-Gym is an open-source tool for developing and evaluating reinforcement learning (RL) algorithms in chemical process control. It features environments that simulate various chemical processes, incorporating nonlinear dynamics,…