English
Related papers

Related papers: Reinforcement Learning with Model Predictive Contr…

200 papers

Perimeter control maintains high traffic efficiency within protected regions by controlling transfer flows among regions to ensure that their traffic densities are below critical values. Existing approaches can be categorized as either…

Machine Learning · Computer Science 2023-06-01 Xiaocan Li , Ray Coden Mercurius , Ayal Taitler , Xiaoyu Wang , Mohammad Noaeen , Scott Sanner , Baher Abdulhai

We consider the ramp metering problem for a freeway stretch modeled by the Cell Transmission Model. Assuming perfect model knowledge and perfect traffic demand prediction, the ramp metering problem can be cast as a finite horizon optimal…

Optimization and Control · Mathematics 2017-10-26 Marius Schmitt , Chithrupa Ramesh , John Lygeros

This work proposes an approach that integrates reinforcement learning and model predictive control (MPC) to solve finite-horizon optimal control problems in mixed-logical dynamical systems efficiently. Optimization-based control of such…

Systems and Control · Electrical Eng. & Systems 2025-04-15 Caio Fabio Oliveira da Silva , Azita Dabiri , Bart De Schutter

Model Predictive Control (MPC) is a classic tool for optimal control of complex, real-world systems. Although it has been successfully applied to a wide range of challenging tasks in robotics, it is fundamentally limited by the prediction…

Robotics · Computer Science 2021-04-08 Nathan Hatch , Byron Boots

The deployment of Autonomous Vehicles (AVs) poses considerable challenges and unique opportunities for the design and management of future urban road infrastructure. In light of this disruptive transformation, the Right-Of-Way (ROW)…

Machine Learning · Computer Science 2023-03-23 Qiming Ye , Yuxiang Feng , Jose Javier Escribano Macias , Marc Stettler , Panagiotis Angeloudis

The decentralisation and unpredictability of new renewable energy sources require rethinking our energy system. Data-driven approaches, such as reinforcement learning (RL), have emerged as new control strategies for operating these systems,…

Optimization and Control · Mathematics 2023-07-11 Marine Cauz , Adrien Bolland , Bardhyl Miftari , Lionel Perret , Christophe Ballif , Nicolas Wyrsch

Large-scale ride-hailing systems often combine real-time routing at the individual request level with a macroscopic Model Predictive Control (MPC) optimization for dynamic pricing and vehicle relocation. The MPC relies on a demand forecast…

Artificial Intelligence · Computer Science 2021-11-08 Enpeng Yuan , Pascal Van Hentenryck

Traffic optimization challenges, such as load balancing, flow scheduling, and improving packet delivery time, are difficult online decision-making problems in wide area networks (WAN). Complex heuristics are needed for instance to find…

Networking and Internet Architecture · Computer Science 2021-12-01 Shan Sun , Mariam Kiran , Wei Ren

State of the art methods for target tracking with sensor management (or controlled sensing) are model-based and are obtained through solutions to Partially Observable Markov Decision Process (POMDP) formulations. In this paper a…

Signal Processing · Electrical Eng. & Systems 2024-07-22 Adarsh M. Subramaniam , Argyrios Gerogiannis , James Z. Hare , Venugopal V. Veeravalli

Reinforcement learning (RL) has recently been used for solving challenging decision-making problems in the context of automated driving. However, one of the main drawbacks of the presented RL-based policies is the lack of safety guarantees,…

Robotics · Computer Science 2021-07-16 Danial Kamran , Yu Ren , Martin Lauer

The random nature of traffic conditions on freeways can cause excessive congestions and irregularities in the traffic flow. Ramp metering is a proven effective method to maintain freeway efficiency under various traffic conditions. Creating…

Systems and Control · Electrical Eng. & Systems 2020-11-17 Anahita Sanandaji , Saeed Ghanbartehrani , Zahra Mokhtari , Kimia Tajik

In this paper, we investigate a hybrid scheme that combines nonlinear model predictive control (MPC) and model-based reinforcement learning (RL) for navigation planning of an autonomous model car across offroad, unstructured terrains…

Robotics · Computer Science 2023-10-03 Faraz Lotfi , Khalil Virji , Farnoosh Faraji , Lucas Berry , Andrew Holliday , David Meger , Gregory Dudek

Most reinforcement learning (RL) approaches for the decision-making of autonomous driving consider safety as a reward instead of a cost, which makes it hard to balance the tradeoff between safety and other objectives. Human risk preference…

Robotics · Computer Science 2025-03-05 Yang Li , Shijie Yuan , Yuan Chang , Xiaolong Chen , Qisong Yang , Zhiyuan Yang , Hongmao Qin

This paper presents a Predictive Maneuver Planning with Deep Reinforcement Learning (PMP-DRL) model for maneuver planning. Traditional rule-based maneuver planning approaches often have to improve their abilities to handle the variabilities…

In this paper we present a Learning Model Predictive Controller (LMPC) for autonomous racing. We model the autonomous racing problem as a minimum time iterative control task, where an iteration corresponds to a lap. In the proposed approach…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Ugo Rosolia , Francesco Borrelli

Connected vehicles will change the modes of future transportation management and organization, especially at an intersection without traffic light. Centralized coordination methods globally coordinate vehicles approaching the intersection…

Robotics · Computer Science 2021-03-12 Yang Guan , Yangang Ren , Shengbo Eben Li , Qi Sun , Laiquan Luo , Keqiang Li

Reinforcement Learning (RL) applications in real-world scenarios must prioritize safety and reliability, which impose strict constraints on agent behavior. Model-based RL leverages predictive world models for action planning and policy…

Artificial Intelligence · Computer Science 2025-06-06 Artem Latyshev , Gregory Gorbov , Aleksandr I. Panov

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency…

Machine Learning · Computer Science 2022-02-08 Renke Huang , Yujiao Chen , Tianzhixi Yin , Qiuhua Huang , Jie Tan , Wenhao Yu , Xinya Li , Ang Li , Yan Du

Over the years, reinforcement learning has emerged as a popular approach to develop signal control and vehicle platooning strategies either independently or in a hierarchical way. However, jointly controlling both in real-time to alleviate…

Machine Learning · Computer Science 2025-08-13 Xianyue Peng , Shenyang Chen , Hang Gao , Hao Wang , H. Michael Zhang

We develop reinforcement learning (RL) boundary controllers to mitigate stop-and-go traffic congestion on a freeway segment. The traffic dynamics of the freeway segment are governed by a macroscopic Aw-Rascle-Zhang (ARZ) model, consisting…

Optimization and Control · Mathematics 2021-01-18 Huan Yu , Saehong Park , Alexandre Bayen , Scott Moura , Miroslav Krstic