English
Related papers

Related papers: A Hierarchical Signal Coordination and Control Sys…

200 papers

The effective and safe management of traffic is a key issue due to the rapid advancement of the urban transportation system. Connected autonomous vehicles (CAVs) possess the capability to connect with each other and adjacent infrastructure,…

Systems and Control · Electrical Eng. & Systems 2025-11-10 Rudra Sen , Subashish Datta

Decentralized Multi-Agent Reinforcement Learning (MARL) methods allow for learning scalable multi-agent policies, but suffer from partial observability and induced non-stationarity. These challenges can be addressed by introducing…

Machine Learning · Computer Science 2025-08-01 Tommaso Marzi , Cesare Alippi , Andrea Cini

Reinforcement learning (RL)-based adaptive cruise control systems (ACC) that learn and adapt to road, traffic and vehicle conditions are attractive for enhancing vehicle energy efficiency and traffic flow. However, the application of RL in…

Systems and Control · Electrical Eng. & Systems 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

Connected and automated vehicles (CAVs) have recently gained prominence in traffic research due to advances in communication technology and autonomous driving. Various longitudinal control strategies for CAVs have been developed to enhance…

Systems and Control · Electrical Eng. & Systems 2024-06-25 Jingyuan Zhou , Longhao Yan , Kaidi Yang

Platooning and coordination are two implementation strategies that are frequently proposed for traffic control of connected and autonomous vehicles (CAVs) at signal-free intersections instead of using conventional traffic signals. However,…

Machine Learning · Computer Science 2022-12-06 Duowei Li , Jianping Wu , Feng Zhu , Tianyi Chen , Yiik Diew Wong

Coordinating intersections in arterial networks is critical to the performance of urban transportation systems. Deep reinforcement learning (RL) has gained traction in traffic control research along with data-driven approaches for traffic…

Systems and Control · Electrical Eng. & Systems 2022-08-30 Keith Anshilo Diaz , Damian Dailisan , Umang Sharaf , Carissa Santos , Qijian Gan , Francis Aldrine Uy , May T. Lim , Alexandre M. Bayen

Recently, with the development of Multi-agent reinforcement learning (MARL), adaptive traffic signal control (ATSC) has achieved satisfactory results. In traffic scenarios with multiple intersections, MARL treats each intersection as an…

Machine Learning · Computer Science 2025-03-12 Kailing Zhou , Chengwei Zhang , Furui Zhan , Wanting Liu , Yihong Li

Model Predictive Control (MPC) provides interpretable, tunable locomotion controllers grounded in physical models, but its robustness depends on frequent replanning and is limited by model mismatch and real-time computational constraints.…

Robotics · Computer Science 2025-10-15 Se Hwan Jeon , Ho Jae Lee , Seungwoo Hong , Sangbae Kim

For autonomous vehicles, effective behavior planning is crucial to ensure safety of the ego car. In many urban scenarios, it is hard to create sufficiently general heuristic rules, especially for challenging scenarios that some new human…

Robotics · Computer Science 2020-11-11 Zhiqian Qiao , Jeff Schneider , John M. Dolan

Reinforcement learning (RL) has evolved into a widely investigated technology for the development of smart TSC strategies. However, current RL algorithms necessitate excessive interaction with the environment to learn effective policies,…

Machine Learning · Computer Science 2025-03-05 Qiang Li , Yinhan Lin , Qin Luo , Lina Yu

Wind farm wake steering optimization is challenging due to complex flow physics and changing conditions. This paper presents a hierarchical framework that combines reinforcement learning with model predictive control, where an RL agent…

Systems and Control · Electrical Eng. & Systems 2026-04-28 Marcus Binder Nilsen , Teodor Olof Benedict Åstrand , Tuhfe Göçmen , Pierre-Elouan Réthoré

Optimizing traffic signal control (TSC) at intersections continues to pose a challenging problem, particularly for large-scale traffic networks. It has been shown in past research that it is feasible to optimize the operations of individual…

Machine Learning · Computer Science 2021-10-13 Paul , Ha , Sikai Chen , Runjia Du , Samuel Labi

Multi-agent Deep Reinforcement Learning (MADRL) based traffic signal control becomes a popular research topic in recent years. To alleviate the scalability issue of completely centralized RL techniques and the non-stationarity issue of…

Artificial Intelligence · Computer Science 2023-09-08 Hankang Gu , Shangbo Wang , Xiaoguang Ma , Dongyao Jia , Guoqiang Mao , Eng Gee Lim , Cheuk Pong Ryan Wong

In traffic signal control, flow-based (optimizing the overall flow) and pressure-based methods (equalizing and alleviating congestion) are commonly used but often considered separately. This study introduces a unified framework using…

Systems and Control · Electrical Eng. & Systems 2024-01-18 Chaolun Ma , Bruce Wang , Zihao Li , Ahmadreza Mahmoudzadeh , Yunlong Zhang

Reinforcement learning (RL) constitutes a promising solution for alleviating the problem of traffic congestion. In particular, deep RL algorithms have been shown to produce adaptive traffic signal controllers that outperform conventional…

Machine Learning · Statistics 2019-07-23 Filipe Rodrigues , Carlos Lima Azevedo

We develop a hybrid control approach for robot learning based on combining learned predictive models with experience-based state-action policy mappings to improve the learning capabilities of robotic systems. Predictive models provide an…

Robotics · Computer Science 2020-06-09 Ian Abraham , Alexander Broad , Allison Pinosky , Brenna Argall , Todd D. Murphey

Automated driving at unsignalized intersections is challenging due to complex multi-vehicle interactions and the need to balance safety and efficiency. Model Predictive Control (MPC) offers structured constraint handling through…

Robotics · Computer Science 2026-04-16 Saeed Rahmani , Gözde Körpe , Zhenlin , Xu , Bruno Brito , Simeon Craig Calvert , Bart van Arem

This paper introduces a decentralized multi-agent reinforcement learning framework enabling structurally heterogeneous teams of agents to jointly discover and acquire randomly located targets in environments characterized by partial…

Robotics · Computer Science 2026-01-14 Gabriele Calzolari , Vidya Sumathy , Christoforos Kanellakis , George Nikolakopoulos

Managing mixed traffic comprising human-driven and robot vehicles (RVs) across large-scale networks presents unique challenges beyond single-intersection control. This paper proposes a reinforcement learning framework for coordinating mixed…

Machine Learning · Computer Science 2024-12-18 Iftekharul Islam , Weizi Li

Guaranteeing the quality of transit service is of great importance to promote the attractiveness of buses and alleviate urban traffic issues such as congestion and pollution. Emerging technologies of automated driving and V2X communication…

Optimization and Control · Mathematics 2021-02-11 Xiangdong Chen , Xi Lin , Meng Li , Fang He