English
Related papers

Related papers: Learning Decentralized Traffic Signal Controllers …

200 papers

Traditional traffic optimization solutions assume that the graph structure of road networks is static, missing opportunities for further traffic flow optimization. We are interested in optimizing traffic flows as a new type of graph-based…

Systems and Control · Electrical Eng. & Systems 2019-10-16 Udesh Gunarathna , Hairuo Xie , Egemen Tanin , Shanika Karunasekara , Renata Borovica-Gajic

This paper considers multi-agent reinforcement learning (MARL) in networked system control. Specifically, each agent learns a decentralized control policy based on local observations and messages from connected neighbors. We formulate such…

Machine Learning · Computer Science 2020-04-27 Tianshu Chu , Sandeep Chinchali , Sachin Katti

The growing complexity of urban mobility and the demand for efficient, sustainable, and adaptive solutions have positioned Intelligent Transportation Systems (ITS) at the forefront of modern infrastructure innovation. At the core of ITS…

Machine Learning · Computer Science 2026-03-06 Rexcharles Donatus , Kumater Ter , Daniel Udekwe

Urban traffic congestion presents a significant challenge for modern cities, which impacts mobility and sustainability. Traditional traffic light control systems often fail to adapt to dynamic conditions, leading to inefficiencies. This…

Machine Learning · Computer Science 2026-05-12 Matteo Cederle , Giacomo Scatto , Gian Antonio Susto

This paper addresses the challenge of decentralized task allocation within heterogeneous multi-agent systems operating under communication constraints. We introduce a novel framework that integrates graph neural networks (GNNs) with a…

Robotics · Computer Science 2025-02-21 Lavanya Ratnabala , Aleksey Fedoseev , Robinroy Peter , Dzmitry Tsetserukou

We consider the networked multi-agent reinforcement learning (MARL) problem in a fully decentralized setting, where agents learn to coordinate to achieve the joint success. This problem is widely encountered in many areas including traffic…

Machine Learning · Computer Science 2019-10-01 Chao Qu , Shie Mannor , Huan Xu , Yuan Qi , Le Song , Junwu Xiong

Multi-Agent Reinforcement Learning (MARL) is a challenging subarea of Reinforcement Learning due to the non-stationarity of the environments and the large dimensionality of the combined action space. Deep MARL algorithms have been applied…

Machine Learning · Computer Science 2021-07-27 Yuanchao Xu , Amal Feriani , Ekram Hossain

Accurate and real-time traffic state prediction is of great practical importance for urban traffic control and web mapping services. With the support of massive data, deep learning methods have shown their powerful capability in capturing…

Machine Learning · Computer Science 2023-09-07 Xunlian Luo , Chunjiang Zhu , Detian Zhang , Qing Li

Learning a world model for model-free Reinforcement Learning (RL) agents can significantly improve the sample efficiency by learning policies in imagination. However, building a world model for Multi-Agent RL (MARL) can be particularly…

Machine Learning · Computer Science 2025-09-03 Yang Zhang , Chenjia Bai , Bin Zhao , Junchi Yan , Xiu Li , Xuelong Li

Multi-agent reinforcement learning (MARL) requires coordination to efficiently solve certain tasks. Fully centralized control is often infeasible in such domains due to the size of joint action spaces. Coordination graph based formalization…

Machine Learning · Computer Science 2021-02-05 Sheng Li , Jayesh K. Gupta , Peter Morales , Ross Allen , Mykel J. Kochenderfer

We study real-time sampling and estimation of autoregressive Markovian sources in decentralized and dynamic multi-hop networks that share similar structures. Nodes cache neighboring samples and communicate over wireless collision channels.…

Signal Processing · Electrical Eng. & Systems 2026-01-21 Xingran Chen , Navid NaderiAlizadeh , Alejandro Ribeiro , Shirin Saeedi Bidokhti

Time-evolving traffic flow forecasting are playing a vital role in intelligent transportation systems and smart cities. However, the dynamic traffic flow forecasting is a highly nonlinear problem with complex temporal-spatial dependencies.…

Machine Learning · Computer Science 2025-08-05 Zhenan Lin , Yuni Lai , Wai Lun Lo , Richard Tai-Chiu Hsung , Harris Sik-Ho Tsang , Xiaoyu Xue , Kai Zhou , Yulin Zhu

Efforts in this paper seek to combine graph theory with adaptive dynamic programming (ADP) as a reinforcement learning (RL) framework to determine forward-in-time, real-time, approximate optimal controllers for distributed multi-agent…

Systems and Control · Computer Science 2017-07-25 Rushikesh Kamalapurkar , Huyen Dinh , Patrick Walters , Warren Dixon

Achieving distributed reinforcement learning (RL) for large-scale cooperative multi-agent systems (MASs) is challenging because: (i) each agent has access to only limited information; (ii) issues on convergence or computational complexity…

Machine Learning · Computer Science 2024-04-15 Gangshan Jing , He Bai , Jemin George , Aranya Chakrabortty , Piyush K. Sharma

Traffic signal control is of critical importance for the effective use of transportation infrastructures. The rapid increase of vehicle traffic and changes in traffic patterns make traffic signal control more and more challenging.…

Machine Learning · Computer Science 2021-12-08 Xingshuai Huang , Di Wu , Michael Jenkin , Benoit Boulet

Traffic signal control is a challenging real-world problem aiming to minimize overall travel time by coordinating vehicle movements at road intersections. Existing traffic signal control systems in use still rely heavily on oversimplified…

Artificial Intelligence · Computer Science 2022-08-09 Chi-Chun Chao , Jun-Wei Hsieh , Bor-Shiun Wang

Adaptive traffic signal control, which adjusts traffic signal timing according to real-time traffic, has been shown to be an effective method to reduce traffic congestion. Available works on adaptive traffic signal control make responsive…

Networking and Internet Architecture · Computer Science 2017-05-09 Juntao Gao , Yulong Shen , Jia Liu , Minoru Ito , Norio Shiratori

Traffic signal control is a critical challenge in urban transportation, requiring coordination among multiple intersections to optimize network-wide traffic flow. While reinforcement learning has shown promise for adaptive signal control,…

Machine Learning · Computer Science 2026-02-04 Haoran Su , Yandong Sun , Hanxiao Deng

Adaptive traffic signal control (ATSC) in urban traffic networks poses a challenging task due to the complicated dynamics arising in traffic systems. In recent years, several approaches based on multi-agent deep reinforcement learning…

Multiagent Systems · Computer Science 2021-07-07 Paolo Fazzini , Marco Torre , Valeria Rizza , Francesco Petracchini

A number of deep reinforcement-learning (RL) approaches propose to control traffic signals. In this work, we study the robustness of such methods along two axes. First, sensor failures and GPS occlusions create missing-data challenges and…

Machine Learning · Computer Science 2023-06-09 Tianyu Shi , Francois-Xavier Devailly , Denis Larocque , Laurent Charlin