English
Related papers

Related papers: OffLight: An Offline Multi-Agent Reinforcement Lea…

200 papers

City-scale traffic signal control (TSC) involves thousands of heterogeneous intersections with varying topologies, making cooperative decision-making across intersections particularly challenging. Given the prohibitive computational cost of…

Systems and Control · Electrical Eng. & Systems 2025-08-07 Jinwei Zeng , Chao Yu , Xinyi Yang , Wenxuan Ao , Qianyue Hao , Jian Yuan , Yong Li , Yu Wang , Huazhong Yang

One of the main challenges in offline Reinforcement Learning (RL) is the distribution shift that arises from the learned policy deviating from the data collection policy. This is often addressed by avoiding out-of-distribution (OOD) actions…

Machine Learning · Computer Science 2023-11-07 Daiki E. Matsunaga , Jongmin Lee , Jaeseok Yoon , Stefanos Leonardos , Pieter Abbeel , Kee-Eung Kim

Autonomous driving has attracted significant research interests in the past two decades as it offers many potential benefits, including releasing drivers from exhausting driving and mitigating traffic congestion, among others. Despite…

Machine Learning · Computer Science 2024-01-08 Wei Zhou , Dong Chen , Jun Yan , Zhaojian Li , Huilin Yin , Wanchen Ge

Ramp merging is a critical and challenging task for autonomous vehicles (AVs), particularly in mixed traffic environments with human-driven vehicles (HVs). Existing approaches typically rely on either lane-changing or inter-vehicle gap…

Robotics · Computer Science 2025-11-20 Yassine Ibork , Myounggyu Won , Lokesh Das

Autonomous vehicles (AVs), possibly using Multi-Agent Reinforcement Learning (MARL) for simultaneous route optimization, may destabilize traffic networks, with human drivers potentially experiencing longer travel times. We study this…

Multiagent Systems · Computer Science 2025-06-17 Anastasia Psarou , Ahmet Onur Akman , Łukasz Gorczyca , Michał Hoffmann , Grzegorz Jamróz , Rafał Kucharski

Reinforcement learning (RL) has attracted increasing interest for adaptive traffic signal control due to its model-free ability to learn control policies directly from interaction with the traffic environment. However, several challenges…

Machine Learning · Computer Science 2026-03-17 Dickens Kwesiga , Angshuman Guin , Khaled Abdelghany , Michael Hunter

Traffic signal control (TSC) is a core challenge in urban mobility, where real-time decisions must balance efficiency and safety. Existing methods - ranging from rule-based heuristics to reinforcement learning (RL) - often struggle to…

Systems and Control · Electrical Eng. & Systems 2025-12-12 Maonan Wang , Yirong Chen , Aoyu Pang , Yuxin Cai , Chung Shue Chen , Yuheng Kan , Man-On Pun

Offline reinforcement learning (RL) seeks to learn optimal policies from static datasets without interacting with the environment. A common challenge is handling multi-modal action distributions, where multiple behaviours are represented in…

Machine Learning · Computer Science 2025-03-20 Mianchu Wang , Yue Jin , Giovanni Montana

This study integrates Transit Signal Priority (TSP) into multi-agent reinforcement learning (MARL) based traffic signal control. The first part of the study develops adaptive signal control based on MARL for a pair of coordinated…

Artificial Intelligence · Computer Science 2024-12-02 Dickness Kakitahi Kwesiga , Suyash Chandra Vishnoi , Angshuman Guin , Michael Hunter

Effective traffic signal control (TSC) is crucial in mitigating urban congestion and reducing emissions. Recently, reinforcement learning (RL) has been the research trend for TSC. However, existing RL algorithms face several real-world…

Systems and Control · Electrical Eng. & Systems 2025-09-30 Mingyuan Li , Jiahao Wang , Bo Du , Jun Shen , Qiang Wu

Multi-agent formation as well as obstacle avoidance is one of the most actively studied topics in the field of multi-agent systems. Although some classic controllers like model predictive control (MPC) and fuzzy control achieve a certain…

Systems and Control · Electrical Eng. & Systems 2021-11-16 Yuzi Yan , Xiaoxiang Li , Xinyou Qiu , Jiantao Qiu , Jian Wang , Yu Wang , Yuan Shen

Intelligent Traffic Light Control System (ITLCS) is a typical Multi-Agent System (MAS), which comprises multiple roads and traffic lights.Constructing a model of MAS for ITLCS is the basis to alleviate traffic congestion. Existing…

Machine Learning · Computer Science 2022-07-06 Ruijie Zhu , Lulu Li , Shuning Wu , Pei Lv , Yafai Li , Mingliang Xu

Cooperation among the traffic signals enables vehicles to move through intersections more quickly. Conventional transportation approaches implement cooperation by pre-calculating the offsets between two intersections. Such pre-calculated…

Multiagent Systems · Computer Science 2019-11-06 Hua Wei , Nan Xu , Huichu Zhang , Guanjie Zheng , Xinshi Zang , Chacha Chen , Weinan Zhang , Yanmin Zhu , Kai Xu , Zhenhui Li

Offline reinforcement learning (RL) represents a significant shift in RL research, allowing agents to learn from pre-collected datasets without further interaction with the environment. A key, yet underexplored, challenge in offline RL is…

Machine Learning · Computer Science 2025-02-27 Yiqin Yang , Quanwei Wang , Chenghao Li , Hao Hu , Chengjie Wu , Yuhua Jiang , Dianyu Zhong , Ziyou Zhang , Qianchuan Zhao , Chongjie Zhang , Xu Bo

This paper introduces MoveLight, a novel traffic signal control system that enhances urban traffic management through movement-centric deep reinforcement learning. By leveraging detailed real-time data and advanced machine learning…

Machine Learning · Computer Science 2024-07-25 Junqi Shao , Chenhao Zheng , Yuxuan Chen , Yucheng Huang , Rui Zhang

Reinforcement learning (RL) holds significant promise for adaptive traffic signal control. While existing RL-based methods demonstrate effectiveness in reducing vehicular congestion, their predominant focus on vehicle-centric optimization…

Machine Learning · Computer Science 2025-07-24 Bibek Poudel , Xuan Wang , Weizi Li , Lei Zhu , Kevin Heaslip

The goal of this work is to provide a viable solution based on reinforcement learning for traffic signal control problems. Although the state-of-the-art reinforcement learning approaches have yielded great success in a variety of domains,…

Machine Learning · Computer Science 2020-05-20 Yueh-Hua Wu , I-Hau Yeh , David Hu , Hong-Yuan Mark Liao

A number of deep reinforcement-learning (RL) approaches propose to control traffic signals. In this work, we study the robustness of such methods along two axes. First, sensor failures and GPS occlusions create missing-data challenges and…

Machine Learning · Computer Science 2023-06-09 Tianyu Shi , Francois-Xavier Devailly , Denis Larocque , Laurent Charlin

With wireless devices increasingly forming a unified smart network for seamless, user-friendly operations, random access (RA) medium access control (MAC) design is considered a key solution for handling unpredictable data traffic from…

Networking and Internet Architecture · Computer Science 2025-08-12 Myeung Suk Oh , Zhiyao Zhang , FNU Hairi , Alvaro Velasquez , Jia Liu

The optimal operation of transportation systems is often susceptible to unexpected disruptions. Many established control strategies reliant on mathematical models can struggle with real-world disruptions, leading to significant divergence…

Systems and Control · Electrical Eng. & Systems 2026-03-24 Linghang Sun , Michail A. Makridis , Alexander Genser , Cristian Axenie , Margherita Grossi , Anastasios Kouvelas