English
Related papers

Related papers: TSC: Topology-Conditioned Stackelberg Coordination…

200 papers

Finding the optimal signal timing strategy is a difficult task for the problem of large-scale traffic signal control (TSC). Multi-Agent Reinforcement Learning (MARL) is a promising method to solve this problem. However, there is still room…

Machine Learning · Computer Science 2021-09-14 Xiaoqiang Wang , Liangjun Ke , Zhimin Qiao , Xinghua Chai

Connected and autonomous vehicles across land, water, and air must often operate in dynamic, unpredictable environments with limited communication, no centralized control, and partial observability. These real-world constraints pose…

Multiagent Systems · Computer Science 2025-11-18 Hung Du , Hy Nguyen , Srikanth Thudumu , Rajesh Vasa , Kon Mouzakis

Adaptive traffic signal control (ATSC) is crucial in alleviating congestion, maximizing throughput and promoting sustainable mobility in ever-expanding cities. Multi-Agent Reinforcement Learning (MARL) has recently shown significant…

Machine Learning · Computer Science 2026-03-26 Yifeng Zhang , Harsh Goel , Peizhuo Li , Mehul Damani , Sandeep Chinchali , Guillaume Sartoretti

Communication technologies enable coordination among connected and autonomous vehicles (CAVs). However, it remains unclear how to utilize shared information to improve the safety and efficiency of the CAV system in dynamic and complicated…

Robotics · Computer Science 2023-03-15 Zhili Zhang , Songyang Han , Jiangwei Wang , Fei Miao

Efficient traffic control (TSC) is essential for urban mobility, but traditional systems struggle to handle the complexity of real-world traffic. Multi-agent Reinforcement Learning (MARL) offers adaptive solutions, but online MARL requires…

Artificial Intelligence · Computer Science 2025-03-19 Rohit Bokade , Xiaoning Jin

Ensuring safety in MARL, particularly when deploying it in real-world applications such as autonomous driving, emerges as a critical challenge. To address this challenge, traditional safe MARL methods extend MARL approaches to incorporate…

Robotics · Computer Science 2024-05-29 Zhi Zheng , Shangding Gu

Reinforcement learning (RL) emerges as a promising data-driven approach for adaptive traffic signal control (ATSC) in complex urban traffic networks, with deep neural networks substantially augmenting its learning capabilities. However,…

Artificial Intelligence · Computer Science 2025-02-25 Yuli Zhang , Shangbo Wang , Dongyao Jia , Pengfei Fan , Ruiyuan Jiang , Hankang Gu , Andy H. F. Chow

Multi-Agent Reinforcement Learning (MARL) presents a promising approach for addressing the complexity of Traffic Signal Control (TSC) in urban environments. However, existing platforms for MARL-based TSC research face challenges such as…

Multiagent Systems · Computer Science 2024-10-25 Rohit Bokade , Xiaoning Jin

Reinforcement learning (RL) for traffic signal control (TSC) has shown better performance in simulation for controlling the traffic flow of intersections than conventional approaches. However, due to several challenges, no RL-based TSC has…

Machine Learning · Computer Science 2022-06-22 Arthur Müller , Matthia Sabatelli

Multi-Agent Reinforcement Learning (MARL) has emerged as a foundational approach for addressing diverse, intelligent control tasks in various scenarios like the Internet of Vehicles, Internet of Things, and Unmanned Aerial Vehicles.…

Multiagent Systems · Computer Science 2024-10-15 Xiaoxue Yu , Rongpeng Li , Chengchao Liang , Zhifeng Zhao

Connected and autonomous vehicles (CAVs) promise next-gen transportation systems with enhanced safety, energy efficiency, and sustainability. One typical control strategy for CAVs is the so-called cooperative adaptive cruise control (CACC)…

Systems and Control · Electrical Eng. & Systems 2024-02-20 Dong Chen , Kaixiang Zhang , Yongqiang Wang , Xunyuan Yin , Zhaojian Li , Dimitar Filev

Traffic congestion, primarily driven by intersection queuing, significantly impacts urban living standards, safety, environmental quality, and economic efficiency. While Traffic Signal Control (TSC) systems hold potential for congestion…

Machine Learning · Computer Science 2026-01-14 Qiang Li , Jin Niu , Lina Yu

This work explores the large-scale multi-agent communication mechanism under a multi-agent reinforcement learning (MARL) setting. We summarize the general categories of topology for communication structures in MARL literature, which are…

Machine Learning · Computer Science 2020-02-12 Junjie Sheng , Xiangfeng Wang , Bo Jin , Junchi Yan , Wenhao Li , Tsung-Hui Chang , Jun Wang , Hongyuan Zha

In this thesis, I propose a family of fully decentralized deep multi-agent reinforcement learning (MARL) algorithms to achieve high, real-time performance in network-level traffic signal control. In this approach, each intersection is…

Machine Learning · Computer Science 2020-07-21 Jin Guo

Several studies have employed reinforcement learning (RL) to address the challenges of regional adaptive traffic signal control (ATSC) and achieved promising results. In this field, existing research predominantly adopts multi-agent…

Artificial Intelligence · Computer Science 2026-01-14 Qiang Li , Ningjing Zeng , Lina Yu

With wireless devices increasingly forming a unified smart network for seamless, user-friendly operations, random access (RA) medium access control (MAC) design is considered a key solution for handling unpredictable data traffic from…

Networking and Internet Architecture · Computer Science 2025-08-12 Myeung Suk Oh , Zhiyao Zhang , FNU Hairi , Alvaro Velasquez , Jia Liu

Traffic congestion in metropolitan areas presents a formidable challenge with far-reaching economic, environmental, and societal ramifications. Therefore, effective congestion management is imperative, with traffic signal control (TSC)…

Systems and Control · Electrical Eng. & Systems 2024-06-13 Maonan Wang , Aoyu Pang , Yuheng Kan , Man-On Pun , Chung Shue Chen , Bo Huang

Closed-loop traffic simulation requires agents that are both scalable and behaviorally realistic. Recent self-play reinforcement learning approaches demonstrate strong scalability, but their equilibrium strategies fail to capture the…

Robotics · Computer Science 2026-05-12 Weifan Zhang , Xiaofeng Zhao , Adel Bazzi , Mingrui Li , Yifan Wei , Dengfeng Sun

Human-centric traffic signal control in corridor networks must increasingly account for multimodal travelers, particularly high-occupancy public transportation, rather than focusing solely on vehicle-centric performance. This paper proposes…

Machine Learning · Computer Science 2026-02-20 Xiaocai Zhang , Neema Nassir , Milad Haghani

Multi-Agent Reinforcement Learning (MARL) has emerged as a powerfulparadigm for cooperative decision-making in connected autonomous vehicles(CAVs); however, existing approaches often fail to guarantee stability, optimality,and…

General Mathematics · Mathematics 2025-11-25 Mazyar Taghavi , Javad Vahidi