English
Related papers

Related papers: TSC: Topology-Conditioned Stackelberg Coordination…

200 papers

Traffic Signal Control (TSC) aims to reduce the average travel time of vehicles in a road network, which in turn enhances fuel utilization efficiency, air quality, and road safety, benefiting society as a whole. Due to the complexity of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Junfan Lin , Yuying Zhu , Lingbo Liu , Yang Liu , Guanbin Li , Liang Lin

Traffic congestion in urban areas is a significant problem, leading to prolonged travel times, reduced efficiency, and increased environmental concerns. Effective traffic signal control (TSC) is a key strategy for reducing congestion.…

Systems and Control · Electrical Eng. & Systems 2025-05-27 Maonan Wang , Yirong Chen , Yuheng Kan , Chengcheng Xu , Michael Lepech , Man-On Pun , Xi Xiong

In this paper, we present Stratified Topological Autonomy for Long-Range Coordination (STALC), a hierarchical planning approach for multi-robot coordination in real-world environments with significant inter-robot spatial and temporal…

Recently, with the development of Multi-agent reinforcement learning (MARL), adaptive traffic signal control (ATSC) has achieved satisfactory results. In traffic scenarios with multiple intersections, MARL treats each intersection as an…

Machine Learning · Computer Science 2025-03-12 Kailing Zhou , Chengwei Zhang , Furui Zhan , Wanting Liu , Yihong Li

The development of intelligent traffic light control systems is essential for smart transportation management. While some efforts have been made to optimize the use of individual traffic lights in an isolated way, related studies have…

Multiagent Systems · Computer Science 2020-12-01 Yanan Wang , Tong Xu , Xin Niu , Chang Tan , Enhong Chen , Hui Xiong

Traffic congestion remains a major challenge for urban transportation, leading to significant economic and environmental impacts. Traffic Signal Control (TSC) is one of the key measures to mitigate congestion, and recent studies have…

Multiagent Systems · Computer Science 2026-01-27 Hsiao-Chuan Chang , Sheng-You Huang , Yen-Chi Chen , I-Chen Wu

Recently, autonomous driving has made substantial progress in addressing the most common traffic scenarios like intersection navigation and lane changing. However, most of these successes have been limited to scenarios with well-defined…

Machine Learning · Computer Science 2021-10-25 Christoph Killing , Adam Villaflor , John M. Dolan

This paper proposes implicit cooperation, a framework enabling decentralized agents to approximate optimal coordination in local energy markets without explicit peer-to-peer communication. We formulate the problem as a decentralized…

Systems and Control · Electrical Eng. & Systems 2026-02-19 Nelson Salazar-Pena , Alejandra Tabares , Andres Gonzalez-Mancera

Shared control allows the human driver to collaborate with an assistive driving system while retaining the ability to make decisions and take control if necessary. However, human-vehicle teaming and planning are challenging due to…

Robotics · Computer Science 2024-03-19 Yuhan Zhao , Quanyan Zhu

Urban congestion remains a critical challenge, with traffic signal control (TSC) emerging as a potent solution. TSC is often modeled as a Markov Decision Process problem and then solved using reinforcement learning (RL), which has proven…

Artificial Intelligence · Computer Science 2024-07-09 Aoyu Pang , Maonan Wang , Man-On Pun , Chung Shue Chen , Xi Xiong

Multi-agent reinforcement learning (MARL) requires coordination to efficiently solve certain tasks. Fully centralized control is often infeasible in such domains due to the size of joint action spaces. Coordination graph based formalization…

Machine Learning · Computer Science 2021-02-05 Sheng Li , Jayesh K. Gupta , Peter Morales , Ross Allen , Mykel J. Kochenderfer

Traffic Signal Control (TSC) plays a critical role in urban traffic management by optimizing traffic flow and mitigating congestion. While Large Language Models (LLMs) have recently emerged as promising tools for TSC due to their…

Machine Learning · Computer Science 2025-03-18 Zirui Yuan , Siqi Lai , Hao Liu

Understanding how Advanced Driver-Assistance Systems (ADAS) interact with Traffic Control Devices (TCDs) is critical for assessing their influence on traffic operations, yet this interaction has received little focused empirical study. This…

Robotics · Computer Science 2025-12-16 Zheng Li , Peng Zhang , Shixiao Liang , Hang Zhou , Chengyuan Ma , Handong Yao , Qianwen Li , Xiaopeng Li

Decentralized cooperative multi-agent deep reinforcement learning (MARL) can be a versatile learning framework, particularly in scenarios where centralized training is either not possible or not practical. One of the critical challenges in…

In this paper, we propose capturing and utilizing \textit{Temporal Information through Graph-based Embeddings and Representations} or \textbf{TIGER} to enhance multi-agent reinforcement learning (MARL). We explicitly model how inter-agent…

Machine Learning · Computer Science 2025-11-13 Nikunj Gupta , Ludwika Twardecka , James Zachary Hare , Jesse Milzman , Rajgopal Kannan , Viktor Prasanna

The development of autonomous vehicles has shown great potential to enhance the efficiency and safety of transportation systems. However, the decision-making issue in complex human-machine mixed traffic scenarios, such as unsignalized…

Robotics · Computer Science 2024-09-10 Jiaqi Liu , Peng Hang , Xiaoxiang Na , Chao Huang , Jian Sun

Reinforcement learning-based traffic signal control (RL-TSC) has emerged as a promising approach for improving urban mobility. However, its robustness under real-world disruptions such as traffic incidents remains largely underexplored. In…

Machine Learning · Computer Science 2025-06-18 Dang Viet Anh Nguyen , Carlos Lima Azevedo , Tomer Toledo , Filipe Rodrigues

In an intelligent transportation system, the key problem of traffic forecasting is how to extract periodic temporal dependencies and complex spatial correlations. Current state-of-the-art methods for predicting traffic flow are based on…

Machine Learning · Computer Science 2022-03-01 Zichuan Liu , Rui Zhang , Chen Wang , Zhu Xiao , Hongbo Jiang

Autocurricular training is an important sub-area of multi-agent reinforcement learning~(MARL) that allows multiple agents to learn emergent skills in an unsupervised co-evolving scheme. The robotics community has experimented autocurricular…

Artificial Intelligence · Computer Science 2023-05-09 Boling Yang , Liyuan Zheng , Lillian J. Ratliff , Byron Boots , Joshua R. Smith

Traffic congestion in metropolitan areas is a world-wide problem that can be ameliorated by traffic lights that respond dynamically to real-time conditions. Recent studies applying deep reinforcement learning (RL) to optimize single traffic…

Machine Learning · Computer Science 2019-12-10 Zhi Zhang , Jiachen Yang , Hongyuan Zha