English
Related papers

Related papers: STMARL: A Spatio-Temporal Multi-Agent Reinforcemen…

200 papers

Collaborative decision-making is an essential capability for multi-robot systems, such as connected vehicles, to collaboratively control autonomous vehicles in accident-prone scenarios. Under limited communication bandwidth, capturing…

Robotics · Computer Science 2023-11-01 Peng Gao , Yu Shen , Ming C. Lin

Autonomous driving has attracted significant research interests in the past two decades as it offers many potential benefits, including releasing drivers from exhausting driving and mitigating traffic congestion, among others. Despite…

Machine Learning · Computer Science 2024-01-08 Wei Zhou , Dong Chen , Jun Yan , Zhaojian Li , Huilin Yin , Wanchen Ge

Traffic flow forecasting is a crucial task in urban computing. The challenge arises as traffic flows often exhibit intrinsic and latent spatio-temporal correlations that cannot be identified by extracting the spatial and temporal patterns…

Machine Learning · Computer Science 2022-02-02 Song Yang , Jiamou Liu , Kaiqi Zhao

Coordination in traffic signal control is crucial for managing congestion in urban networks. Existing pressure-based control methods focus only on immediate upstream links, leading to suboptimal green time allocation and increased network…

Machine Learning · Computer Science 2025-01-20 Xiaocan Li , Xiaoyu Wang , Ilia Smirnov , Scott Sanner , Baher Abdulhai

Traffic flow forecasting is a crucial task in transportation management and planning. The main challenges for traffic flow forecasting are that (1) as the length of prediction time increases, the accuracy of prediction will decrease; (2)…

Artificial Intelligence · Computer Science 2024-05-13 Jianli Xiao , Baichao Long

Traffic signal control is of critical importance for the effective use of transportation infrastructures. The rapid increase of vehicle traffic and changes in traffic patterns make traffic signal control more and more challenging.…

Machine Learning · Computer Science 2021-12-08 Xingshuai Huang , Di Wu , Michael Jenkin , Benoit Boulet

Intelligent traffic signal controllers, applying DQN algorithms to traffic light policy optimization, efficiently reduce traffic congestion by adjusting traffic signals to real-time traffic. Most propositions in the literature however…

Machine Learning · Computer Science 2021-09-30 Romain Ducrocq , Nadir Farhi

Timely accurate traffic forecast is crucial for urban traffic control and guidance. Due to the high nonlinearity and complexity of traffic flow, traditional methods cannot satisfy the requirements of mid-and-long term prediction tasks and…

Machine Learning · Computer Science 2018-07-13 Bing Yu , Haoteng Yin , Zhanxing Zhu

Accurate traffic prediction in real time plays an important role in Intelligent Transportation System (ITS) and travel navigation guidance. There have been many attempts to predict short-term traffic status which consider the spatial and…

Machine Learning · Computer Science 2023-02-22 Ruiyuan Jiang , Shangbo Wang , Yuli Zhang

Traffic forecasting is a complex multivariate time-series regression task of paramount importance for traffic management and planning. However, existing approaches often struggle to model complex multi-range dependencies using local…

Machine Learning · Computer Science 2023-11-07 Dongcheng Zou , Senzhang Wang , Xuefeng Li , Hao Peng , Yuandong Wang , Chunyang Liu , Kehua Sheng , Bo Zhang

Spatio-temporal graphs are powerful tools for modeling complex dependencies in traffic time series. However, the distributed nature of real-world traffic data across multiple stakeholders poses significant challenges in modeling and…

Machine Learning · Computer Science 2025-11-14 Feng Wang , Tianxiang Chen , Shuyue Wei , Qian Chu , Yi Zhang , Yifan Sun , Zhiming Zheng

Reinforcement Learning (RL) has been widely used for packet routing in communication networks, but traditional RL methods rely on the Markov assumption that the current state contains all necessary information for decision-making. In…

Machine Learning · Computer Science 2025-08-01 Molly Wang , Kin. K Leung

Traffic forecasting is an indispensable part of Intelligent transportation systems (ITS), and long-term network-wide accurate traffic speed forecasting is one of the most challenging tasks. Recently, deep learning methods have become…

Artificial Intelligence · Computer Science 2021-04-13 Haoyang Yan , Xiaolei Ma

Multi-Agent Reinforcement Learning (MARL) is a widely used technique for optimization in decentralised control problems. However, most applications of MARL are in static environments, and are not suitable when agent behaviour and…

Multiagent Systems · Computer Science 2014-09-17 Andrei Marinescu , Ivana Dusparic , Adam Taylor , Vinny Cahill , Siobhán Clarke

Traffic management in a city has become a major problem due to the increasing number of vehicles on roads. Intelligent Transportation System (ITS) can help the city traffic managers to tackle the problem by providing accurate traffic…

Machine Learning · Computer Science 2021-11-04 Shatrughan Modi , Jhilik Bhattacharya , Prasenjit Basak

Reliable traffic flow prediction is crucial to creating intelligent transportation systems. Many big-data-based prediction approaches have been developed but they do not reflect complicated dynamic interactions between roads considering…

Machine Learning · Computer Science 2023-06-21 Won Kyung Lee , Deuk Sin Kwon , So Young Sohn

In recent years, traffic flow prediction has played a crucial role in the management of intelligent transportation systems. However, traditional prediction methods are often limited by static spatial modeling, making it difficult to…

Machine Learning · Computer Science 2025-01-09 Mei Wu , Wenchao Weng , Jun Li , Yiqian Lin , Jing Chen , Dewen Seng

Conventional control, such as model-based control, is commonly utilized in autonomous driving due to its efficiency and reliability. However, real-world autonomous driving contends with a multitude of diverse traffic scenarios that are…

Robotics · Computer Science 2024-03-08 Vindula Jayawardana , Sirui Li , Cathy Wu , Yashar Farid , Kentaro Oguchi

This paper presents a mixed traffic control policy designed to optimize traffic efficiency across diverse road topologies, addressing issues of congestion prevalent in urban environments. A model-free reinforcement learning (RL) approach is…

Robotics · Computer Science 2025-01-29 Chuyang Xiao , Dawei Wang , Xinzheng Tang , Jia Pan , Yuexin Ma

Traffic light control is important for reducing congestion in urban mobility systems. This paper proposes a real-time traffic light control method using deep Q learning. Our approach incorporates a reward function considering queue lengths,…

Artificial Intelligence · Computer Science 2023-08-29 Taoyu Pan