English
Related papers

Related papers: STMARL: A Spatio-Temporal Multi-Agent Reinforcemen…

200 papers

Traffic forecasting, crucial for urban planning, requires accurate predictions of spatial-temporal traffic patterns across urban areas. Existing research mainly focuses on designing complex models that capture spatial-temporal dependencies…

Machine Learning · Computer Science 2024-07-30 Jiarui Sun , Yujie Fan , Chin-Chia Michael Yeh , Wei Zhang , Girish Chowdhary

To capture spatial relationships and temporal dynamics in traffic data, spatio-temporal models for traffic forecasting have drawn significant attention in recent years. Most of the recent works employed graph neural networks(GNN) with…

Machine Learning · Computer Science 2021-04-02 Amit Roy , Kashob Kumar Roy , Amin Ahsan Ali , M Ashraful Amin , A K M Mahbubur Rahman

Travel time estimation is one of the core tasks for the development of intelligent transportation systems. Most previous works model the road segments or intersections separately by learning their spatio-temporal characteristics to estimate…

Artificial Intelligence · Computer Science 2023-11-16 Guangyin Jin , Huan Yan , Fuxian Li , Jincai Huang , Yong Li

Existing data-driven and feedback traffic control strategies do not consider the heterogeneity of real-time data measurements. Besides, traditional reinforcement learning (RL) methods for traffic control usually converge slowly for lacking…

Systems and Control · Electrical Eng. & Systems 2022-09-14 C. Chen , Y. P. Huang , W. H. K. Lam , T. L. Pan , S. C. Hsu , A. Sumalee , R. X. Zhong

Multi-Agent Reinforcement Learning (MARL) has emerged as a powerfulparadigm for cooperative decision-making in connected autonomous vehicles(CAVs); however, existing approaches often fail to guarantee stability, optimality,and…

General Mathematics · Mathematics 2025-11-25 Mazyar Taghavi , Javad Vahidi

On-ramp merging is a challenging task for autonomous vehicles (AVs), especially in mixed traffic where AVs coexist with human-driven vehicles (HDVs). In this paper, we formulate the mixed-traffic highway on-ramp merging problem as a…

Systems and Control · Electrical Eng. & Systems 2022-11-08 Dong Chen , Mohammad Hajidavalloo , Zhaojian Li , Kaian Chen , Yongqiang Wang , Longsheng Jiang , Yue Wang

RouteRL is a novel framework that integrates multi-agent reinforcement learning (MARL) with a microscopic traffic simulation, facilitating the testing and development of efficient route choice strategies for autonomous vehicles (AVs). The…

Intelligent Traffic Light Control System (ITLCS) is a typical Multi-Agent System (MAS), which comprises multiple roads and traffic lights.Constructing a model of MAS for ITLCS is the basis to alleviate traffic congestion. Existing…

Machine Learning · Computer Science 2022-07-06 Ruijie Zhu , Lulu Li , Shuning Wu , Pei Lv , Yafai Li , Mingliang Xu

The goal of this work is to provide a viable solution based on reinforcement learning for traffic signal control problems. Although the state-of-the-art reinforcement learning approaches have yielded great success in a variety of domains,…

Machine Learning · Computer Science 2020-05-20 Yueh-Hua Wu , I-Hau Yeh , David Hu , Hong-Yuan Mark Liao

In mixed-traffic environments, autonomous vehicles must adapt to human-controlled vehicles and other unusual driving situations. This setting can be framed as a multi-agent reinforcement learning (MARL) environment with full cooperative…

Artificial Intelligence · Computer Science 2025-09-19 Xuan Duy Ta , Bang Giang Le , Thanh Ha Le , Viet Cuong Ta

Telecommunication networks play a critical role in modern society. With the arrival of 5G networks, these systems are becoming even more diversified, integrated, and intelligent. Traffic forecasting is one of the key components in such a…

Machine Learning · Computer Science 2020-09-22 Marcus Kalander , Min Zhou , Chengzhi Zhang , Hanling Yi , Lujia Pan

Deep Reinforcement Learning (DRL) uses diverse, unstructured data and makes RL capable of learning complex policies in high dimensional environments. Intelligent Transportation System (ITS) based on Autonomous Vehicles (AVs) offers an…

Machine Learning · Computer Science 2022-06-30 Anum Mushtaq , Irfan ul Haq , Muhammad Azeem Sarwar , Asifullah Khan , Omair Shafiq

Accurate traffic flow prediction heavily relies on the spatio-temporal correlation of traffic flow data. Most current studies separately capture correlations in spatial and temporal dimensions, making it difficult to capture complex…

Machine Learning · Computer Science 2025-01-03 Ben-Ao Dai , Nengchao Lyu , Yongchao Miao

Predicting traffic accidents is the key to sustainable city management, which requires effective address of the dynamic and complex spatiotemporal characteristics of cities. Current data-driven models often struggle with data sparsity and…

Machine Learning · Computer Science 2024-07-26 Xiaowei Gao , James Haworth , Ilya Ilyankou , Xianghui Zhang , Tao Cheng , Stephen Law , Huanfa Chen

The management of mixed traffic that consists of robot vehicles (RVs) and human-driven vehicles (HVs) at complex intersections presents a multifaceted challenge. Traditional signal controls often struggle to adapt to dynamic traffic…

Robotics · Computer Science 2024-03-25 Dawei Wang , Weizi Li , Lei Zhu , Jia Pan

Traffic forecasting is essential to intelligent transportation systems, which is challenging due to the complicated spatial and temporal dependencies within a road network. Existing works usually learn spatial and temporal dependencies…

Machine Learning · Computer Science 2023-07-04 Binqing Wu , Ling Chen

A key aspect of driving a road vehicle is to interact with other road users, assess their intentions and make risk-aware tactical decisions. An intuitive approach to enabling an intelligent automated driving system would be incorporating…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Videsh Suman , Phu Pham , Aniket Bera

We propose a model-free reinforcement learning method for controlling mixed autonomy traffic in simulated traffic networks with through-traffic-only two-way and four-way intersections. Our method utilizes multi-agent policy decomposition…

Artificial Intelligence · Computer Science 2021-11-09 Zhongxia Yan , Cathy Wu

To safely and rationally participate in dense and heterogeneous traffic, autonomous vehicles require to sufficiently analyze the motion patterns of surrounding traffic-agents and accurately predict their future trajectories. This is…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Weihuang Chen , Fangfang Wang , Hongbin Sun

Navigating through intersections is one of the main challenging tasks for an autonomous vehicle. However, for the majority of intersections regulated by traffic lights, the problem could be solved by a simple rule-based method in which the…

Robotics · Computer Science 2021-05-04 Alessandro Paolo Capasso , Paolo Maramotti , Anthony Dell'Eva , Alberto Broggi