English
Related papers

Related papers: STMARL: A Spatio-Temporal Multi-Agent Reinforcemen…

200 papers

The emergence of reinforcement learning (RL) methods in traffic signal control tasks has achieved better performance than conventional rule-based approaches. Most RL approaches require the observation of the environment for the agent to…

Machine Learning · Computer Science 2023-11-16 Hao Mei , Junxian Li , Bin Shi , Hua Wei

Discretionary lane-change is one of the critical challenges for autonomous vehicle (AV) design due to its significant impact on traffic efficiency. Existing intelligent lane-change solutions have primarily focused on optimizing the…

Computers and Society · Computer Science 2023-03-17 Lokesh Chandra Das , Myounggyu Won

The effective design of patrol strategies is a difficult and complex problem, especially in medium and large areas. The objective is to plan, in a coordinated manner, the optimal routes for a set of patrols in a given area, in order to…

Artificial Intelligence · Computer Science 2025-01-15 Juan Palma-Borda , Eduardo Guzmán , María-Victoria Belmonte

Multi-agent reinforcement learning (MARL) has shown promise for adaptive traffic signal control (ATSC), enabling multiple intersections to coordinate signal timings in real time. However, in large-scale settings, MARL faces constraints due…

Machine Learning · Computer Science 2026-02-10 Yongjie Fu , Lingyun Zhong , Zifan Li , Xuan Di

Traffic signal control is an important and challenging real-world problem, which aims to minimize the travel time of vehicles by coordinating their movements at the road intersections. Current traffic signal control systems in use still…

Machine Learning · Computer Science 2020-01-17 Hua Wei , Guanjie Zheng , Vikash Gayah , Zhenhui Li

This work examines the implications of uncoupled intersections with local real-world topology and sensor setup on traffic light control approaches. Control approaches are evaluated with respect to: Traffic flow, fuel consumption and noise…

Artificial Intelligence · Computer Science 2018-11-29 Mark Schutera , Niklas Goby , Stefan Smolarek , Markus Reischl

In dense traffic scenarios, ensuring safety while keeping high task performance for autonomous driving is a critical challenge. To address this problem, this paper proposes a computationally-efficient spatiotemporal receding horizon control…

Robotics · Computer Science 2024-05-28 Lei Zheng , Rui Yang , Zengqi Peng , Michael Yu Wang , Jun Ma

In order to predict a pedestrian's trajectory in a crowd accurately, one has to take into account her/his underlying socio-temporal interactions with other pedestrians consistently. Unlike existing work that represents the relevant…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Yuke Li , Lixiong Chen , Guangyi Chen , Ching-Yao Chan , Kun Zhang , Stefano Anzellotti , Donglai Wei

Traffic congestion in dense urban centers presents an economical and environmental burden. In recent years, the availability of vehicle-to-anything communication allows for the transmission of detailed vehicle states to the infrastructure…

The adaptive traffic signal control (ATSC) problem can be modeled as a multiagent cooperative game among urban intersections, where intersections cooperate to optimize their common goal. Recently, reinforcement learning (RL) has achieved…

Machine Learning · Computer Science 2021-04-23 Chengwei Zhang , Shan Jin , Wanli Xue , Xiaofei Xie , Shengyong Chen , Rong Chen

It is expected that autonomous vehicles(AVs) and heterogeneous human-driven vehicles(HVs) will coexist on the same road. The safety and reliability of AVs will depend on their social awareness and their ability to engage in complex social…

Robotics · Computer Science 2025-12-11 Rodolfo Valiente , Behrad Toghi , Mahdi Razzaghpour , Ramtin Pedarsani , Yaser P. Fallah

This paper considers multi-agent reinforcement learning (MARL) in networked system control. Specifically, each agent learns a decentralized control policy based on local observations and messages from connected neighbors. We formulate such…

Machine Learning · Computer Science 2020-04-27 Tianshu Chu , Sandeep Chinchali , Sachin Katti

Spatial-temporal prediction is a critical problem for intelligent transportation, which is helpful for tasks such as traffic control and accident prevention. Previous studies rely on large-scale traffic data collected from sensors. However,…

Machine Learning · Computer Science 2021-08-24 Chung-Yi Lin , Hung-Ting Su , Shen-Lung Tung , Winston H. Hsu

Real-time traffic prediction from high-fidelity spatiotemporal traffic sensor datasets is an important problem for intelligent transportation systems and sustainability. However, it is challenging due to the complex topological dependencies…

Social and Information Networks · Computer Science 2016-07-22 Dingxiong Deng , Cyrus Shahabi , Ugur Demiryurek , Linhong Zhu , Rose Yu , Yan Liu

The effective deployment of connected vehicular networks is contingent upon maintaining a desired performance across spatial and temporal domains. In this paper, a graph-based framework, called SMART, is proposed to model and keep track of…

Signal Processing · Electrical Eng. & Systems 2021-03-16 Juntong Liu , Yong Xiao , Yingyu Li , Guangming Shiyz , Walid Saad , H. Vincent Poor

Spatio-temporal forecasting is an open research field whose interest is growing exponentially. In this work we focus on creating a complex deep neural framework for spatio-temporal traffic forecasting with comparatively very good…

Machine Learning · Computer Science 2020-10-22 Rodrigo de Medrano , José L. Aznarte

Sub-optimal control policies in intersection traffic signal controllers (TSC) contribute to congestion and lead to negative effects on human health and the environment. Reinforcement learning (RL) for traffic signal control is a promising…

Lane detection is a crucial perception task for all levels of automated vehicles (AVs) and Advanced Driver Assistance Systems, particularly in mixed-traffic environments where AVs must interact with human-driven vehicles (HDVs) and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Sandeep Patil , Yongqi Dong , Haneen Farah , Hans Hellendoorn

Dynamic demand prediction is crucial for the efficient operation and management of urban transportation systems. Extensive research has been conducted on single-mode demand prediction, ignoring the fact that the demands for different…

Machine Learning · Computer Science 2022-09-02 Yuebing Liang , Guan Huang , Zhan Zhao

Connected and autonomous vehicles across land, water, and air must often operate in dynamic, unpredictable environments with limited communication, no centralized control, and partial observability. These real-world constraints pose…

Multiagent Systems · Computer Science 2025-11-18 Hung Du , Hy Nguyen , Srikanth Thudumu , Rajesh Vasa , Kon Mouzakis