English
Related papers

Related papers: Adaptive Traffic Signal Control based on Multi-Age…

200 papers

Ensuring transportation systems are efficient is a priority for modern society. Technological advances have made it possible for transportation systems to collect large volumes of varied data on an unprecedented scale. We propose a traffic…

Machine Learning · Computer Science 2016-11-04 Wade Genders , Saiedeh Razavi

This paper presents the results of a new deep learning model for traffic signal control. In this model, a novel state space approach is proposed to capture the main attributes of the control environment and the underlying temporal traffic…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Matthew Muresan , Liping Fu , Guangyuan Pan

Signal control in urban corridors faces the dual challenge of maintaining arterial traffic progression while adapting to demand variations at local intersections. We propose a hierarchical traffic signal coordination and control scheme that…

Systems and Control · Electrical Eng. & Systems 2025-08-29 Xianyue Peng , Shenyang Chen , H. Michael Zhang

Adaptive traffic signal control (ATSC) in urban traffic networks poses a challenging task due to the complicated dynamics arising in traffic systems. In recent years, several approaches based on multi-agent deep reinforcement learning…

Multiagent Systems · Computer Science 2021-07-07 Paolo Fazzini , Marco Torre , Valeria Rizza , Francesco Petracchini

Urban traffic congestion, particularly at intersections, significantly affects travel time, fuel consumption, and emissions. Traditional fixed-time signal control systems often lack the adaptability to effectively manage dynamic traffic…

Artificial Intelligence · Computer Science 2025-12-01 Saahil Mahato

Proximal Policy Optimization (PPO) is a widely used reinforcement learning algorithm that heavily relies on accurate advantage estimates for stable and efficient training. However, raw advantage signals can exhibit significant variance,…

Machine Learning · Computer Science 2025-05-22 Soham Sane

Efficient traffic signal control is essential for managing urban transportation, minimizing congestion, and improving safety and sustainability. Reinforcement Learning (RL) has emerged as a promising approach to enhancing adaptive traffic…

Machine Learning · Computer Science 2024-09-18 Xiaoyu Wang , Ayal Taitler , Scott Sanner , Baher Abdulhai

As travel demand increases and urban traffic condition becomes more complicated, applying multi-agent deep reinforcement learning (MARL) to traffic signal control becomes one of the hot topics. The rise of Reinforcement Learning (RL) has…

Artificial Intelligence · Computer Science 2023-06-06 Shijie Wang , Shangbo Wang

Reinforcement learning (RL) is a promising data-driven approach for adaptive traffic signal control (ATSC) in complex urban traffic networks, and deep neural networks further enhance its learning power. However, centralized RL is infeasible…

Machine Learning · Computer Science 2019-03-13 Tianshu Chu , Jie Wang , Lara Codecà , Zhaojian Li

Reinforcement learning (RL) has re-emerged as a natural approach for training interactive LLM agents in real-world environments. However, directly applying the widely used Group Relative Policy Optimization (GRPO) algorithm to multi-turn…

Machine Learning · Computer Science 2026-01-27 Junbo Li , Peng Zhou , Rui Meng , Meet P. Vadera , Lihong Li , Yang Li

Existing data-driven and feedback traffic control strategies do not consider the heterogeneity of real-time data measurements. Besides, traditional reinforcement learning (RL) methods for traffic control usually converge slowly for lacking…

Systems and Control · Electrical Eng. & Systems 2022-09-14 C. Chen , Y. P. Huang , W. H. K. Lam , T. L. Pan , S. C. Hsu , A. Sumalee , R. X. Zhong

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots

Expert human drivers perform actions relying on traffic laws and their previous experience. While traffic laws are easily embedded into an artificial brain, modeling human complex behaviors which come from past experience is a more…

Multiagent Systems · Computer Science 2019-03-05 Giulio Bacchiani , Daniele Molinari , Marco Patander

Simulation-based testing of self-driving cars (SDCs) typically relies on scripted pedestrian models that do not capture the heterogeneity and uncertainty of real crossing behavior, limiting the realism of safety assessments, especially for…

Machine Learning · Computer Science 2026-05-27 Prakash Aryan , Kaushik Raghupathruni , Timo Kehrer , Sebastiano Panichella

Autonomous driving has attracted great interest due to its potential capability in full-unsupervised driving. Model-based and learning-based methods are widely used in autonomous driving. Model-based methods rely on pre-defined models of…

Due to the rapid growth of data transmissions in internet of vehicles (IoV), finding schemes that can effectively alleviate access congestion has become an important issue. Recently, many traffic control schemes have been studied.…

Networking and Internet Architecture · Computer Science 2022-04-13 Haijun Zhang , Minghui Jiang , Xiangnan Liu , Keping Long , Victor C. M. Leung

We develop a multi-agent reinforcement learning (MARL) algorithm to minimize the total energy consumption of multiple massive MIMO (multiple-input multiple-output) base stations (BSs) in a multi-cell network while preserving the overall…

Information Theory · Computer Science 2024-02-06 Tianzhang Cai , Qichen Wang , Shuai Zhang , Özlem Tuğfe Demir , Cicek Cavdar

Autonomous vehicles inevitably encounter a vast array of scenarios in real-world environments. Addressing long-tail scenarios, particularly those involving intensive interactions with numerous traffic participants, remains one of the most…

Robotics · Computer Science 2024-12-16 Guanzhou Li , Jianping Wu , Yujing He

Instability and slowness are two main problems in deep reinforcement learning. Even if proximal policy optimization (PPO) is the state of the art, it still suffers from these two problems. We introduce an improved algorithm based on…

Machine Learning · Computer Science 2019-10-01 Zhenyu Zhang , Xiangfeng Luo , Tong Liu , Shaorong Xie , Jianshu Wang , Wei Wang , Yang Li , Yan Peng

Recently, with the development of Multi-agent reinforcement learning (MARL), adaptive traffic signal control (ATSC) has achieved satisfactory results. In traffic scenarios with multiple intersections, MARL treats each intersection as an…

Machine Learning · Computer Science 2025-03-12 Kailing Zhou , Chengwei Zhang , Furui Zhan , Wanting Liu , Yihong Li