English
Related papers

Related papers: Large-scale traffic signal control using machine l…

200 papers

Reinforcement learning (RL) constitutes a promising solution for alleviating the problem of traffic congestion. In particular, deep RL algorithms have been shown to produce adaptive traffic signal controllers that outperform conventional…

Machine Learning · Statistics 2019-07-23 Filipe Rodrigues , Carlos Lima Azevedo

Ineffective and inflexible traffic signal control at urban intersections can often lead to bottlenecks in traffic flows and cause congestion, delay, and environmental problems. How to manage traffic smartly by intelligent signal control is…

Systems and Control · Computer Science 2019-05-21 Mengyu Guo , Pin Wang , Ching-Yao Chan , Sid Askary

A number of deep reinforcement-learning (RL) approaches propose to control traffic signals. In this work, we study the robustness of such methods along two axes. First, sensor failures and GPS occlusions create missing-data challenges and…

Machine Learning · Computer Science 2023-06-09 Tianyu Shi , Francois-Xavier Devailly , Denis Larocque , Laurent Charlin

Lane-change maneuvers are commonly executed by drivers to follow a certain routing plan, overtake a slower vehicle, adapt to a merging lane ahead, etc. However, improper lane change behaviors can be a major cause of traffic flow disruptions…

Machine Learning · Computer Science 2020-05-22 Fei Ye , Xuxin Cheng , Pin Wang , Ching-Yao Chan , Jiucai Zhang

Reinforcement learning (RL) holds significant promise for adaptive traffic signal control. While existing RL-based methods demonstrate effectiveness in reducing vehicular congestion, their predominant focus on vehicle-centric optimization…

Machine Learning · Computer Science 2025-07-24 Bibek Poudel , Xuan Wang , Weizi Li , Lei Zhu , Kevin Heaslip

Deep reinforcement learning (DRL) has become a popular approach in traffic signal control (TSC) due to its ability to learn adaptive policies from complex traffic environments. Within DRL-based TSC methods, two primary control paradigms are…

Machine Learning · Computer Science 2025-09-04 Hankang Gu , Yuli Zhang , Chengming Wang , Ruiyuan Jiang , Ziheng Qiao , Pengfei Fan , Dongyao Jia

Urban traffic congestion, particularly at intersections, significantly affects travel time, fuel consumption, and emissions. Traditional fixed-time signal control systems often lack the adaptability to effectively manage dynamic traffic…

Artificial Intelligence · Computer Science 2025-12-01 Saahil Mahato

Inefficient traffic signal control methods may cause numerous problems, such as traffic congestion and waste of energy. Reinforcement learning (RL) is a trending data-driven approach for adaptive traffic signal control in complex urban…

Signal Processing · Electrical Eng. & Systems 2021-07-14 Zhenning Li , Chengzhong Xu , Guohui Zhang

Many existing traffic signal controllers are either simple adaptive controllers based on sensors placed around traffic intersections, or optimized by traffic engineers on a fixed schedule. Optimizing traffic controllers is time consuming…

Systems and Control · Electrical Eng. & Systems 2019-11-15 Kai Liang Tan , Subhadipto Poddar , Anuj Sharma , Soumik Sarkar

Reinforcement learning (RL) has attracted increasing interest for adaptive traffic signal control due to its model-free ability to learn control policies directly from interaction with the traffic environment. However, several challenges…

Machine Learning · Computer Science 2026-03-17 Dickens Kwesiga , Angshuman Guin , Khaled Abdelghany , Michael Hunter

The emergence of reinforcement learning (RL) methods in traffic signal control tasks has achieved better performance than conventional rule-based approaches. Most RL approaches require the observation of the environment for the agent to…

Machine Learning · Computer Science 2023-11-16 Hao Mei , Junxian Li , Bin Shi , Hua Wei

Taking advantage of both vehicle-to-everything (V2X) communication and automated driving technology, connected and automated vehicles are quickly becoming one of the transformative solutions to many transportation problems. However, in a…

Systems and Control · Electrical Eng. & Systems 2022-09-01 Zhengwei Bai , Peng Hao , Wei Shangguan , Baigen Cai , Matthew J. Barth

Cooperative relays improve reliability and coverage in wireless networks by providing multiple paths for data transmission. Relaying will play an essential role in vehicular networks at higher frequency bands, where mobility and frequent…

Signal Processing · Electrical Eng. & Systems 2022-12-21 Dohyun Kim , Miguel R. Castellanos , Robert W. Heath

This article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results in model-free DRL-based…

Systems and Control · Electrical Eng. & Systems 2022-12-07 Ramij R. Hossain , Tianzhixi Yin , Yan Du , Renke Huang , Jie Tan , Wenhao Yu , Yuan Liu , Qiuhua Huang

Autonomous navigation in dense traffic scenarios remains challenging for autonomous vehicles (AVs) because the intentions of other drivers are not directly observable and AVs have to deal with a wide range of driving behaviors. To maneuver…

Robotics · Computer Science 2021-07-12 Bruno Brito , Achin Agarwal , Javier Alonso-Mora

Autonomous driving in urban crowds at unregulated intersections is challenging, where dynamic occlusions and uncertain behaviors of other vehicles should be carefully considered. Traditional methods are heuristic and based on…

Robotics · Computer Science 2021-09-20 Peide Cai , Sukai Wang , Hengli Wang , Ming Liu

Developing an autonomous vehicle control strategy for signalised intersections (SI) is one of the challenging tasks due to its inherently complex decision-making process. This study proposes a Deep Reinforcement Learning (DRL) based…

Artificial Intelligence · Computer Science 2025-05-15 Pankaj Kumar , Aditya Mishra , Pranamesh Chakraborty , Subrahmanya Swamy Peruru

This work reports the application of a model-free deep-reinforcement-learning-based (DRL) flow control strategy to suppress perturbations evolving in the 1-D linearised Kuramoto-Sivashinsky (KS) equation and 2-D boundary layer flows. The…

Fluid Dynamics · Physics 2023-01-18 Da Xu , Mengqi Zhang

Autonomous driving at intersections is one of the most complicated and accident-prone traffic scenarios, especially with mixed traffic participants such as vehicles, bicycles and pedestrians. The driving policy should make safe decisions to…

Machine Learning · Computer Science 2022-04-27 Jianhua Jiang , Yangang Ren , Yang Guan , Shengbo Eben Li , Yuming Yin , Xiaoping Jin

This paper presents the results of a new deep learning model for traffic signal control. In this model, a novel state space approach is proposed to capture the main attributes of the control environment and the underlying temporal traffic…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Matthew Muresan , Liping Fu , Guangyuan Pan