English
Related papers

Related papers: LibSignal: An Open Library for Traffic Signal Cont…

200 papers

With growing urbanization worldwide, efficient management of traffic infrastructure is critical for transportation agencies and city planners. It is essential to have tools that help analyze large volumes of stored traffic data and make…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-06 Rahul Sengupta , Nooshin Yousefzadeh , Manav Sanghvi , Yash Ranjan , Anand Rangarajan , Sanjay Ranka , Yashaswi Karnati , Jeremy Dilmore , Tushar Patel , Ryan Casburn

Reinforcement learning (RL) is widely used in autonomous driving tasks and training RL models typically involves in a multi-step process: pre-training RL models on simulators, uploading the pre-trained model to real-life robots, and…

Machine Learning · Computer Science 2019-10-15 Xinle Liang , Yang Liu , Tianjian Chen , Ming Liu , Qiang Yang

This paper presents the results of a new deep learning model for traffic signal control. In this model, a novel state space approach is proposed to capture the main attributes of the control environment and the underlying temporal traffic…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Matthew Muresan , Liping Fu , Guangyuan Pan

Supervised open-loop training has been widely adopted for training traffic simulation models; however, it fails to capture the inherently dynamic, multi-agent interactions common in complex driving scenarios. We introduce RLFTSim, a…

Rapid urbanization in cities like Bangalore has led to severe traffic congestion, making efficient Traffic Signal Control (TSC) essential. Multi-Agent Reinforcement Learning (MARL), often modeling each traffic signal as an independent agent…

Machine Learning · Computer Science 2026-05-19 Sayambhu Sen , Shalabh Bhatnagar

Many existing traffic signal controllers are either simple adaptive controllers based on sensors placed around traffic intersections, or optimized by traffic engineers on a fixed schedule. Optimizing traffic controllers is time consuming…

Systems and Control · Electrical Eng. & Systems 2019-11-15 Kai Liang Tan , Subhadipto Poddar , Anuj Sharma , Soumik Sarkar

Traffic signal control has the potential to reduce congestion in dynamic networks. Recent studies show that traffic signal control with reinforcement learning (RL) methods can significantly reduce the average waiting time. However, a…

Systems and Control · Electrical Eng. & Systems 2024-06-13 Maonan Wang , Yutong Xu , Xi Xiong , Yuheng Kan , Chengcheng Xu , Man-On Pun

Safety-critical robot systems need thorough testing to expose design flaws and software bugs which could endanger humans. Testing in simulation is becoming increasingly popular, as it can be applied early in the development process and does…

With the rapid growth of urban transportation and the continuous progress in autonomous driving, a demand for robust benchmarking autonomous driving algorithms has emerged, calling for accurate modeling of large-scale urban traffic…

Robotics · Computer Science 2025-02-14 Yuheng Zhang , Tianjian Ouyang , Fudan Yu , Lei Qiao , Wei Wu , Jingtao Ding , Jian Yuan , Yong Li

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

Reinforcement learning (RL) has emerged as a promising solution for addressing traffic signal control (TSC) challenges. While most RL-based TSC systems typically employ an online approach, facilitating frequent active interaction with the…

Machine Learning · Computer Science 2024-05-03 Liang Zhang , Yutong Zhang , Jianming Deng , Chen Li

In recent years, both reinforcement learning and learning-based control -- as well as the study of their safety, which is crucial for deployment in real-world robots -- have gained significant traction. However, to adequately gauge the…

Reinforcement learning (RL) is a promising solution for autonomous vehicles to deal with complex and uncertain traffic environments. The RL training process is however expensive, unsafe, and time consuming. Algorithms are often developed…

Robotics · Computer Science 2022-11-29 Kevin Voogd , Jean Pierre Allamaa , Javier Alonso-Mora , Tong Duy Son

Traffic congestion is a persistent problem in urban areas, which calls for the development of effective traffic signal control (TSC) systems. While existing Reinforcement Learning (RL)-based methods have shown promising performance in…

Systems and Control · Electrical Eng. & Systems 2024-06-13 Maonan Wang , Xi Xiong , Yuheng Kan , Chengcheng Xu , Man-On Pun

Transportation is the backbone of the economy and urban development. Improving the efficiency, sustainability, resilience, and intelligence of transportation systems is critical and also challenging. The constantly changing traffic…

Machine Learning · Computer Science 2022-10-27 Can Li , Lei Bai , Lina Yao , S. Travis Waller , Wei Liu

Decision-making is critical for lane change in autonomous driving. Reinforcement learning (RL) algorithms aim to identify the values of behaviors in various situations and thus they become a promising pathway to address the decision-making…

Robotics · Computer Science 2022-07-08 Jingda Wu , Wenhui Huang , Niels de Boer , Yanghui Mo , Xiangkun He , Chen Lv

The optimization of traffic signal control (TSC) is critical for an efficient transportation system. In recent years, reinforcement learning (RL) techniques have emerged as a popular approach for TSC and show promising results for highly…

Artificial Intelligence · Computer Science 2023-11-28 Jianxiong Li , Shichao Lin , Tianyu Shi , Chujie Tian , Yu Mei , Jian Song , Xianyuan Zhan , Ruimin Li

Smart traffic control and management become an emerging application for Deep Reinforcement Learning (DRL) to solve traffic congestion problems in urban networks. Different traffic control and management policies can be tested on the traffic…

Multiagent Systems · Computer Science 2021-05-31 Zijian Hu , Chengxiang Zhuge , Wei Ma

With the growing popularity of digital twin and autonomous driving in transportation, the demand for simulation systems capable of generating high-fidelity and reliable scenarios is increasing. Existing simulation systems suffer from a lack…

Systems and Control · Electrical Eng. & Systems 2023-07-27 Licheng Wen , Daocheng Fu , Song Mao , Pinlong Cai , Min Dou , Yikang Li , Yu Qiao

We propose a model-free reinforcement learning method for controlling mixed autonomy traffic in simulated traffic networks with through-traffic-only two-way and four-way intersections. Our method utilizes multi-agent policy decomposition…

Artificial Intelligence · Computer Science 2021-11-09 Zhongxia Yan , Cathy Wu