English
Related papers

Related papers: CityFlow: A Multi-Agent Reinforcement Learning Env…

200 papers

Urban traffic optimization using traffic cameras as sensors is driving the need to advance state-of-the-art multi-target multi-camera (MTMC) tracking. This work introduces CityFlow, a city-scale traffic camera dataset consisting of more…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Zheng Tang , Milind Naphade , Ming-Yu Liu , Xiaodong Yang , Stan Birchfield , Shuo Wang , Ratnesh Kumar , David Anastasiu , Jenq-Neng Hwang

Nowadays, many cities are equipped with surveillance systems and traffic control centers to monitor vehicular traffic for road safety and efficiency. The monitoring process is mostly done manually which is inefficient and expensive. In…

Machine Learning · Computer Science 2021-08-30 Sepehr Sabour , Sanjeev Rao , Majid Ghaderi

Currently, traffic signal control (TSC) methods based on reinforcement learning (RL) have proven superior to traditional methods. However, most RL methods face difficulties when applied in the real world due to three factors: input, output,…

Multiagent Systems · Computer Science 2024-07-16 Haoyuan Jiang , Xuantang Xiong , Ziyue Li , Hangyu Mao , Guanghu Sui , Jingqing Ruan , Yuheng Cheng , Hua Wei , Wolfgang Ketter , Rui Zhao

Traffic signal control aims to coordinate traffic signals across intersections to improve the traffic efficiency of a district or a city. Deep reinforcement learning (RL) has been applied to traffic signal control recently and demonstrated…

Machine Learning · Computer Science 2024-04-02 Liwen Zhu , Peixi Peng , Zongqing Lu , Xiangqian Wang , Yonghong Tian

This paper presents the results of a new deep learning model for traffic signal control. In this model, a novel state space approach is proposed to capture the main attributes of the control environment and the underlying temporal traffic…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Matthew Muresan , Liping Fu , Guangyuan Pan

Multi-Agent Reinforcement Learning (MARL) presents a promising approach for addressing the complexity of Traffic Signal Control (TSC) in urban environments. However, existing platforms for MARL-based TSC research face challenges such as…

Multiagent Systems · Computer Science 2024-10-25 Rohit Bokade , Xiaoning Jin

Traffic simulations are commonly used to optimize urban traffic flow, with reinforcement learning (RL) showing promising potential for automated traffic signal control, particularly in intelligent transportation systems involving connected…

Systems and Control · Electrical Eng. & Systems 2025-09-19 Talha Azfar , Kaicong Huang , Andrew Tracy , Sandra Misiewicz , Chenxi Liu , Ruimin Ke

A traffic system is a random and complex large system, which is difficult to conduct repeated modelling and control research in a real traffic environment. With the development of automatic driving technology, the requirements for testing…

Robotics · Computer Science 2023-08-01 Junfeng Li , Changqing Yan

Traffic simulators act as an essential component in the operating and planning of transportation systems. Conventional traffic simulators usually employ a calibrated physical car-following model to describe vehicles' behaviors and their…

Artificial Intelligence · Computer Science 2022-07-12 Guanjie Zheng , Hanyang Liu , Kai Xu , Zhenhui Li

Autonomous driving systems require robust lane perception capabilities, yet existing vision-based detection methods suffer significant performance degradation when visual sensors provide insufficient cues, such as in occluded or…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yihan Xie , Han Xia , Zhen Yang

In multi-agent based traffic simulation, agents are always supposed to move following existing instructions, and mechanically and unnaturally imitate human behavior. The human drivers perform acceleration or deceleration irregularly all the…

Multiagent Systems · Computer Science 2021-01-26 Junjie Zhong , Hiromitsu Hattori

Reinforcement Learning (RL) in Traffic Signal Control (TSC) faces significant hurdles in real-world deployment due to limited generalization to dynamic traffic flow variations. Existing approaches often overfit static patterns and use…

Artificial Intelligence · Computer Science 2026-03-13 Sheng-You Huang , Hsiao-Chuan Chang , Yen-Chi Chen , Ting-Han Wei , I-Hau Yeh , Sheng-Yao Kuan , Chien-Yao Wang , Hsuan-Han Lee , I-Chen Wu

Recent advances in combining deep neural network architectures with reinforcement learning techniques have shown promising potential results in solving complex control problems with high dimensional state and action spaces. Inspired by…

Machine Learning · Computer Science 2017-05-30 Seyed Sajad Mousavi , Michael Schukat , Enda Howley

The goal of this work is to provide a viable solution based on reinforcement learning for traffic signal control problems. Although the state-of-the-art reinforcement learning approaches have yielded great success in a variety of domains,…

Machine Learning · Computer Science 2020-05-20 Yueh-Hua Wu , I-Hau Yeh , David Hu , Hong-Yuan Mark Liao

The transition from today's mostly human-driven traffic to a purely automated one will be a gradual evolution, with the effect that we will likely experience mixed traffic in the near future. Connected and automated vehicles can benefit…

Machine Learning · Computer Science 2021-06-14 Shengchao Yan , Tim Welschehold , Daniel Büscher , Wolfram Burgard

Reinforcement learning for traffic signal control is bottlenecked by simulators: training in SUMO takes hours, reproducing results often requires days of platform-specific setup, and the slow iteration cycle discourages the multi-seed…

Systems and Control · Electrical Eng. & Systems 2026-02-26 Haoran Su , Hanxiao Deng

Reinforcement learning (RL) for traffic signal control (TSC) has shown better performance in simulation for controlling the traffic flow of intersections than conventional approaches. However, due to several challenges, no RL-based TSC has…

Machine Learning · Computer Science 2022-06-22 Arthur Müller , Matthia Sabatelli

Urban traffic control is a system-level coordination problem spanning heterogeneous subsystems, including traffic signals, freeways, public transit, and taxi services. Existing optimization-based, reinforcement learning (RL), and emerging…

Artificial Intelligence · Computer Science 2026-04-21 Siqi Lai , Pan Zhang , Yuping Zhou , Jindong Han , Yansong Ning , Hao Liu

Reinforcement learning (RL) constitutes a promising solution for alleviating the problem of traffic congestion. In particular, deep RL algorithms have been shown to produce adaptive traffic signal controllers that outperform conventional…

Machine Learning · Statistics 2019-07-23 Filipe Rodrigues , Carlos Lima Azevedo

Many existing traffic signal controllers are either simple adaptive controllers based on sensors placed around traffic intersections, or optimized by traffic engineers on a fixed schedule. Optimizing traffic controllers is time consuming…

Systems and Control · Electrical Eng. & Systems 2019-11-15 Kai Liang Tan , Subhadipto Poddar , Anuj Sharma , Soumik Sarkar