English
Related papers

Related papers: DataLight: Offline Data-Driven Traffic Signal Cont…

200 papers

The dynamic nature of driving environments and the presence of diverse road users pose significant challenges for decision-making in autonomous driving. Deep reinforcement learning (DRL) has emerged as a popular approach to tackle this…

Robotics · Computer Science 2025-09-29 Iman Sharifi , Mustafa Yildirim , Saber Fallah

Traditional offline reinforcement learning (RL) methods predominantly operate in a batch-constrained setting. This confines the algorithms to a specific state-action distribution present in the dataset, reducing the effects of…

Machine Learning · Statistics 2025-07-16 Charles A. Hepburn , Yue Jin , Giovanni Montana

Reinforcement learning (RL) holds significant promise for adaptive traffic signal control. While existing RL-based methods demonstrate effectiveness in reducing vehicular congestion, their predominant focus on vehicle-centric optimization…

Machine Learning · Computer Science 2025-07-24 Bibek Poudel , Xuan Wang , Weizi Li , Lei Zhu , Kevin Heaslip

Pretraining reinforcement learning (RL) models on offline datasets is a promising way to improve their training efficiency in online tasks, but challenging due to the inherent mismatch in dynamics and behaviors across various tasks. We…

Machine Learning · Computer Science 2024-06-06 Minting Pan , Yitao Zheng , Yunbo Wang , Xiaokang Yang

Traffic Signal Control (TSC) is a crucial component in urban traffic management, aiming to optimize road network efficiency and reduce congestion. Traditional TSC methods, primarily based on transportation engineering and reinforcement…

Artificial Intelligence · Computer Science 2024-12-18 Siqi Lai , Zhao Xu , Weijia Zhang , Hao Liu , Hui Xiong

Urban congestion remains a critical challenge, with traffic signal control (TSC) emerging as a potent solution. TSC is often modeled as a Markov Decision Process problem and then solved using reinforcement learning (RL), which has proven…

Artificial Intelligence · Computer Science 2024-07-09 Aoyu Pang , Maonan Wang , Man-On Pun , Chung Shue Chen , Xi Xiong

Existing data-driven and feedback traffic control strategies do not consider the heterogeneity of real-time data measurements. Besides, traditional reinforcement learning (RL) methods for traffic control usually converge slowly for lacking…

Systems and Control · Electrical Eng. & Systems 2022-09-14 C. Chen , Y. P. Huang , W. H. K. Lam , T. L. Pan , S. C. Hsu , A. Sumalee , R. X. Zhong

The prevalent use of benchmarks in current offline reinforcement learning (RL) research has led to a neglect of the imbalance of real-world dataset distributions in the development of models. The real-world offline RL dataset is often…

Machine Learning · Computer Science 2024-05-22 Li Jiang , Sijie Cheng , Jielin Qiu , Haoran Xu , Wai Kin Chan , Zhao Ding

Traffic signal control is an emerging application scenario for reinforcement learning. Besides being as an important problem that affects people's daily life in commuting, traffic signal control poses its unique challenges for reinforcement…

Multiagent Systems · Computer Science 2019-05-15 Huichu Zhang , Siyuan Feng , Chang Liu , Yaoyao Ding , Yichen Zhu , Zihan Zhou , Weinan Zhang , Yong Yu , Haiming Jin , Zhenhui Li

Multi-agent Deep Reinforcement Learning (MADRL) based traffic signal control becomes a popular research topic in recent years. To alleviate the scalability issue of completely centralized RL techniques and the non-stationarity issue of…

Artificial Intelligence · Computer Science 2023-09-08 Hankang Gu , Shangbo Wang , Xiaoguang Ma , Dongyao Jia , Guoqiang Mao , Eng Gee Lim , Cheuk Pong Ryan Wong

Evaluating autonomous vehicle stacks (AVs) in simulation typically involves replaying driving logs from real-world recorded traffic. However, agents replayed from offline data are not reactive and hard to intuitively control. Existing…

Many studies confirmed that a proper traffic state representation is more important than complex algorithms for the classical traffic signal control (TSC) problem. In this paper, we (1) present a novel, flexible and efficient method, namely…

Artificial Intelligence · Computer Science 2022-08-10 Liang Zhang , Qiang Wu , Jun Shen , Linyuan Lü , Bo Du , Jianqing Wu

Nowadays, transportation networks face the challenge of sub-optimal control policies that can have adverse effects on human health, the environment, and contribute to traffic congestion. Increased levels of air pollution and extended…

Systems and Control · Electrical Eng. & Systems 2023-10-25 Pedram Agand , Alexey Iskrov , Mo Chen

Offline Safe Reinforcement Learning (RL) seeks to address safety constraints by learning from static datasets and restricting exploration. However, these approaches heavily rely on the dataset and struggle to generalize to unseen scenarios…

Robotics · Computer Science 2025-03-04 Chenyang Cao , Yucheng Xin , Silang Wu , Longxiang He , Zichen Yan , Junbo Tan , Xueqian Wang

The issue of traffic congestion poses a significant obstacle to the development of global cities. One promising solution to tackle this problem is intelligent traffic signal control (TSC). Recently, TSC strategies leveraging reinforcement…

Human-Computer Interaction · Computer Science 2024-10-03 Yutian Zhang , Guohong Zheng , Zhiyuan Liu , Quan Li , Haipeng Zeng

Since conventional approaches could not adapt to dynamic traffic conditions, reinforcement learning (RL) has attracted more attention to help solve the traffic signal control (TSC) problem. However, existing RL-based methods are rarely…

Machine Learning · Computer Science 2021-12-07 Qiang Wu , Liang Zhang , Jun Shen , Linyuan Lü , Bo Du , Jianqing Wu

The recent success of supervised learning methods on ever larger offline datasets has spurred interest in the reinforcement learning (RL) field to investigate whether the same paradigms can be translated to RL algorithms. This research…

Machine Learning · Computer Science 2021-02-12 Mengjiao Yang , Ofir Nachum

Offline reinforcement learning (RL) represents a significant shift in RL research, allowing agents to learn from pre-collected datasets without further interaction with the environment. A key, yet underexplored, challenge in offline RL is…

Machine Learning · Computer Science 2025-02-27 Yiqin Yang , Quanwei Wang , Chenghao Li , Hao Hu , Chengjie Wu , Yuhua Jiang , Dianyu Zhong , Ziyou Zhang , Qianchuan Zhao , Chongjie Zhang , Xu Bo

Navigating unsignalized intersections in urban environments poses a complex challenge for self-driving vehicles, where issues such as view obstructions, unpredictable pedestrian crossings, and diverse traffic participants demand a great…

Robotics · Computer Science 2024-07-08 Pierre Haritz , David Wanke , Thomas Liebig

Offline reinforcement learning (RL) extends the paradigm of classical RL algorithms to purely learning from static datasets, without interacting with the underlying environment during the learning process. A key challenge of offline RL is…

Machine Learning · Computer Science 2022-06-16 Shentao Yang , Yihao Feng , Shujian Zhang , Mingyuan Zhou
‹ Prev 1 3 4 5 6 7 10 Next ›