English
Related papers

Related papers: DataLight: Offline Data-Driven Traffic Signal Cont…

200 papers

Urban traffic is subject to disruptions that cause extended waiting time and safety issues at signalized intersections. While numerous studies have addressed the issue of intelligent traffic systems in the context of various disturbances,…

Artificial Intelligence · Computer Science 2024-09-16 Qinchen Yang , Zejun Xie , Hua Wei , Desheng Zhang , Yu Yang

Offline reinforcement learning (RL) algorithms have shown promising results in domains where abundant pre-collected data is available. However, prior methods focus on solving individual problems from scratch with an offline dataset without…

Machine Learning · Computer Science 2021-09-17 Tianhe Yu , Aviral Kumar , Yevgen Chebotar , Karol Hausman , Sergey Levine , Chelsea Finn

Traffic signal control plays a crucial role in urban mobility. However, existing methods often struggle to generalize beyond their training environments to unseen scenarios with varying traffic dynamics. We present TransferLight, a novel…

Artificial Intelligence · Computer Science 2024-12-25 Johann Schmidt , Frank Dreyer , Sayed Abid Hashimi , Sebastian Stober

Data-efficient reinforcement learning (RL) in continuous state-action spaces using very high-dimensional observations remains a key challenge in developing fully autonomous systems. We consider a particularly important instance of this…

Artificial Intelligence · Computer Science 2015-10-12 John-Alexander M. Assael , Niklas Wahlström , Thomas B. Schön , Marc Peter Deisenroth

Smart traffic lights in intelligent transportation systems (ITSs) are envisioned to greatly increase traffic efficiency and reduce congestion. Deep reinforcement learning (DRL) is a promising approach to adaptively control traffic lights…

Machine Learning · Computer Science 2025-05-08 Ming Zhu , Xiao-Yang Liu , Sem Borst , Anwar Walid

Off-road autonomous driving poses significant challenges such as navigating unmapped, variable terrain with uncertain and diverse dynamics. Addressing these challenges requires effective long-horizon planning and adaptable control.…

Offline Reinforcement Learning (RL) is structured to derive policies from static trajectory data without requiring real-time environment interactions. Recent studies have shown the feasibility of framing offline RL as a sequence modeling…

Machine Learning · Computer Science 2023-09-01 Abdelghani Ghanem , Philippe Ciblat , Mounir Ghogho

With the ability to learn from static datasets, Offline Reinforcement Learning (RL) emerges as a compelling avenue for real-world applications. However, state-of-the-art offline RL algorithms perform sub-optimally when confronted with…

Machine Learning · Computer Science 2024-06-12 Briti Gangopadhyay , Zhao Wang , Jia-Fong Yeh , Shingo Takamatsu

Natural agents can effectively learn from multiple data sources that differ in size, quality, and types of measurements. We study this heterogeneity in the context of offline reinforcement learning (RL) by introducing a new, practically…

Machine Learning · Computer Science 2023-06-23 Qinqing Zheng , Mikael Henaff , Brandon Amos , Aditya Grover

Reinforcement learning has demonstrated significant potential in the field of autonomous driving. However, it suffers from defects such as training instability and unsafe action outputs when faced with autonomous racing environments…

Robotics · Computer Science 2026-03-09 Bo Leng , Weiqi Zhang , Zhuoren Li , Lu Xiong , Guizhe Jin , Ran Yu , Chen Lv

Many recent works have turned to multi-agent reinforcement learning (MARL) for adaptive traffic signal control to optimize the travel time of vehicles over large urban networks. However, achieving effective and scalable cooperation among…

Machine Learning · Computer Science 2023-05-26 Harsh Goel , Yifeng Zhang , Mehul Damani , Guillaume Sartoretti

The recent advances in information technology and artificial intelligence have fueled a rapid expansion of the data center (DC) industry worldwide, accompanied by an immense appetite for electricity to power the DCs. In a typical DC, around…

Artificial Intelligence · Computer Science 2025-02-17 Xianyuan Zhan , Xiangyu Zhu , Peng Cheng , Xiao Hu , Ziteng He , Hanfei Geng , Jichao Leng , Huiwen Zheng , Chenhui Liu , Tianshun Hong , Yan Liang , Yunxin Liu , Feng Zhao

Reinforcement learning (RL) is a promising data-driven approach for adaptive traffic signal control (ATSC) in complex urban traffic networks, and deep neural networks further enhance its learning power. However, centralized RL is infeasible…

Machine Learning · Computer Science 2019-03-13 Tianshu Chu , Jie Wang , Lara Codecà , Zhaojian Li

Optimizing traffic signal control (TSC) at intersections continues to pose a challenging problem, particularly for large-scale traffic networks. It has been shown in past research that it is feasible to optimize the operations of individual…

Machine Learning · Computer Science 2021-10-13 Paul , Ha , Sikai Chen , Runjia Du , Samuel Labi

Constrained reinforcement learning (RL) seeks high-performance policies under safety constraints. We focus on an offline setting where the agent has only a fixed dataset -- common in realistic tasks to prevent unsafe exploration. To address…

Machine Learning · Computer Science 2025-09-08 Junyu Guo , Zhi Zheng , Donghao Ying , Ming Jin , Shangding Gu , Costas Spanos , Javad Lavaei

Traffic congestion remains a major challenge for urban transportation, leading to significant economic and environmental impacts. Traffic Signal Control (TSC) is one of the key measures to mitigate congestion, and recent studies have…

Multiagent Systems · Computer Science 2026-01-27 Hsiao-Chuan Chang , Sheng-You Huang , Yen-Chi Chen , I-Chen Wu

Numerous solutions are proposed for the Traffic Signal Control (TSC) tasks aiming to provide efficient transportation and mitigate congestion waste. In recent, promising results have been attained by Reinforcement Learning (RL) methods…

Artificial Intelligence · Computer Science 2024-01-24 Longchao Da , Minquan Gao , Hao Mei , Hua Wei

Sample efficiency and exploration remain major challenges in online reinforcement learning (RL). A powerful approach that can be applied to address these issues is the inclusion of offline data, such as prior trajectories from a human…

Machine Learning · Computer Science 2023-06-01 Philip J. Ball , Laura Smith , Ilya Kostrikov , Sergey Levine

A promising paradigm for offline reinforcement learning (RL) is to constrain the learned policy to stay close to the dataset behaviors, known as policy constraint offline RL. However, existing works heavily rely on the purity of the data,…

Machine Learning · Computer Science 2022-10-20 Chengqian Gao , Ke Xu , Liu Liu , Deheng Ye , Peilin Zhao , Zhiqiang Xu

Offline reinforcement learning (RL) aims to optimize the return given a fixed dataset of agent trajectories without additional interactions with the environment. While algorithm development has progressed rapidly, significant theoretical…

Machine Learning · Computer Science 2025-08-12 Fengdi Che