English
Related papers

Related papers: LibSignal: An Open Library for Traffic Signal Cont…

200 papers

Nowadays, realistic simulation environments are essential to validate and build reliable robotic solutions. This is particularly true when using Reinforcement Learning (RL) based control policies. To this end, both robotics and RL…

Robotics · Computer Science 2023-10-12 Matteo El-Hariry , Antoine Richard , Miguel Olivares-Mendez

Increasingly available city data and advanced learning techniques have empowered people to improve the efficiency of our city functions. Among them, improving the urban transportation efficiency is one of the most prominent topics. Recent…

Machine Learning · Computer Science 2019-05-14 Guanjie Zheng , Yuanhao Xiong , Xinshi Zang , Jie Feng , Hua Wei , Huichu Zhang , Yong Li , Kai Xu , Zhenhui Li

The issue of traffic congestion poses a significant obstacle to the development of global cities. One promising solution to tackle this problem is intelligent traffic signal control (TSC). Recently, TSC strategies leveraging reinforcement…

Human-Computer Interaction · Computer Science 2024-10-03 Yutian Zhang , Guohong Zheng , Zhiyuan Liu , Quan Li , Haipeng Zeng

Sub-optimal control policies in transportation systems negatively impact mobility, the environment and human health. Developing optimal transportation control systems at the appropriate scale can be difficult as cities' transportation…

Systems and Control · Electrical Eng. & Systems 2019-09-04 Wade Genders , Saiedeh Razavi

Using Reinforcement Learning (RL) in simulation to construct policies useful in real life is challenging. This is often attributed to the sequential decision making aspect: inaccuracies in simulation accumulate over multiple steps, hence…

Machine Learning · Computer Science 2017-06-09 Rika Antonova , Silvia Cruciani

Model free reinforcement learning (RL) provides a potential alternative to earlier formulations of adaptive transit signal priority (TSP) algorithms based on mathematical programming that require complex and nonlinear objective functions.…

Machine Learning · Computer Science 2024-08-02 Dickness Kwesiga , Angshuman Guin , Michael Hunter

Machine learning (especially reinforcement learning) methods for trading are increasingly reliant on simulation for agent training and testing. Furthermore, simulation is important for validation of hand-coded trading strategies and for…

Trading and Market Microstructure · Quantitative Finance 2019-12-12 Svitlana Vyetrenko , David Byrd , Nick Petosa , Mahmoud Mahfouz , Danial Dervovic , Manuela Veloso , Tucker Hybinette Balch

Traffic simulation is an essential tool for transportation infrastructure planning, intelligent traffic control policy learning, and traffic flow analysis. Its effectiveness relies heavily on the realism of the simulators used. Traditional…

Multiagent Systems · Computer Science 2024-02-12 Longchao Da , Chen Chu , Weinan Zhang , Hua Wei

Urban congestion remains a critical challenge, with traffic signal control (TSC) emerging as a potent solution. TSC is often modeled as a Markov Decision Process problem and then solved using reinforcement learning (RL), which has proven…

Artificial Intelligence · Computer Science 2024-07-09 Aoyu Pang , Maonan Wang , Man-On Pun , Chung Shue Chen , Xi Xiong

In reinforcement learning (RL) research, simulations enable benchmarks between algorithms, as well as prototyping and hyper-parameter tuning of agents. In order to promote RL both in research and real-world applications, frameworks are…

Robotics · Computer Science 2022-12-05 Christian Bitter , Timo Thun , Tobias Meisen

Designing optimal controllers continues to be challenging as systems are becoming complex and are inherently nonlinear. The principal advantage of reinforcement learning (RL) is its ability to learn from the interaction with the environment…

Machine Learning · Computer Science 2018-10-05 Savinay Nagendra , Nikhil Podila , Rashmi Ugarakhod , Koshy George

Traffic congestion in metropolitan areas is a world-wide problem that can be ameliorated by traffic lights that respond dynamically to real-time conditions. Recent studies applying deep reinforcement learning (RL) to optimize single traffic…

Machine Learning · Computer Science 2019-12-10 Zhi Zhang , Jiachen Yang , Hongyuan Zha

Urban traffic control is a system-level coordination problem spanning heterogeneous subsystems, including traffic signals, freeways, public transit, and taxi services. Existing optimization-based, reinforcement learning (RL), and emerging…

Artificial Intelligence · Computer Science 2026-04-21 Siqi Lai , Pan Zhang , Yuping Zhou , Jindong Han , Yansong Ning , Hao Liu

Over the years, reinforcement learning has emerged as a popular approach to develop signal control and vehicle platooning strategies either independently or in a hierarchical way. However, jointly controlling both in real-time to alleviate…

Machine Learning · Computer Science 2025-08-13 Xianyue Peng , Shenyang Chen , Hang Gao , Hao Wang , H. Michael Zhang

This study introduces CycLight, a novel cycle-level deep reinforcement learning (RL) approach for network-level adaptive traffic signal control (NATSC) systems. Unlike most traditional RL-based traffic controllers that focus on step-by-step…

Machine Learning · Computer Science 2024-01-17 Gengyue Han , Xiaohan Liu , Xianyue Peng , Hao Wang , Yu Han

With the increasing availability of traffic data and advance of deep reinforcement learning techniques, there is an emerging trend of employing reinforcement learning (RL) for traffic signal control. A key question for applying RL to…

Machine Learning · Computer Science 2019-05-14 Guanjie Zheng , Xinshi Zang , Nan Xu , Hua Wei , Zhengyao Yu , Vikash Gayah , Kai Xu , Zhenhui Li

The interest in using reinforcement learning (RL) controllers in safety-critical applications such as robot navigation around pedestrians motivates the development of additional safety mechanisms. Running RL-enabled systems among uncertain…

Robotics · Computer Science 2023-12-08 Kegan J. Strawn , Nora Ayanian , Lars Lindemann

Modern approaches to autonomous driving rely heavily on learned components trained with large amounts of human driving data via imitation learning. However, these methods require large amounts of expensive data collection and even then face…

Tactile information is important for robust performance in robotic tasks that involve physical interaction, such as object manipulation. However, with more data included in the reasoning and control process, modeling behavior becomes…

Robotics · Computer Science 2023-11-14 Luca Lach , Francesco Ferro , Robert Haschke

Multi-agent reinforcement learning (MARL) has shown significant potential in traffic signal control (TSC). However, current MARL-based methods often suffer from insufficient generalization due to the fixed traffic patterns and road network…

Multiagent Systems · Computer Science 2025-03-13 Yihong Li , Chengwei Zhang , Furui Zhan , Wanting Liu , Kailing Zhou , Longji Zheng