English
Related papers

Related papers: A Methodology for the Development of RL-Based Adap…

200 papers

Traffic signal control is an important problem in urban mobility with a significant potential of economic and environmental impact. While there is a growing interest in Reinforcement Learning (RL) for traffic signal control, the work so far…

Artificial Intelligence · Computer Science 2022-12-13 Mayuresh Kunjir , Sanjay Chawla

In recent years, control under urban intersection scenarios becomes an emerging research topic. In such scenarios, the autonomous vehicle confronts complicated situations since it must deal with the interaction with social vehicles timely…

Artificial Intelligence · Computer Science 2021-09-23 Yuqi Liu , Qichao Zhang , Dongbin Zhao

Reinforcement learning (RL) algorithms find applications in inventory control, recommender systems, vehicular traffic management, cloud computing and robotics. The real-world complications of many tasks arising in these domains makes them…

Machine Learning · Computer Science 2021-06-03 Sindhu Padakandla

Ineffective and inflexible traffic signal control at urban intersections can often lead to bottlenecks in traffic flows and cause congestion, delay, and environmental problems. How to manage traffic smartly by intelligent signal control is…

Systems and Control · Computer Science 2019-05-21 Mengyu Guo , Pin Wang , Ching-Yao Chan , Sid Askary

A number of deep reinforcement-learning (RL) approaches propose to control traffic signals. In this work, we study the robustness of such methods along two axes. First, sensor failures and GPS occlusions create missing-data challenges and…

Machine Learning · Computer Science 2023-06-09 Tianyu Shi , Francois-Xavier Devailly , Denis Larocque , Laurent Charlin

Scaling adaptive traffic-signal control involves dealing with combinatorial state and action spaces. Multi-agent reinforcement learning attempts to address this challenge by distributing control to specialized agents. However,…

Machine Learning · Computer Science 2021-09-22 François-Xavier Devailly , Denis Larocque , Laurent Charlin

In this article, we explore the technical details of the reinforcement learning (RL) algorithms that were deployed in the largest field test of automated vehicles designed to smooth traffic flow in history as of 2023, uncovering the…

In this paper we revisit some of the fundamental premises for a reinforcement learning (RL) approach to self-learning traffic lights. We propose RLight, a combination of choices that offers robust performance and good generalization to…

Machine Learning · Computer Science 2021-11-23 Sierk Kanis , Laurens Samson , Daan Bloembergen , Tim Bakker

Reinforcement Learning (RL) is a powerful method for controlling dynamic systems, but its learning mechanism can lead to unpredictable actions that undermine the safety of critical systems. Here, we propose RL with Adaptive Regularization…

Machine Learning · Computer Science 2024-11-01 Haozhe Tian , Homayoun Hamedmoghadam , Robert Shorten , Pietro Ferraro

Traffic signal controllers play an essential role in today's traffic system. However, the majority of them currently is not sufficiently flexible or adaptive to generate optimal traffic schedules. In this paper we present an approach to…

Machine Learning · Computer Science 2021-05-05 Shengchao Yan , Jingwei Zhang , Daniel Büscher , Wolfram Burgard

Inefficient traffic signal control methods may cause numerous problems, such as traffic congestion and waste of energy. Reinforcement learning (RL) is a trending data-driven approach for adaptive traffic signal control in complex urban…

Signal Processing · Electrical Eng. & Systems 2021-07-14 Zhenning Li , Chengzhong Xu , Guohui Zhang

In traffic signal control, flow-based (optimizing the overall flow) and pressure-based methods (equalizing and alleviating congestion) are commonly used but often considered separately. This study introduces a unified framework using…

Systems and Control · Electrical Eng. & Systems 2024-01-18 Chaolun Ma , Bruce Wang , Zihao Li , Ahmadreza Mahmoudzadeh , Yunlong Zhang

Sub-optimal control policies in intersection traffic signal controllers (TSC) contribute to congestion and lead to negative effects on human health and the environment. Reinforcement learning (RL) for traffic signal control is a promising…

Traffic congestion is a persistent problem in urban areas, which calls for the development of effective traffic signal control (TSC) systems. While existing Reinforcement Learning (RL)-based methods have shown promising performance in…

Systems and Control · Electrical Eng. & Systems 2024-06-13 Maonan Wang , Xi Xiong , Yuheng Kan , Chengcheng Xu , Man-On Pun

Electric motors are crucial in many applications, but traditional control methods struggle with nonlinearities, parameter uncertainties, and external disturbances. Reinforcement Learning (RL) offers a promising solution as a data-driven…

Systems and Control · Electrical Eng. & Systems 2024-12-25 Danial Kazemikia

Reinforcement learning has demonstrated significant potential in the field of autonomous driving. However, it suffers from defects such as training instability and unsafe action outputs when faced with autonomous racing environments…

Robotics · Computer Science 2026-03-09 Bo Leng , Weiqi Zhang , Zhuoren Li , Lu Xiong , Guizhe Jin , Ran Yu , Chen Lv

This paper proposes a framework for adaptively learning a feedback linearization-based tracking controller for an unknown system using discrete-time model-free policy-gradient parameter update rules. The primary advantage of the scheme over…

Machine Learning · Computer Science 2020-04-07 Tyler Westenbroek , Eric Mazumdar , David Fridovich-Keil , Valmik Prabhu , Claire J. Tomlin , S. Shankar Sastry

Choosing an appropriate parameter set for the designed controller is critical for the final performance but usually requires a tedious and careful tuning process, which implies a strong need for automatic tuning methods. However, among…

Systems and Control · Electrical Eng. & Systems 2022-09-13 Yuheng Lei , Jianyu Chen , Shengbo Eben Li , Sifa Zheng

Model-free reinforcement learning (RL) is inherently a reactive method, operating under the assumption that it starts with no prior knowledge of the system and entirely depends on trial-and-error for learning. This approach faces several…

Existing data-driven and feedback traffic control strategies do not consider the heterogeneity of real-time data measurements. Besides, traditional reinforcement learning (RL) methods for traffic control usually converge slowly for lacking…

Systems and Control · Electrical Eng. & Systems 2022-09-14 C. Chen , Y. P. Huang , W. H. K. Lam , T. L. Pan , S. C. Hsu , A. Sumalee , R. X. Zhong