English
Related papers

Related papers: Towards a Very Large Scale Traffic Simulator for M…

200 papers

Advanced vehicle control is a fundamental building block in the development of autonomous driving systems. Reinforcement learning (RL) promises to achieve control performance superior to classical approaches while keeping computational…

Machine Learning · Computer Science 2023-12-01 Bernd Frauenknecht , Tobias Ehlgen , Sebastian Trimpe

In this article, we explore the technical details of the reinforcement learning (RL) algorithms that were deployed in the largest field test of automated vehicles designed to smooth traffic flow in history as of 2023, uncovering the…

Predicting traffic volume in real-time can improve both traffic flow and road safety. A precise traffic volume forecast helps alert drivers to the flow of traffic along their preferred routes, preventing potential deadlock situations.…

Machine Learning · Computer Science 2023-03-23 Lokesh Chandra Das

Deep Reinforcement Learning (DRL) has demonstrated impressive results in domains such as games and robotics, where task formulations are well-defined. However, few DRL benchmarks are grounded in complex, real-world environments, where…

Machine Learning · Computer Science 2025-05-13 Henrique Donâncio , Laurent Vercouter , Harald Roclawski

Existing data-driven and feedback traffic control strategies do not consider the heterogeneity of real-time data measurements. Besides, traditional reinforcement learning (RL) methods for traffic control usually converge slowly for lacking…

Systems and Control · Electrical Eng. & Systems 2022-09-14 C. Chen , Y. P. Huang , W. H. K. Lam , T. L. Pan , S. C. Hsu , A. Sumalee , R. X. Zhong

Traffic congestion, primarily driven by intersection queuing, significantly impacts urban living standards, safety, environmental quality, and economic efficiency. While Traffic Signal Control (TSC) systems hold potential for congestion…

Machine Learning · Computer Science 2026-01-14 Qiang Li , Jin Niu , Lina Yu

This paper presents a safe learning-based eco-driving framework tailored for mixed traffic flows, which aims to optimize energy efficiency while guaranteeing safety during real-system operations. Even though reinforcement learning (RL) is…

Systems and Control · Electrical Eng. & Systems 2024-02-01 Ke Lu , Dongjun Li , Qun Wang , Kaidi Yang , Lin Zhao , Ziyou Song

We propose a safe DRL approach for autonomous vehicle (AV) navigation through crowds of pedestrians while making a left turn at an unsignalized intersection. Our method uses two long-short term memory (LSTM) models that are trained to…

Robotics · Computer Science 2021-06-09 Kasra Mokhtari , Alan R. Wagner

In this thesis, I propose a family of fully decentralized deep multi-agent reinforcement learning (MARL) algorithms to achieve high, real-time performance in network-level traffic signal control. In this approach, each intersection is…

Machine Learning · Computer Science 2020-07-21 Jin Guo

In this paper, methods have been explored to effectively optimise traffic signal control to minimise waiting times and queue lengths, thereby increasing traffic flow. The traffic intersection was first defined as a Markov Decision Process,…

Systems and Control · Electrical Eng. & Systems 2022-07-29 Hrishit Chaudhuri , Vibha Masti , Vishruth Veerendranath , S Natarajan

Avoiding congestion and controlling traffic in urban scenarios is becoming nowadays of paramount importance due to the rapid growth of our cities' population and vehicles. The effective control of urban traffic as a means to mitigate…

Artificial Intelligence · Computer Science 2022-08-08 Matteo Cardellini

Reinforcement learning (RL) has evolved into a widely investigated technology for the development of smart TSC strategies. However, current RL algorithms necessitate excessive interaction with the environment to learn effective policies,…

Machine Learning · Computer Science 2025-03-05 Qiang Li , Yinhan Lin , Qin Luo , Lina Yu

The Fleet Size and Mix Vehicle Routing Problem (FSMVRP) is a prominent variant of the Vehicle Routing Problem (VRP), extensively studied in operations research and computational science. FSMVRP requires simultaneous decisions on fleet…

Artificial Intelligence · Computer Science 2026-01-01 Pengfu Wan , Jiawei Chen , Gangyan Xu

Traffic jams in urban scenarios are often caused by bottlenecks related to the street topology and road infrastructure, e.g. traffic lights and merging of lanes. Instead of addressing traffic flow optimization in a static way by extending…

Physics and Society · Physics 2019-07-09 Tim Vranken , Benjamin Sliwa , Christian Wietfeld , Michael Schreckenberg

Efficient traffic signal control (TSC) is crucial for reducing congestion, travel delays, pollution, and for ensuring road safety. Traditional approaches, such as fixed signal control and actuated control, often struggle to handle dynamic…

Systems and Control · Electrical Eng. & Systems 2025-09-29 Anirud Nandakumar , Chayan Banerjee , Lelitha Devi Vanajakshi

Deep reinforcement learning (DRL) has become a powerful tool for complex decision-making in machine learning and AI. However, traditional methods often assume perfect action execution, overlooking the uncertainties and deviations between an…

Robotics · Computer Science 2025-07-02 Oren Fivel , Matan Rudman , Kobi Cohen

Conventional simulations on multi-exit indoor evacuation focus primarily on how to determine a reasonable exit based on numerous factors in a changing environment. Results commonly include some congested and other under-utilized exits,…

Machine Learning · Computer Science 2020-07-14 Dong Xu , Xiao Huang , Joseph Mango , Xiang Li , Zhenlong Li

This paper presents the results of a new deep learning model for traffic signal control. In this model, a novel state space approach is proposed to capture the main attributes of the control environment and the underlying temporal traffic…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Matthew Muresan , Liping Fu , Guangyuan Pan

Reinforcement Learning (RL) has been widely explored in Traffic Signal Control (TSC) applications, however, still no such system has been deployed in practice. A key barrier to progress in this area is the reality gap, the discrepancy that…

Machine Learning · Computer Science 2023-07-24 Arthur Müller , Matthia Sabatelli

Autonomous driving in urban crowds at unregulated intersections is challenging, where dynamic occlusions and uncertain behaviors of other vehicles should be carefully considered. Traditional methods are heuristic and based on…

Robotics · Computer Science 2021-09-20 Peide Cai , Sukai Wang , Hengli Wang , Ming Liu