English
Related papers

Related papers: Quantifying the Impact of Non-Stationarity in Rein…

200 papers

Multi-agent reinforcement learning (MARL) has shown significant potential in traffic signal control (TSC). However, current MARL-based methods often suffer from insufficient generalization due to the fixed traffic patterns and road network…

Multiagent Systems · Computer Science 2025-03-13 Yihong Li , Chengwei Zhang , Furui Zhan , Wanting Liu , Kailing Zhou , Longji Zheng

This article proposes a novel approach to traffic signal control that combines phase re-service with reinforcement learning (RL). The RL agent directly determines the duration of the next phase in a pre-defined sequence. Before the RL…

Systems and Control · Electrical Eng. & Systems 2024-08-05 Zhiyao Zhang , George Gunter , Marcos Quinones-Grueiro , Yuhang Zhang , William Barbour , Gautam Biswas , Daniel Work

Most traffic flow control algorithms address switching cycle adaptation of traffic signals and lights. This work addresses traffic flow optimisation by self-organising micro-level control combining Reinforcement Learning and rule-based…

Artificial Intelligence · Computer Science 2022-02-25 Stefan Bosse

This work proposes a novel method for estimating the influence that unknown static objects might have over mobile agents. Since the motion of agents can be affected by the presence of fixed objects, it is possible use the information about…

Machine Learning · Computer Science 2019-09-10 Damian Campo , Vahid Bastani , Lucio Marcenaro , Carlo Regazzoni

The relationship between a reinforcement learning (RL) agent and an asynchronous environment is often ignored. Frequently used models of the interaction between an agent and its environment, such as Markov Decision Processes (MDP) or…

Artificial Intelligence · Computer Science 2018-06-29 Jaden B. Travnik , Kory W. Mathewson , Richard S. Sutton , Patrick M. Pilarski

Reinforcement Learning is a highly active research field with promising advancements. In the field of autonomous driving, however, often very simple scenarios are being examined. Common approaches use non-interpretable control commands as…

Machine Learning · Computer Science 2025-05-06 Daniel Bogdoll , Jing Qin , Moritz Nekolla , Ahmed Abouelazm , Tim Joseph , J. Marius Zöllner

Traffic signal control is of critical importance for the effective use of transportation infrastructures. The rapid increase of vehicle traffic and changes in traffic patterns make traffic signal control more and more challenging.…

Machine Learning · Computer Science 2021-12-08 Xingshuai Huang , Di Wu , Michael Jenkin , Benoit Boulet

Conditional Imitation learning is a common and effective approach to train autonomous driving agents. However, two issues limit the full potential of this approach: (i) the inertia problem, a special case of causal confusion where the agent…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Luca Cultrera , Federico Becattini , Lorenzo Seidenari , Pietro Pala , Alberto Del Bimbo

A fundamental challenge in multiagent reinforcement learning is to learn beneficial behaviors in a shared environment with other simultaneously learning agents. In particular, each agent perceives the environment as effectively…

Training an agent to solve control tasks directly from high-dimensional images with model-free reinforcement learning (RL) has proven difficult. A promising approach is to learn a latent representation together with the control policy.…

Machine Learning · Computer Science 2020-07-10 Denis Yarats , Amy Zhang , Ilya Kostrikov , Brandon Amos , Joelle Pineau , Rob Fergus

Automated lane changing is a critical feature for advanced autonomous driving systems. In recent years, reinforcement learning (RL) algorithms trained on traffic simulators yielded successful results in computing lane changing policies that…

Robotics · Computer Science 2021-03-16 Anil Ozturk , Mustafa Burak Gunel , Melih Dal , Ugur Yavas , Nazim Kemal Ure

This work leverages adaptive social learning to estimate partially observable global states in multi-agent reinforcement learning (MARL) problems. Unlike existing methods, the proposed approach enables the concurrent operation of social…

Multiagent Systems · Computer Science 2025-08-11 Ainur Zhaikhan , Malek Khammassi , Ali H. Sayed

Partially Detected Intelligent Traffic Signal Control (PD-ITSC) systems that can optimize traffic signals based on limited detected information could be a cost-efficient solution for mitigating traffic congestion in the future. In this…

Signal Processing · Electrical Eng. & Systems 2019-10-25 Rusheng Zhang , Romain Leteurtre , Benjamin Striner , Ammar Alanazi , Abdullah Alghafis , Ozan K. Tonguz

When learning to behave in a stochastic environment where safety is critical, such as driving a vehicle in traffic, it is natural for human drivers to plan fallback strategies as a backup to use if ever there is an unexpected change in the…

Machine Learning · Computer Science 2022-04-12 Ugo Lecerf , Christelle Yemdji-Tchassi , Sébastien Aubert , Pietro Michiardi

In the context of global urbanization and motorization, traffic congestion has become a significant issue, severely affecting the quality of life, environment, and economy. This paper puts forward a single-agent reinforcement learning…

Machine Learning · Computer Science 2026-01-14 Qiang Li , Jin Niu , Qin Luo , Lina Yu

The optimization of traffic signal control (TSC) is critical for an efficient transportation system. In recent years, reinforcement learning (RL) techniques have emerged as a popular approach for TSC and show promising results for highly…

Artificial Intelligence · Computer Science 2023-11-28 Jianxiong Li , Shichao Lin , Tianyu Shi , Chujie Tian , Yu Mei , Jian Song , Xianyuan Zhan , Ruimin Li

Reinforcement learning (RL) and causal modelling naturally complement each other. The goal of causal modelling is to predict the effects of interventions in an environment, while the goal of reinforcement learning is to select interventions…

Machine Learning · Computer Science 2024-07-12 Oliver Schulte , Pascal Poupart

Recently, Intelligent Transportation Systems are leveraging the power of increased sensory coverage and computing power to deliver data-intensive solutions achieving higher levels of performance than traditional systems. Within Traffic…

Machine Learning · Computer Science 2021-05-03 Alvaro Cabrejas-Egea , Raymond Zhang , Neil Walton

We study the problem of representation transfer in offline Reinforcement Learning (RL), where a learner has access to episodic data from a number of source tasks collected a priori, and aims to learn a shared representation to be used in…

Machine Learning · Computer Science 2024-02-21 Avinandan Bose , Simon Shaolei Du , Maryam Fazel

Traffic signal control (TSC) is a high-stakes domain that is growing in importance as traffic volume grows globally. An increasing number of works are applying reinforcement learning (RL) to TSC; RL can draw on an abundance of traffic data…

Artificial Intelligence · Computer Science 2022-10-05 Rex Chen , Fei Fang , Norman Sadeh