English
Related papers

Related papers: Optimizing Traffic Lights with Multi-agent Deep Re…

200 papers

This paper considers optimal traffic signal control in smart cities, which has been taken as a complex networked system control problem. Given the interacting dynamics among traffic lights and road networks, attaining controller adaptivity…

Machine Learning · Computer Science 2023-11-08 Yao Zhang , Zhiwen Yu , Jun Zhang , Liang Wang , Tom H. Luan , Bin Guo , Chau Yuen

Deep reinforcement learning algorithms have recently been used to train multiple interacting agents in a centralised manner whilst keeping their execution decentralised. When the agents can only acquire partial observations and are faced…

Machine Learning · Computer Science 2020-01-27 Emanuele Pesce , Giovanni Montana

Coordination in traffic signal control is crucial for managing congestion in urban networks. Existing pressure-based control methods focus only on immediate upstream links, leading to suboptimal green time allocation and increased network…

Machine Learning · Computer Science 2025-01-20 Xiaocan Li , Xiaoyu Wang , Ilia Smirnov , Scott Sanner , Baher Abdulhai

Recent work in multi-agent reinforcement learning has investigated inter agent communication which is learned simultaneously with the action policy in order to improve the team reward. In this paper, we investigate independent Q-learning…

The main challenge of multiagent reinforcement learning is the difficulty of learning useful policies in the presence of other simultaneously learning agents whose changing behaviors jointly affect the environment's transition and reward…

Vehicular traffic is a classical example of a multi-agent system in which autonomous drivers operate in a shared environment. The article provides an overview of the state-of-the-art in microscopic traffic modeling and the implications for…

Physics and Society · Physics 2009-10-26 Arne Kesting , Martin Treiber , Dirk Helbing

Reinforcement learning (RL) is gaining popularity as an effective approach for traffic signal control (TSC) and is increasingly applied in this domain. However, most existing RL methodologies are confined to a single-stage TSC framework,…

Machine Learning · Computer Science 2024-05-03 Liang Zhang , Yutong Zhang , Shubin Xie , Jianming Deng , Chen Li

We present an approach to reduce the communication required between agents in a Multi-Agent learning system by exploiting the inherent robustness of the underlying Markov Decision Process. We compute so-called robustness surrogate functions…

Multiagent Systems · Computer Science 2022-09-08 Daniel Jarne Ornia , Manuel Mazo

Decision making in dense traffic can be challenging for autonomous vehicles. An autonomous system only relying on predefined road priorities and considering other drivers as moving objects will cause the vehicle to freeze and fail the…

Robotics · Computer Science 2019-06-27 Maxime Bouton , Alireza Nakhaei , Kikuo Fujimura , Mykel J. Kochenderfer

Deep reinforcement learning (DRL) has become a popular approach in traffic signal control (TSC) due to its ability to learn adaptive policies from complex traffic environments. Within DRL-based TSC methods, two primary control paradigms are…

Machine Learning · Computer Science 2025-09-04 Hankang Gu , Yuli Zhang , Chengming Wang , Ruiyuan Jiang , Ziheng Qiao , Pengfei Fan , Dongyao Jia

Traffic signal control is one of the most effective methods of traffic management in urban areas. In recent years, traffic control methods based on deep reinforcement learning (DRL) have gained attention due to their ability to exploit…

Machine Learning · Computer Science 2021-07-22 Majid Raeis , Alberto Leon-Garcia

In reinforcement learning (RL), different reward functions can define the same optimal policy but result in drastically different learning performance. For some, the agent gets stuck with a suboptimal behavior, and for others, it solves the…

Machine Learning · Computer Science 2025-02-25 Grigorii Veviurko , Wendelin Böhmer , Mathijs de Weerdt

Deep reinforcement learning is actively used for training autonomous car policies in a simulated driving environment. Due to the large availability of various reinforcement learning algorithms and the lack of their systematic comparison…

Artificial Intelligence · Computer Science 2023-03-24 Aizaz Sharif , Dusica Marijan

Scalable multi-agent driving simulation requires behavior models that are both realistic and computationally efficient. We address this by optimizing the behavior model that controls individual traffic participants. To improve efficiency,…

Robotics · Computer Science 2026-04-15 Fabian Konstantinidis , Moritz Sackmann , Ulrich Hofmann , Christoph Stiller

The combination of Artificial Intelligence (AI) and Internet-of-Things (IoT), which is denoted as AI-powered Internet-of-Things (AIoT), is capable of processing huge amount of data generated from a large number of devices and handling…

Systems and Control · Computer Science 2017-11-30 Ying Liu , Lei Liu , Wei-Peng Chen

Reinforcement learning (RL) has attracted increasing interest for adaptive traffic signal control due to its model-free ability to learn control policies directly from interaction with the traffic environment. However, several challenges…

Machine Learning · Computer Science 2026-03-17 Dickens Kwesiga , Angshuman Guin , Khaled Abdelghany , Michael Hunter

We consider the problem of dynamic platoon leader selection, user association, channel assignment, and power allocation on a cellular vehicle-to-everything (C-V2X) based highway, where multiple vehicle-to-vehicle (V2V) and…

Multiagent Systems · Computer Science 2023-03-31 Mohammad Farzanullah , Tho Le-Ngoc

Collisions, crashes, and other incidents on road networks, if left unmitigated, can potentially cause cascading failures that can affect large parts of the system. Timely handling such extreme congestion scenarios is imperative to reduce…

Artificial Intelligence · Computer Science 2023-05-17 Ashutosh Dutta , Milan Jain , Arif Khan , Arun Sathanur

Effective mixed traffic control requires balancing efficiency, fairness, and safety. Existing approaches excel at optimizing efficiency and enforcing safety constraints but lack mechanisms to ensure equitable service, resulting in…

Multiagent Systems · Computer Science 2025-12-15 Iftekharul Islam , Weizi Li

We consider the sequential decision-making problem of making proactive request assignment and rejection decisions for a profit-maximizing operator of an autonomous mobility on demand system. We formalize this problem as a Markov decision…

Machine Learning · Computer Science 2023-05-11 Tobias Enders , James Harrison , Marco Pavone , Maximilian Schiffer