English
Related papers

Related papers: Adaptive Traffic Signal Control based on Multi-Age…

200 papers

Coordination in traffic signal control is crucial for managing congestion in urban networks. Existing pressure-based control methods focus only on immediate upstream links, leading to suboptimal green time allocation and increased network…

Machine Learning · Computer Science 2025-01-20 Xiaocan Li , Xiaoyu Wang , Ilia Smirnov , Scott Sanner , Baher Abdulhai

The policy represented by the deep neural network can overfit the spurious features in observations, which hamper a reinforcement learning agent from learning effective policy. This issue becomes severe in high-dimensional state, where the…

Machine Learning · Computer Science 2023-05-01 Md Masudur Rahman , Yexiang Xue

Traffic signal control is an important problem in urban mobility with a significant potential of economic and environmental impact. While there is a growing interest in Reinforcement Learning (RL) for traffic signal control, the work so far…

Artificial Intelligence · Computer Science 2022-12-13 Mayuresh Kunjir , Sanjay Chawla

Recent advances in combining deep neural network architectures with reinforcement learning techniques have shown promising potential results in solving complex control problems with high dimensional state and action spaces. Inspired by…

Machine Learning · Computer Science 2017-05-30 Seyed Sajad Mousavi , Michael Schukat , Enda Howley

The deployment of Autonomous Vehicles (AVs) poses considerable challenges and unique opportunities for the design and management of future urban road infrastructure. In light of this disruptive transformation, the Right-Of-Way (ROW)…

Machine Learning · Computer Science 2023-03-23 Qiming Ye , Yuxiang Feng , Jose Javier Escribano Macias , Marc Stettler , Panagiotis Angeloudis

Reinforcement learning (RL)-based adaptive cruise control systems (ACC) that learn and adapt to road, traffic and vehicle conditions are attractive for enhancing vehicle energy efficiency and traffic flow. However, the application of RL in…

Systems and Control · Electrical Eng. & Systems 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

The capability to learn and adapt to changes in the driving environment is crucial for developing autonomous driving systems that are scalable beyond geo-fenced operational design domains. Deep Reinforcement Learning (RL) provides a…

Machine Learning · Computer Science 2019-11-12 Praveen Palanisamy

Traffic congestion in metropolitan areas is a world-wide problem that can be ameliorated by traffic lights that respond dynamically to real-time conditions. Recent studies applying deep reinforcement learning (RL) to optimize single traffic…

Machine Learning · Computer Science 2019-12-10 Zhi Zhang , Jiachen Yang , Hongyuan Zha

Multi-robot systems can benefit from reinforcement learning (RL) algorithms that learn behaviours in a small number of trials, a property known as sample efficiency. This research thus investigates the use of learned world models to improve…

Robotics · Computer Science 2021-03-08 Daniël Willemsen , Mario Coppola , Guido C. H. E. de Croon

In traffic signal control, flow-based (optimizing the overall flow) and pressure-based methods (equalizing and alleviating congestion) are commonly used but often considered separately. This study introduces a unified framework using…

Systems and Control · Electrical Eng. & Systems 2024-01-18 Chaolun Ma , Bruce Wang , Zihao Li , Ahmadreza Mahmoudzadeh , Yunlong Zhang

Many studies confirmed that a proper traffic state representation is more important than complex algorithms for the classical traffic signal control (TSC) problem. In this paper, we (1) present a novel, flexible and efficient method, namely…

Artificial Intelligence · Computer Science 2022-08-10 Liang Zhang , Qiang Wu , Jun Shen , Linyuan Lü , Bo Du , Jianqing Wu

Multi-Agent Proximal Policy Optimization (MAPPO) is a variant of the Proximal Policy Optimization (PPO) algorithm, specifically tailored for multi-agent reinforcement learning (MARL). MAPPO optimizes cooperative multi-agent settings by…

Machine Learning · Computer Science 2026-05-14 Changha Lee , Gyusang Cho

Reinforcement learning algorithms require a large amount of samples; this often limits their real-world applications on even simple tasks. Such a challenge is more outstanding in multi-agent tasks, as each step of operation is more costly…

Machine Learning · Computer Science 2022-09-05 Yali Du , Chengdong Ma , Yuchen Liu , Runji Lin , Hao Dong , Jun Wang , Yaodong Yang

This work considers the problem of learning cooperative policies in multi-agent settings with partially observable and non-stationary environments without a communication channel. We focus on improving information sharing between agents and…

Machine Learning · Computer Science 2021-09-03 Eshagh Kargar , Ville Kyrki

Traffic signal control has long been considered as a critical topic in intelligent transportation systems. Most existing learning methods mainly focus on isolated intersections and suffer from inefficient training. This paper aims at the…

Machine Learning · Computer Science 2019-10-01 Yusen Huo , Qinghua Tao , Jianming Hu

We implement the reinforcement learning agent for a spin-1 atomic system to prepare spin squeezed state from given initial state. Proximal policy gradient (PPO) algorithm is used to deal with continuous external control field and final…

Quantum Physics · Physics 2019-02-21 Jun-Jie Chen , Ming Xue

Multi-agent pathfinding (MAPF) has been widely used to solve large-scale real-world problems, e.g., automation warehouses. The learning-based, fully decentralized framework has been introduced to alleviate real-time problems and…

Robotics · Computer Science 2022-02-11 Wenhao Li , Hongjun Chen , Bo Jin , Wenzhe Tan , Hongyuan Zha , Xiangfeng Wang

Adaptive traffic signal control (ATSC) can effectively reduce vehicle travel times by dynamically adjusting signal timings but poses a critical challenge in real-world scenarios due to the complexity of real-time decision-making in dynamic…

Artificial Intelligence · Computer Science 2025-03-19 Yuxuan Wang , Meng Long , Qiang Wu , Wei Liu , Jiatian Pi , Xinmin Yang

Recently, Intelligent Transportation Systems are leveraging the power of increased sensory coverage and computing power to deliver data-intensive solutions achieving higher levels of performance than traditional systems. Within Traffic…

Machine Learning · Computer Science 2021-05-03 Alvaro Cabrejas-Egea , Raymond Zhang , Neil Walton

Novel advanced policy gradient (APG) methods, such as Trust Region policy optimization and Proximal policy optimization (PPO), have become the dominant reinforcement learning algorithms because of their ease of implementation and good…

Optimization and Control · Mathematics 2022-03-22 J. G. Dai , Mark Gluzman