English
Related papers

Related papers: Mitigating Partial Observability in Adaptive Traff…

200 papers

Model predictive control (MPC) has established itself as the primary methodology for constrained control, enabling general-purpose robot autonomy in diverse real-world scenarios. However, for most problems of interest, MPC relies on the…

The way of analyzing, designing and building of real-time projects has been changed due to the rapid growth of internet, mobile technologies and intelligent applications. Most of these applications are intelligent, tiny and distributed…

Multiagent Systems · Computer Science 2011-08-03 Venkatesh. M , K. Kumar , Srinivas. V

Inefficient traffic signal control methods may cause numerous problems, such as traffic congestion and waste of energy. Reinforcement learning (RL) is a trending data-driven approach for adaptive traffic signal control in complex urban…

Signal Processing · Electrical Eng. & Systems 2021-07-14 Zhenning Li , Chengzhong Xu , Guohui Zhang

The goal of this work is to provide a viable solution based on reinforcement learning for traffic signal control problems. Although the state-of-the-art reinforcement learning approaches have yielded great success in a variety of domains,…

Machine Learning · Computer Science 2020-05-20 Yueh-Hua Wu , I-Hau Yeh , David Hu , Hong-Yuan Mark Liao

Adaptive traffic signal control (ATSC) is crucial in alleviating congestion, maximizing throughput and promoting sustainable mobility in ever-expanding cities. Multi-Agent Reinforcement Learning (MARL) has recently shown significant…

Machine Learning · Computer Science 2026-03-26 Yifeng Zhang , Harsh Goel , Peizhuo Li , Mehul Damani , Sandeep Chinchali , Guillaume Sartoretti

The rapid advancements of Internet of Things (IoT) and artificial intelligence (AI) have catalyzed the development of adaptive traffic signal control systems (ATCS) for smart cities. In particular, deep reinforcement learning (DRL) methods…

Machine Learning · Computer Science 2021-11-05 Ao Qu , Yihong Tang , Wei Ma

We develop adaptive data-driven traffic light controllers for a grid-like traffic network considering straight, left-turn, and right-turn traffic flows. The analysis incorporates transit delays and blocking effects on vehicle movements…

Systems and Control · Electrical Eng. & Systems 2024-04-29 Yingqing Chen , Christos G. Cassandras

Autonomous Vehicles (AVs) represent a transformative advancement in the transportation industry. These vehicles have sophisticated sensors, advanced algorithms, and powerful computing systems that allow them to navigate and operate without…

Signal Processing · Electrical Eng. & Systems 2025-01-03 Noor Aboueleneen , Yahuza Bello , Abdullatif Albaseer , Ahmed Refaey Hussein , Mohamed Abdallah , Ekram Hossain

A driving algorithm that aligns with good human driving practices, or at the very least collaborates effectively with human drivers, is crucial for developing safe and efficient autonomous vehicles. In practice, two main approaches are…

Multiagent Systems · Computer Science 2026-02-10 Zhihao Zhang , Keith Redmill , Chengyang Peng , Bowen Weng

Reinforcement learning (RL) is gaining popularity as an effective approach for traffic signal control (TSC) and is increasingly applied in this domain. However, most existing RL methodologies are confined to a single-stage TSC framework,…

Machine Learning · Computer Science 2024-05-03 Liang Zhang , Yutong Zhang , Shubin Xie , Jianming Deng , Chen Li

Autonomous vehicles are the upcoming solution to most transportation problems such as safety, comfort and efficiency. The steering control is one of the main important tasks in achieving autonomous driving. Model predictive control (MPC) is…

Optimization and Control · Mathematics 2025-09-23 Yassine Kebbati , Vicenç Puig , Naima Ait-Oufroukh , Vincent Vigneron , Dalil Ichalal

Scalable multi-agent driving simulation requires behavior models that are both realistic and computationally efficient. We address this by optimizing the behavior model that controls individual traffic participants. To improve efficiency,…

Robotics · Computer Science 2026-04-15 Fabian Konstantinidis , Moritz Sackmann , Ulrich Hofmann , Christoph Stiller

Applying reinforcement learning to autonomous driving entails particular challenges, primarily due to dynamically changing traffic flows. To address such challenges, it is necessary to quickly determine response strategies to the changing…

Robotics · Computer Science 2022-12-12 Se-Wook Yoo , Chan Kim , Jin-Woo Choi , Seong-Woo Kim , Seung-Woo Seo

Deep reinforcement learning (RL) has shown immense potential for learning to control systems through data alone. However, one challenge deep RL faces is that the full state of the system is often not observable. When this is the case, the…

Machine Learning · Computer Science 2023-10-27 Ian Char , Jeff Schneider

This study proposes a delay-compensated feedback controller based on proximal policy optimization (PPO) reinforcement learning to stabilize traffic flow in the congested regime by manipulating the time-gap of adaptive cruise…

Artificial Intelligence · Computer Science 2023-01-18 Shurong Mo , Nailong Wu , Jie Qi , Anqi Pan , Zhiguang Feng , Huaicheng Yan , Yueying Wang

Camera-based adaptive traffic signal control is inherently partially observable: detections can be missed, vehicle speeds and distances can be noisy, and a phase-change decision becomes temporally irreversible once yellow onset is…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jayawant Bodagala , Balaji Bodagala

The difficulty of optimal control problems has classically been characterized in terms of system properties such as minimum eigenvalues of controllability/observability gramians. We revisit these characterizations in the context of the…

Machine Learning · Computer Science 2021-04-05 Jingxi Xu , Bruce Lee , Nikolai Matni , Dinesh Jayaraman

Urban traffic congestion is a critical predicament that plagues modern road networks. To alleviate this issue and enhance traffic efficiency, traffic signal control and vehicle routing have proven to be effective measures. In this paper, we…

Systems and Control · Electrical Eng. & Systems 2023-10-18 Xianyue Peng , Hang Gao , Gengyue Han , Hao Wang , Michael Zhang

This paper introduces an efficient Residual Reinforcement Learning (RRL) framework for voltage control in active distribution grids. Voltage control remains a critical challenge in distribution grids, where conventional Reinforcement…

Systems and Control · Electrical Eng. & Systems 2025-12-30 Sarra Bouchkati , Ramil Sabirov , Steffen Kortmann , Andreas Ulbig

We propose AttendLight, an end-to-end Reinforcement Learning (RL) algorithm for the problem of traffic signal control. Previous approaches for this problem have the shortcoming that they require training for each new intersection with a…

Machine Learning · Computer Science 2020-10-13 Afshin Oroojlooy , Mohammadreza Nazari , Davood Hajinezhad , Jorge Silva