English
Related papers

Related papers: TSC: Topology-Conditioned Stackelberg Coordination…

200 papers

Multi-agent Deep Reinforcement Learning (MADRL) based traffic signal control becomes a popular research topic in recent years. To alleviate the scalability issue of completely centralized RL techniques and the non-stationarity issue of…

Artificial Intelligence · Computer Science 2023-09-08 Hankang Gu , Shangbo Wang , Xiaoguang Ma , Dongyao Jia , Guoqiang Mao , Eng Gee Lim , Cheuk Pong Ryan Wong

This paper presents a novel two-level control architecture for a fully autonomous vehicle in a deterministic environment, which can handle traffic rules as specifications and low-level vehicle control with real-time performance. At the top…

Robotics · Computer Science 2021-05-07 Erfan Aasi , Cristian Ioan Vasile , Calin Belta

Generating safe and non-conservative behaviors in dense, dynamic environments remains challenging for automated vehicles due to the stochastic nature of traffic participants' behaviors and their implicit interaction with the ego vehicle.…

Robotics · Computer Science 2023-09-13 Tong Li , Lu Zhang , Sikang Liu , Shaojie Shen

In multi-agent reinforcement learning (MARL), self-interested agents attempt to establish equilibrium and achieve coordination depending on game structure. However, existing MARL approaches are mostly bound by the simultaneous actions of…

Multiagent Systems · Computer Science 2023-12-12 Bin Zhang , Lijuan Li , Zhiwei Xu , Dapeng Li , Guoliang Fan

Multi-agent reinforcement learning (MARL) suffers from the non-stationarity problem, which is the ever-changing targets at every iteration when multiple agents update their policies at the same time. Starting from first principle, in this…

Machine Learning · Computer Science 2022-12-05 Chuming Li , Jie Liu , Yinmin Zhang , Yuhong Wei , Yazhe Niu , Yaodong Yang , Yu Liu , Wanli Ouyang

We present a decentralized minimum-time trajectory optimization scheme based on learning model predictive control for multi-agent systems with nonlinear decoupled dynamics and coupled state constraints. By performing the same task…

Systems and Control · Electrical Eng. & Systems 2020-12-21 Edward L. Zhu , Yvonne R. Stürz , Ugo Rosolia , Francesco Borrelli

Persistent monitoring of dynamic targets is essential in real-world applications such as disaster response, environmental sensing, and wildlife conservation, where mobile agents must continuously gather information under uncertainty. We…

Multiagent Systems · Computer Science 2025-10-21 Xingjian Zhang , Yizhuo Wang , Guillaume Sartoretti

Active Traffic Management strategies are often adopted in real-time to address such sudden flow breakdowns. When queuing is imminent, Speed Harmonization (SH), which adjusts speeds in upstream traffic to mitigate traffic showckwaves…

Machine Learning · Computer Science 2020-10-13 Paul Young Joun Ha , Sikai Chen , Jiqian Dong , Runjia Du , Yujie Li , Samuel Labi

Traffic signal control (TSC) is crucial for reducing traffic congestion leading to smoother traffic flow, reduced idle time, and mitigated CO2 emissions. In this paper, we explore the computer vision approach for TSC that modulates on-road…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Pan He , Quanyi Li , Xiaoyong Yuan , Bolei Zhou

The advent of autonomous vehicles (AVs) alongside human-driven vehicles (HVs) has ushered in an era of mixed traffic flow, presenting a significant challenge: the intricate interaction between these entities within complex driving…

Robotics · Computer Science 2023-09-19 Jiaqi Liu , Donghao Zhou , Peng Hang , Ying Ni , Jian Sun

Coordinating actions is the most fundamental form of cooperation in multi-agent reinforcement learning (MARL). Successful decentralized decision-making often depends not only on good individual actions, but on selecting compatible actions…

Machine Learning · Computer Science 2026-02-24 Nikunj Gupta , James Zachary Hare , Jesse Milzman , Rajgopal Kannan , Viktor Prasanna

Traffic signal control (TSC) is a high-stakes domain that is growing in importance as traffic volume grows globally. An increasing number of works are applying reinforcement learning (RL) to TSC; RL can draw on an abundance of traffic data…

Artificial Intelligence · Computer Science 2022-10-05 Rex Chen , Fei Fang , Norman Sadeh

The empirical success of multi-agent reinforcement learning (MARL) has motivated the search for more efficient and scalable algorithms for large scale multi-agent systems. However, existing state-of-the-art algorithms do not fully exploit…

Multiagent Systems · Computer Science 2025-10-14 Shahbaz P Qadri Syed , He Bai

Traditional traffic optimization solutions assume that the graph structure of road networks is static, missing opportunities for further traffic flow optimization. We are interested in optimizing traffic flows as a new type of graph-based…

Systems and Control · Electrical Eng. & Systems 2019-10-16 Udesh Gunarathna , Hairuo Xie , Egemen Tanin , Shanika Karunasekara , Renata Borovica-Gajic

This paper studies the stability and convergence properties of a class of multi-agent concurrent learning (CL) algorithms with momentum and restart. Such algorithms can be integrated as part of the estimation pipelines of data-enabled…

Optimization and Control · Mathematics 2024-06-24 Daniel E. Ochoa , Muhammad U. Javed , Xudong Chen , Jorge I. Poveda

Applying reinforcement learning to autonomous driving entails particular challenges, primarily due to dynamically changing traffic flows. To address such challenges, it is necessary to quickly determine response strategies to the changing…

Robotics · Computer Science 2022-12-12 Se-Wook Yoo , Chan Kim , Jin-Woo Choi , Seong-Woo Kim , Seung-Woo Seo

The recent advancements in wireless technology enable connected autonomous vehicles (CAVs) to gather information about their environment by vehicle-to-vehicle (V2V) communication. In this work, we design an information-sharing-based…

Artificial Intelligence · Computer Science 2022-09-07 Songyang Han , Shanglin Zhou , Jiangwei Wang , Lynn Pepin , Caiwen Ding , Jie Fu , Fei Miao

Efficient traffic signal control (TSC) is crucial for reducing congestion, travel delays, pollution, and for ensuring road safety. Traditional approaches, such as fixed signal control and actuated control, often struggle to handle dynamic…

Systems and Control · Electrical Eng. & Systems 2025-09-29 Anirud Nandakumar , Chayan Banerjee , Lelitha Devi Vanajakshi

Traffic signal control has long been considered as a critical topic in intelligent transportation systems. Most existing learning methods mainly focus on isolated intersections and suffer from inefficient training. This paper aims at the…

Machine Learning · Computer Science 2019-10-01 Yusen Huo , Qinghua Tao , Jianming Hu

Trajectory planning in dense, interactive traffic scenarios presents significant challenges for autonomous vehicles, primarily due to the uncertainty of human driver behavior and the non-convex nature of collision avoidance constraints.…

Systems and Control · Electrical Eng. & Systems 2025-10-30 Erik Börve , Nikolce Murgovski , Leo Laine