English
Related papers

Related papers: Delay-Aware Multi-Agent Reinforcement Learning for…

200 papers

Traffic simulation is a cost-effective way to test the deployment of Cooperative Adaptive Cruise Control (CACC) vehicles in a large-scale transportation network. By using a previously developed microscopic simulation testbed, this paper…

Multiagent Systems · Computer Science 2019-09-04 Zijia Zhong , Joyoung Lee

Decentralized multi-agent control has broad applications, ranging from multi-robot cooperation to distributed sensor networks. In decentralized multi-agent control, systems are complex with unknown or highly uncertain dynamics, where…

Systems and Control · Electrical Eng. & Systems 2020-09-22 Qingrui Zhang , Hao Dong , Wei Pan

Reinforcement learning (RL) emerges as a promising data-driven approach for adaptive traffic signal control (ATSC) in complex urban traffic networks, with deep neural networks substantially augmenting its learning capabilities. However,…

Artificial Intelligence · Computer Science 2025-02-25 Yuli Zhang , Shangbo Wang , Dongyao Jia , Pengfei Fan , Ruiyuan Jiang , Hankang Gu , Andy H. F. Chow

Reinforcement learning (RL) is a promising data-driven approach for adaptive traffic signal control (ATSC) in complex urban traffic networks, and deep neural networks further enhance its learning power. However, centralized RL is infeasible…

Machine Learning · Computer Science 2019-03-13 Tianshu Chu , Jie Wang , Lara Codecà , Zhaojian Li

The upgrading and updating of vehicles have accelerated in the past decades. Out of the need for environmental friendliness and intelligence, electric vehicles (EVs) and connected and automated vehicles (CAVs) have become new components of…

Systems and Control · Electrical Eng. & Systems 2023-02-07 Xia Jiang , Jian Zhang , Xiaoyu Shi , Jian Cheng

As an emerging technology, Connected Autonomous Vehicles (CAVs) are believed to have the ability to move through intersections in a faster and safer manner, through effective Vehicle-to-Everything (V2X) communication and global observation.…

Multiagent Systems · Computer Science 2022-07-26 Guanzhou Li , Jianping Wu , Yujing He

This paper introduces a novel Multi-Agent Reinforcement Learning (MARL) framework to enhance integrated sensing and communication (ISAC) networks using unmanned aerial vehicle (UAV) swarms as sensing radars. By framing the positioning and…

Signal Processing · Electrical Eng. & Systems 2025-01-14 Obed Morrison Atsu , Salmane Naoumi , Roberto Bomfin , Marwa Chafii

Cooperative Adaptive Cruise Control (CACC) is a vehicular technology that allows groups of vehicles on the highway to form in closely-coupled automated platoons to increase highway capacity and safety, and decrease fuel consumption and CO2…

Systems and Control · Electrical Eng. & Systems 2021-06-22 Tianci Yang , Carlos Murguia , Dragan Nešić , Chen Lv

In this paper, we introduce an alternative approach to enhancing Multi-Agent Reinforcement Learning (MARL) through the integration of domain knowledge and attention-based policy mechanisms. Our methodology focuses on the incorporation of…

Machine Learning · Computer Science 2025-04-04 Andre R Kuroswiski , Annie S Wu , Angelo Passaro

Finding the optimal signal timing strategy is a difficult task for the problem of large-scale traffic signal control (TSC). Multi-Agent Reinforcement Learning (MARL) is a promising method to solve this problem. However, there is still room…

Machine Learning · Computer Science 2021-09-14 Xiaoqiang Wang , Liangjun Ke , Zhimin Qiao , Xinghua Chai

Cooperative platooning, enabled by cooperative adaptive cruise control (CACC), is a cornerstone technology for connected automated vehicles (CAVs), offering significant improvements in safety, comfort, and traffic efficiency over…

Systems and Control · Electrical Eng. & Systems 2026-01-21 Zeyu Mu , Sergei S. Avedisov , Ahmadreza Moradipari , B. Brian Park

This paper proposes a cooperative strategy of connected and automated vehicles (CAVs) longitudinal control for partially connected and automated traffic environment based on deep reinforcement learning (DRL) algorithm, which enhances the…

Systems and Control · Electrical Eng. & Systems 2020-12-04 Haotian Shi , Yang Zhou , Keshu Wu , Xin Wang , Yangxin Lin , Bin Ran

Timely delivery of delay-sensitive information over dynamic, heterogeneous networks is increasingly essential for a range of interactive applications, such as industrial automation, self-driving vehicles, and augmented reality. However,…

Networking and Internet Architecture · Computer Science 2025-10-14 Vincenzo Norman Vitale , Antonia Maria Tulino , Andreas F. Molisch , Jaime Llorca

The majority of current studies on autonomous vehicle control via deep reinforcement learning (DRL) utilize point-mass kinematic models, neglecting vehicle dynamics which includes acceleration delay and acceleration command dynamics. The…

Robotics · Computer Science 2019-12-17 Yuan Lin , John McPhee , Nasser L. Azad

Multi-Agent Reinforcement Learning (MARL) holds significant promise for enabling cooperative driving among Connected and Automated Vehicles (CAVs). However, its practical application is hindered by a critical limitation, i.e., insufficient…

Robotics · Computer Science 2025-12-01 Yuchen Shi , Huaxin Pei , Yi Zhang , Danya Yao

Real-world multi-agent reinforcement learning (MARL) systems must often operate under stale observations, stochastic communication delays, and intermittent packet loss. Policies trained under idealized synchronous conditions frequently…

Multiagent Systems · Computer Science 2026-05-27 Maxim Mednikov , Oren Gal

We develop a predictor-feedback cooperative adaptive cruise control (CACC) design relying on a multiple-predecessor-following (MPF) topology-based nominal delay-free CACC law. We consider vehicular platoons with heterogeneous vehicles,…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Amirhossein Samii , Dimitrios Angelopoulos , Nikolaos Bekiaris-Liberis

Cooperative Adaptive Cruise Control (CACC) is one of the driving applications of vehicular ad-hoc networks (VANETs) and promises to bring more efficient and faster transportation through cooperative behavior between vehicles. In CACC,…

Cryptography and Security · Computer Science 2017-12-11 Rens Wouter van der Heijden , Thomas Lukaseder , Frank Kargl

In real-world multi-agent systems (MASs), observation delays are ubiquitous, preventing agents from making decisions based on the environment's true state. An individual agent's local observation typically comprises multiple components from…

Multiagent Systems · Computer Science 2025-11-13 Songchen Fu , Siang Chen , Shaojing Zhao , Letian Bai , Ta Li , Yonghong Yan

This paper studies cooperative adaptive cruise control (CACC) for vehicle platoons with consideration of the unknown nonlinear vehicle dynamics that are normally ignored in the literature. A unified data-driven CACC design is proposed for…

Systems and Control · Electrical Eng. & Systems 2023-07-24 Jianglin Lan