English
Related papers

Related papers: Delay-Aware Reinforcement Learning for Highway On-…

200 papers

Unpredictable sensor-to-estimator delays fundamentally distort what matters for wireless remote state estimation: not just freshness, but how delay interacts with sensor informativeness and energy efficiency. In this paper, we present a…

Information Theory · Computer Science 2026-01-30 Nho-Duc Tran , Aamir Mahmood , Mikael Gidlund

In vehicular networks of the future, sensing and communication functionalities will be intertwined. In this paper, we investigate a radar-assisted predictive beamforming design for vehicle-to-infrastructure (V2I) communication by exploiting…

Signal Processing · Electrical Eng. & Systems 2020-01-28 Fan Liu , Weijie Yuan , Christos Masouros , Jinhong Yuan

Cooperative Adaptive Cruise Control (CACC) represents a quintessential control strategy for orchestrating vehicular platoon movement within Connected and Automated Vehicle (CAV) systems, significantly enhancing traffic efficiency and…

Robotics · Computer Science 2024-05-14 Jiaqi Liu , Ziran Wang , Peng Hang , Jian Sun

Reinforcement learning (RL) is a promising data-driven approach for adaptive traffic signal control (ATSC) in complex urban traffic networks, and deep neural networks further enhance its learning power. However, centralized RL is infeasible…

Machine Learning · Computer Science 2019-03-13 Tianshu Chu , Jie Wang , Lara Codecà , Zhaojian Li

Reinforcement Learning (RL) in Traffic Signal Control (TSC) faces significant hurdles in real-world deployment due to limited generalization to dynamic traffic flow variations. Existing approaches often overfit static patterns and use…

Artificial Intelligence · Computer Science 2026-03-13 Sheng-You Huang , Hsiao-Chuan Chang , Yen-Chi Chen , Ting-Han Wei , I-Hau Yeh , Sheng-Yao Kuan , Chien-Yao Wang , Hsuan-Han Lee , I-Chen Wu

Coordinating intersections in arterial networks is critical to the performance of urban transportation systems. Deep reinforcement learning (RL) has gained traction in traffic control research along with data-driven approaches for traffic…

Systems and Control · Electrical Eng. & Systems 2022-08-30 Keith Anshilo Diaz , Damian Dailisan , Umang Sharaf , Carissa Santos , Qijian Gan , Francis Aldrine Uy , May T. Lim , Alexandre M. Bayen

Delayed Markov decision processes (DMDPs) fulfill the Markov property by augmenting the state space of agents with a finite time window of recently committed actions. In reliance on these state augmentations, delay-resolved reinforcement…

Robotics · Computer Science 2025-11-17 Mohammadhossein Malmir , Josip Josifovski , Noah Klarmann , Alois Knoll

The capability to learn and adapt to changes in the driving environment is crucial for developing autonomous driving systems that are scalable beyond geo-fenced operational design domains. Deep Reinforcement Learning (RL) provides a…

Machine Learning · Computer Science 2019-11-12 Praveen Palanisamy

Intelligent transportation systems require connected and automated vehicles (CAVs) to conduct safe and efficient cooperation with human-driven vehicles (HVs) in complex real-world traffic environments. However, the inherent unpredictability…

Multiagent Systems · Computer Science 2025-06-17 Jie Pan , Tianyi Wang , Christian Claudel , Jing Shi

The deployment of Autonomous Vehicles (AVs) poses considerable challenges and unique opportunities for the design and management of future urban road infrastructure. In light of this disruptive transformation, the Right-Of-Way (ROW)…

Machine Learning · Computer Science 2023-03-23 Qiming Ye , Yuxiang Feng , Jose Javier Escribano Macias , Marc Stettler , Panagiotis Angeloudis

Lane change decision-making for autonomous vehicles is a complex but high-reward behavior. In this paper, we propose a hybrid input based deep reinforcement learning (DRL) algorithm, which realizes abstract lane change decisions and lane…

Robotics · Computer Science 2025-09-03 Ziteng Gao , Jiaqi Qu , Chaoyu Chen

Reinforcement learning (RL) emerges as a promising data-driven approach for adaptive traffic signal control (ATSC) in complex urban traffic networks, with deep neural networks substantially augmenting its learning capabilities. However,…

Artificial Intelligence · Computer Science 2025-02-25 Yuli Zhang , Shangbo Wang , Dongyao Jia , Pengfei Fan , Ruiyuan Jiang , Hankang Gu , Andy H. F. Chow

Reinforcement learning (RL) is challenging in the common case of delays between events and their sensory perceptions. State-of-the-art (SOTA) state augmentation techniques either suffer from state space explosion or performance degeneration…

Machine Learning · Computer Science 2024-06-07 Qingyuan Wu , Simon Sinong Zhan , Yixuan Wang , Yuhui Wang , Chung-Wei Lin , Chen Lv , Qi Zhu , Jürgen Schmidhuber , Chao Huang

Ineffective and inflexible traffic signal control at urban intersections can often lead to bottlenecks in traffic flows and cause congestion, delay, and environmental problems. How to manage traffic smartly by intelligent signal control is…

Systems and Control · Computer Science 2019-05-21 Mengyu Guo , Pin Wang , Ching-Yao Chan , Sid Askary

Ramp metering that uses traffic signals to regulate vehicle flows from the on-ramps has been widely implemented to improve vehicle mobility of the freeway. Previous studies generally update signal timings in real-time based on predefined…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Bing Liu , Yu Tang , Yuxiong Ji , Yu Shen , Yuchuan Du

Adaptive Traffic Signal Control (ATSC) has become a popular research topic in intelligent transportation systems. Regional Traffic Signal Control (RTSC) using the Multi-agent Deep Reinforcement Learning (MADRL) technique has become a…

Multiagent Systems · Computer Science 2025-02-20 Hankang Gu , Shangbo Wang , Dongyao Jia , Yuli Zhang , Yanrong Luo , Guoqiang Mao , Jianping Wang , Eng Gee Lim

The rapid advancements of Internet of Things (IoT) and artificial intelligence (AI) have catalyzed the development of adaptive traffic signal control systems (ATCS) for smart cities. In particular, deep reinforcement learning (DRL) methods…

Machine Learning · Computer Science 2021-11-05 Ao Qu , Yihong Tang , Wei Ma

This paper presents a LiDAR-based end-to-end autonomous driving method with Vehicle-to-Everything (V2X) communication integration, termed V2X-Lead, to address the challenges of navigating unregulated urban scenarios under mixed-autonomy…

Robotics · Computer Science 2023-09-28 Zhiyun Deng , Yanjun Shi , Weiming Shen

Cellular vehicle-to-everything (V2X) communication is crucial to support future diverse vehicular applications. However, for safety-critical applications, unstable vehicle-to-vehicle (V2V) links and high signalling overhead of centralized…

Networking and Internet Architecture · Computer Science 2020-02-19 Xinran Zhang , Mugen Peng , Shi Yan , Yaohua Sun

Deep reinforcement learning (DRL) methods have demonstrated potential for autonomous navigation and obstacle avoidance of unmanned ground vehicles (UGVs) in crowded environments. Most existing approaches rely on single-frame observation and…

Robotics · Computer Science 2026-01-01 Ruitong Li , Lin Zhang , Yuenan Zhao , Chengxin Liu , Ran Song , Wei Zhang