English
Related papers

Related papers: Towards a Very Large Scale Traffic Simulator for M…

200 papers

Traffic simulations are commonly used to optimize urban traffic flow, with reinforcement learning (RL) showing promising potential for automated traffic signal control, particularly in intelligent transportation systems involving connected…

Systems and Control · Electrical Eng. & Systems 2025-09-19 Talha Azfar , Kaicong Huang , Andrew Tracy , Sandra Misiewicz , Chenxi Liu , Ruimin Ke

Vehicle Twins (VTs) as digital representations of vehicles can provide users with immersive experiences in vehicular metaverse applications, e.g., Augmented Reality (AR) navigation and embodied intelligence. VT migration is an effective way…

Networking and Internet Architecture · Computer Science 2025-04-01 Junlong Chen , Jiawen Kang , Minrui Xu , Fan Wu , Hongliang Zhang , Huawei Huang , Dusit Niyato , Shiwen Mao

Urban traffic congestion is a critical predicament that plagues modern road networks. To alleviate this issue and enhance traffic efficiency, traffic signal control and vehicle routing have proven to be effective measures. In this paper, we…

Systems and Control · Electrical Eng. & Systems 2023-10-18 Xianyue Peng , Hang Gao , Gengyue Han , Hao Wang , Michael Zhang

Traffic optimization challenges, such as load balancing, flow scheduling, and improving packet delivery time, are difficult online decision-making problems in wide area networks (WAN). Complex heuristics are needed for instance to find…

Networking and Internet Architecture · Computer Science 2021-12-01 Shan Sun , Mariam Kiran , Wei Ren

Recently, Intelligent Transportation Systems are leveraging the power of increased sensory coverage and computing power to deliver data-intensive solutions achieving higher levels of performance than traditional systems. Within Traffic…

Machine Learning · Computer Science 2021-05-03 Alvaro Cabrejas-Egea , Raymond Zhang , Neil Walton

Traffic microsimulators are widely used to evaluate road network performance under various ``what-if" conditions. However, the behavior models controlling the actions of the actors are overly simplistic and fails to capture realistic…

Machine Learning · Computer Science 2026-03-20 Yash Ranjan , Rahul Sengupta , Anand Rangarajan , Sanjay Ranka

Environment sensing and fusion via onboard sensors are envisioned to be widely applied in future autonomous driving networks. This paper considers a vehicular system with multiple self-driving vehicles that is assisted by multi-access edge…

Machine Learning · Computer Science 2025-03-26 Xueyao Zhang , Bo Yang , Xuelin Cao , Zhiwen Yu , George C. Alexandropoulos , Yan Zhang , Merouane Debbah , Chau Yuen

Deep reinforcement learning (DRL) has emerged as a pervasive and potent methodology for addressing artificial intelligence challenges. Due to its substantial potential for autonomous self-learning and self-improvement, DRL finds broad…

Artificial Intelligence · Computer Science 2023-10-10 Teng Liu , Yuyou Yang , Wenxuan Xiao , Xiaolin Tang , Mingzhu Yin

Existing ineffective and inflexible traffic light control at urban intersections can often lead to congestion in traffic flows and cause numerous problems, such as long delay and waste of energy. How to find the optimal signal timing…

Machine Learning · Computer Science 2020-09-30 Chenguang Zhao , Xiaorong Hu , Gang Wang

Intelligent Traffic Light Control System (ITLCS) is a typical Multi-Agent System (MAS), which comprises multiple roads and traffic lights.Constructing a model of MAS for ITLCS is the basis to alleviate traffic congestion. Existing…

Machine Learning · Computer Science 2022-07-06 Ruijie Zhu , Lulu Li , Shuning Wu , Pei Lv , Yafai Li , Mingliang Xu

Effective network congestion control strategies are key to keeping the Internet (or any large computer network) operational. Network congestion control has been dominated by hand-crafted heuristics for decades. Recently,…

An emerging public health application of connected and automated vehicle (CAV) technologies is to reduce response times of emergency medical service (EMS) by indirectly coordinating traffic. Therefore, in this work we study the CAV-assisted…

Robotics · Computer Science 2023-12-19 Dajiang Suo , Vindula Jayawardana , Cathy Wu

Developing an automated driving system capable of navigating complex traffic environments remains a formidable challenge. Unlike rule-based or supervised learning-based methods, Deep Reinforcement Learning (DRL) based controllers eliminate…

Machine Learning · Computer Science 2025-01-28 Zhihao Zhang , Ekim Yurtsever , Keith A. Redmill

Combining data-driven applications with control systems plays a key role in recent Autonomous Car research. This thesis offers a structured review of the latest literature on Deep Reinforcement Learning (DRL) within the realm of autonomous…

Robotics · Computer Science 2024-04-02 Yiyang Chen , Chao Ji , Yunrui Cai , Tong Yan , Bo Su

Designing traffic-smoothing cruise controllers that can be deployed onto autonomous vehicles is a key step towards improving traffic flow, reducing congestion, and enhancing fuel efficiency in mixed autonomy traffic. We bypass the common…

Systems and Control · Electrical Eng. & Systems 2024-01-19 Nathan Lichtlé , Kathy Jang , Adit Shah , Eugene Vinitsky , Jonathan W. Lee , Alexandre M. Bayen

Academic research in the field of autonomous vehicles has reached high popularity in recent years related to several topics as sensor technologies, V2X communications, safety, security, decision making, control, and even legal and…

Machine Learning · Computer Science 2020-01-31 Szilárd Aradi

Traffic congestion has been a major challenge in many urban road networks. Extensive research studies have been conducted to highlight traffic-related congestion and address the issue using data-driven approaches. Currently, most traffic…

Artificial Intelligence · Computer Science 2023-12-12 Shyam Pratap Singh , Arshad Ali Khan , Riad Souissi , Syed Adnan Yusuf

Lane change decision-making for autonomous vehicles is a complex but high-reward behavior. In this paper, we propose a hybrid input based deep reinforcement learning (DRL) algorithm, which realizes abstract lane change decisions and lane…

Robotics · Computer Science 2025-09-03 Ziteng Gao , Jiaqi Qu , Chaoyu Chen

Reinforcement Learning (RL) in Traffic Signal Control (TSC) faces significant hurdles in real-world deployment due to limited generalization to dynamic traffic flow variations. Existing approaches often overfit static patterns and use…

Artificial Intelligence · Computer Science 2026-03-13 Sheng-You Huang , Hsiao-Chuan Chang , Yen-Chi Chen , Ting-Han Wei , I-Hau Yeh , Sheng-Yao Kuan , Chien-Yao Wang , Hsuan-Han Lee , I-Chen Wu

Recent advances in supervised learning and reinforcement learning have provided new opportunities to apply related methodologies to automated driving. However, there are still challenges to achieve automated driving maneuvers in dynamically…

Machine Learning · Computer Science 2020-08-31 Fei Ye , Pin Wang , Ching-Yao Chan , Jiucai Zhang