English
Related papers

Related papers: Towards a Very Large Scale Traffic Simulator for M…

200 papers

This paper introduces a Deep Reinforcement Learning (DRL) based TCP congestion-control algorithm that uses a Deep Q-Network (DQN) to adapt the congestion window (cWnd) dynamically based on observed network state. The proposed approach…

Networking and Internet Architecture · Computer Science 2026-01-21 Efe Ağlamazlar , Emirhan Eken , Harun Batur Geçici

With the development of artificial intelligence techniques, transportation system optimization is evolving from traditional methods relying on expert experience to simulation and learning-based decision and optimization methods.…

Artificial Intelligence · Computer Science 2024-10-03 Jun Zhang , Wenxuan Ao , Junbo Yan , Depeng Jin , Yong Li

Multiple automakers have in development or in production automated driving systems (ADS) that offer freeway-pilot functions. This type of ADS is typically limited to restricted-access freeways only, that is, the transition from manual to…

Machine Learning · Computer Science 2019-02-05 Pin Wang , Ching-Yao Chan

The rapid introduction of mobile navigation aides that use real-time road network information to suggest alternate routes to drivers is making it more difficult for researchers and government transportation agencies to understand and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-27 Cy Chan , Anu Kuncheria , Jane Macfarlane

Visual navigation is essential for many applications in robotics, from manipulation, through mobile robotics to automated driving. Deep reinforcement learning (DRL) provides an elegant map-free approach integrating image processing,…

Robotics · Computer Science 2020-10-22 Jonáš Kulhánek , Erik Derner , Robert Babuška

Urban autonomous driving decision making is challenging due to complex road geometry and multi-agent interactions. Current decision making methods are mostly manually designing the driving policy, which might result in sub-optimal solutions…

Machine Learning · Computer Science 2019-10-23 Jianyu Chen , Bodi Yuan , Masayoshi Tomizuka

Deep Reinforcement Learning (DRL) enhances the efficiency of Autonomous Vehicles (AV), but also makes them susceptible to backdoor attacks that can result in traffic congestion or collisions. Backdoor functionality is typically incorporated…

Machine Learning · Computer Science 2023-03-28 Yue Wang , Wending Li , Michail Maniatakos , Saif Eddin Jabari

Deep reinforcement learning (DRL) is an emerging methodology that is transforming the way many complicated transportation decision-making problems are tackled. Researchers have been increasingly turning to this powerful learning-based…

Machine Learning · Computer Science 2020-10-14 Nahid Parvez Farazi , Tanvir Ahamed , Limon Barua , Bo Zou

Deep Reinforcement Learning (DRL) has recently been proposed as a methodology to discover complex Active Flow Control (AFC) strategies [Rabault, J., Kuchta, M., Jensen, A., Reglade, U., & Cerardi, N. (2019): "Artificial neural networks…

Computational Physics · Physics 2019-10-23 Jean Rabault , Alexander Kuhnle

The dynamic nature of driving environments and the presence of diverse road users pose significant challenges for decision-making in autonomous driving. Deep reinforcement learning (DRL) has emerged as a popular approach to tackle this…

Robotics · Computer Science 2025-09-29 Iman Sharifi , Mustafa Yildirim , Saber Fallah

Traffic microsimulation is a crucial tool that uses microscopic traffic models, such as car-following and lane-change models, to simulate the trajectories of individual agents. This digital platform allows for the assessment of the impact…

Applications · Statistics 2024-10-01 Yanbing Wang , Felipe de Souza , Dominik Karbowski

Deep Reinforcement Learning (DRL) has become increasingly powerful in recent years, with notable achievements such as Deepmind's AlphaGo. It has been successfully deployed in commercial vehicles like Mobileye's path planning system.…

Machine Learning · Computer Science 2019-01-17 Victor Talpaert , Ibrahim Sobh , B Ravi Kiran , Patrick Mannion , Senthil Yogamani , Ahmad El-Sallab , Patrick Perez

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency…

Machine Learning · Computer Science 2022-02-08 Renke Huang , Yujiao Chen , Tianzhixi Yin , Qiuhua Huang , Jie Tan , Wenhao Yu , Xinya Li , Ang Li , Yan Du

Human-driven vehicles (HVs) amplify naturally occurring perturbations in traffic, leading to congestion--a major contributor to increased fuel consumption, higher collision risks, and reduced road capacity utilization. While previous…

Robotics · Computer Science 2024-03-26 Bibek Poudel , Weizi Li , Kevin Heaslip

The augmented scale and complexity of urban transportation networks have significantly increased the execution time and resource requirements of vehicular network simulations, exceeding the capabilities of sequential simulators. The need…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-08 Mohammad A Hoque , Xiaoyan Hong , Md Salman Ahmed

Real-time path planning in constrained environments remains a fundamental challenge for autonomous systems. Traditional classical planners, while effective under perfect perception assumptions, are often sensitive to real-world perception…

Robotics · Computer Science 2026-02-02 Feng Tao , Luca Paparusso , Chenyi Gu , Robin Koehler , Chenxu Wu , Xinyu Huang , Christian Juette , David Paz , Ren Liu

Variable speed limit (VSL) control is an established yet challenging problem to improve freeway traffic mobility and alleviate bottlenecks by customizing speed limits at proper locations based on traffic conditions. Recent advances in deep…

Systems and Control · Electrical Eng. & Systems 2024-05-16 Jingwen Yang , Ping Wang , Fatemeh Golpayegani , Shen Wang

Reinforcement learning (RL) has attracted increasing interest for adaptive traffic signal control due to its model-free ability to learn control policies directly from interaction with the traffic environment. However, several challenges…

Machine Learning · Computer Science 2026-03-17 Dickens Kwesiga , Angshuman Guin , Khaled Abdelghany , Michael Hunter

Deep reinforcement learning (DRL) has emerged as a powerful paradigm for solving complex decision-making problems. However, DRL-based systems still face significant dependability challenges particularly in real-time environments due to the…

Software Engineering · Computer Science 2026-03-25 Guoxin Su , Thomas Robinson , Hoa Khanh Dam , Li Liu , David S. Rosenblum

Traffic congestion in metropolitan areas is a world-wide problem that can be ameliorated by traffic lights that respond dynamically to real-time conditions. Recent studies applying deep reinforcement learning (RL) to optimize single traffic…

Machine Learning · Computer Science 2019-12-10 Zhi Zhang , Jiachen Yang , Hongyuan Zha