English
Related papers

Related papers: DQN Control Solution for KDD Cup 2021 City Brain C…

200 papers

Reinforcement Learning algorithms have recently been proposed to learn time-sequential control policies in the field of autonomous driving. Direct applications of Reinforcement Learning algorithms with discrete action space will yield…

Machine Learning · Computer Science 2019-12-03 Pin Wang , Hanhan Li , Ching-Yao Chan

Smart traffic lights in intelligent transportation systems (ITSs) are envisioned to greatly increase traffic efficiency and reduce congestion. Deep reinforcement learning (DRL) is a promising approach to adaptively control traffic lights…

Machine Learning · Computer Science 2025-05-08 Ming Zhu , Xiao-Yang Liu , Sem Borst , Anwar Walid

Reinforcement learning has shown an outstanding performance in the applications of games, particularly in Atari games as well as Go. Based on these successful examples, we attempt to apply one of the well-known reinforcement learning…

Artificial Intelligence · Computer Science 2022-09-22 Curie Kim , Yewon Hwang , Jong-Hwan Kim

With the rapidly growing expansion in the use of UAVs, the ability to autonomously navigate in varying environments and weather conditions remains a highly desirable but as-of-yet unsolved challenge. In this work, we use Deep Reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2019-12-13 Bruna G. Maciel-Pearson , Letizia Marchegiani , Samet Akcay , Amir Atapour-Abarghouei , James Garforth , Toby P. Breckon

The growing demand for road use in urban areas has led to significant traffic congestion, posing challenges that are costly to mitigate through infrastructure expansion alone. As an alternative, optimizing existing traffic management…

Artificial Intelligence · Computer Science 2024-09-04 Muhammad Tahir Rafique , Ahmed Mustafa , Hasan Sajid

The control of traffic signals is crucial for improving transportation efficiency. Recently, learning-based methods, especially Deep Reinforcement Learning (DRL), garnered substantial success in the quest for more efficient traffic signal…

Artificial Intelligence · Computer Science 2025-06-18 Xiao-Cheng Liao , Yi Mei , Mengjie Zhang

Arterial traffic interacts with freeway traffic, yet the two are controlled independently. Arterial traffic signals do not take into account freeway traffic and how ramps control ingress traffic and have no control over egress traffic from…

Systems and Control · Electrical Eng. & Systems 2024-04-10 Tianchen Yuan , Petros A. Ioannou

Grant-free random access (RA) techniques are suitable for machine-type communication (MTC) networks but they need to be adaptive to the MTC traffic, which is different from the human-type communication. Conventional RA protocols such as…

Information Theory · Computer Science 2022-05-05 Muhammad Awais Jadoon , Adriano Pastore , Monica Navarro

Deep reinforcement learning is a technique for solving problems in a variety of environments, ranging from Atari video games to stock trading. This method leverages deep neural network models to make decisions based on observations of a…

Machine Learning · Computer Science 2022-09-13 Anthony Dowling

This dissertation proposes two solutions for urban traffic control in the presence of connected and automated vehicles. First a centralized platoon-based controller is proposed for the cooperative intersection management problem that takes…

Machine Learning · Computer Science 2020-12-11 Masoud Bashiri

This paper considers optimal traffic signal control in smart cities, which has been taken as a complex networked system control problem. Given the interacting dynamics among traffic lights and road networks, attaining controller adaptivity…

Machine Learning · Computer Science 2023-11-08 Yao Zhang , Zhiwen Yu , Jun Zhang , Liang Wang , Tom H. Luan , Bin Guo , Chau Yuen

Over the years, reinforcement learning has emerged as a popular approach to develop signal control and vehicle platooning strategies either independently or in a hierarchical way. However, jointly controlling both in real-time to alleviate…

Machine Learning · Computer Science 2025-08-13 Xianyue Peng , Shenyang Chen , Hang Gao , Hao Wang , H. Michael Zhang

Traffic light timing optimization is still an active line of research despite the wealth of scientific literature on the topic, and the problem remains unsolved for any non-toy scenario. One of the key issues with traffic light optimization…

Neural and Evolutionary Computing · Computer Science 2017-08-03 Noe Casas

In this paper, we provide the details of implementing various reinforcement learning (RL) algorithms for controlling a Cart-Pole system. In particular, we describe various RL concepts such as Q-learning, Deep Q Networks (DQN), Double DQN,…

Robotics · Computer Science 2020-06-15 Swagat Kumar

Lane-changing decisions, which are crucial for autonomous vehicle path planning, face practical challenges due to rule-based constraints and limited data. Deep reinforcement learning has become a major research focus due to its advantages…

Artificial Intelligence · Computer Science 2025-10-27 Xiaojun Bi , Mingjie He , Yiwen Sun

In Beyond 5G (B5G) networks, intelligent, flexible traffic management is essential to meet the stringent speed and reliability requirements of new applications. This paper presents an improved User Plane Function (eUPF) design that uses a…

Networking and Internet Architecture · Computer Science 2026-05-05 Rodrigo Moreira , Larissa Ferreira Rodrigues Moreira , Tereza Cristina Carvalho , Flávio de Oliveira Silva

Deep Reinforcement Learning (DRL) has shown its promising capabilities to learn optimal policies directly from trial and error. However, learning can be hindered if the goal of the learning, defined by the reward function, is "not optimal".…

Artificial Intelligence · Computer Science 2019-10-09 Yizheng Zhang , Andre Rosendo

Effective routing in satellite mega-constellations has become crucial to facilitate the handling of increasing traffic loads, more complex network architectures, as well as the integration into 6G networks. To enhance adaptability as well…

Networking and Internet Architecture · Computer Science 2024-08-06 Manuel M. H. Roth , Anupama Hegde , Thomas Delamotte , Andreas Knopp

Traffic prediction represents one of the crucial tasks for smartly optimizing the mobile network. Recently, Artificial Intelligence (AI) has attracted attention to solve this problem thanks to its ability in cognizing the state of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-30 Alfredo Petrella , Marco Miozzo , Paolo Dini

We present a traffic simulation named DeepTraffic where the planning systems for a subset of the vehicles are handled by a neural network as part of a model-free, off-policy reinforcement learning process. The primary goal of DeepTraffic is…

Neural and Evolutionary Computing · Computer Science 2019-01-04 Lex Fridman , Jack Terwilliger , Benedikt Jenik