English
Related papers

Related papers: DQN Control Solution for KDD Cup 2021 City Brain C…

200 papers

Adaptive traffic signal control, which adjusts traffic signal timing according to real-time traffic, has been shown to be an effective method to reduce traffic congestion. Available works on adaptive traffic signal control make responsive…

Networking and Internet Architecture · Computer Science 2017-05-09 Juntao Gao , Yulong Shen , Jia Liu , Minoru Ito , Norio Shiratori

Many existing traffic signal controllers are either simple adaptive controllers based on sensors placed around traffic intersections, or optimized by traffic engineers on a fixed schedule. Optimizing traffic controllers is time consuming…

Systems and Control · Electrical Eng. & Systems 2019-11-15 Kai Liang Tan , Subhadipto Poddar , Anuj Sharma , Soumik Sarkar

In recent years, there has been increasing amount of interest around meta reinforcement learning methods for traffic signal control, which have achieved better performance compared with traditional control methods. However, previous methods…

Machine Learning · Computer Science 2021-10-26 Yayi Zou , Zhiwei Qin

Due to the complexity and volatility of the traffic environment, decision-making in autonomous driving is a significantly hard problem. In this project, we use a Deep Q-Network, along with rule-based constraints to make lane-changing…

Robotics · Computer Science 2021-12-30 Mukesh Ghimire , Malobika Roy Choudhury , Guna Sekhar Sai Harsha Lagudu

This paper presents the results of a new deep learning model for traffic signal control. In this model, a novel state space approach is proposed to capture the main attributes of the control environment and the underlying temporal traffic…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Matthew Muresan , Liping Fu , Guangyuan Pan

This letter presents a deep reinforcement learning (DRL) approach for transmission design to optimize the energy efficiency in vehicle-to-vehicle (V2V) communication links. Considering the dynamic environment of vehicular communications,…

Signal Processing · Electrical Eng. & Systems 2024-04-22 Zhengpeng Wang , Yanqun Tang , Yingzhe Mao , Tao Wang , Xiunan Huang

Reinforcement Learning is proving a successful tool that can manage urban intersections with a fraction of the effort required to curate traditional traffic controllers. However, literature on the introduction and control of pedestrians to…

Machine Learning · Computer Science 2020-10-20 Alvaro Cabrejas-Egea , Colm Connaughton

Reinforcement learning is nowadays a popular framework for solving different decision making problems in automated driving. However, there are still some remaining crucial challenges that need to be addressed for providing more reliable…

Artificial Intelligence · Computer Science 2020-04-10 Danial Kamran , Carlos Fernandez Lopez , Martin Lauer , Christoph Stiller

Autonomous Vehicles (AVs), furnished with sensors capable of capturing essential vehicle dynamics such as speed, acceleration, and precise location, possess the capacity to execute intelligent maneuvers, including lane changes, in…

Machine Learning · Computer Science 2024-06-28 Emanuel Figetakis , Yahuza Bello , Ahmed Refaey , Abdallah Shami

Autonomous driving is a challenging domain that entails multiple aspects: a vehicle should be able to drive to its destination as fast as possible while avoiding collision, obeying traffic rules and ensuring the comfort of passengers. In…

Machine Learning · Computer Science 2019-02-28 Changjian Li , Krzysztof Czarnecki

The variable and unpredictable load demands in hybrid agricultural tractors make it difficult to design optimal rule-based energy management strategies, motivating the use of adaptive, learning-based control. However, existing approaches…

Systems and Control · Electrical Eng. & Systems 2025-08-06 Hend Abououf , Sidra Ghayour Bhatti , Qadeer Ahmed

Finding the optimal signal timing strategy is a difficult task for the problem of large-scale traffic signal control (TSC). Multi-Agent Reinforcement Learning (MARL) is a promising method to solve this problem. However, there is still room…

Machine Learning · Computer Science 2021-09-14 Xiaoqiang Wang , Liangjun Ke , Zhimin Qiao , Xinghua Chai

Online ride-hailing services have become a prevalent transportation system across the world. In this paper, we study a challenging problem of how to direct vacant taxis around a city such that supplies and demands can be balanced in online…

Machine Learning · Computer Science 2022-12-13 Jiyao Li , Vicki H. Allan

Existing inefficient traffic light control causes numerous problems, such as long delay and waste of energy. To improve efficiency, taking real-time traffic information as an input and dynamically adjusting the traffic light duration…

Machine Learning · Computer Science 2019-02-19 Xiaoyuan Liang , Xunsheng Du , Guiling Wang , Zhu Han

This paper presents a hierarchical path-planning and control framework that combines a high-level Deep Q-Network (DQN) for discrete sub-goal selection with a low-level Twin Delayed Deep Deterministic Policy Gradient (TD3) controller for…

Robotics · Computer Science 2025-10-31 Xiaoyi He , Danggui Chen , Zhenshuo Zhang , Zimeng Bai

Deep Q-Network (DQN) marked a major milestone for reinforcement learning, demonstrating for the first time that human-level control policies could be learned directly from raw visual inputs via reward maximization. Even years after its…

Machine Learning · Computer Science 2021-11-03 Brett Daley , Christopher Amato

Over the past decade, remarkable progress has been made in adopting deep neural networks to enhance the performance of conventional reinforcement learning. A notable milestone was the development of Deep Q-Networks (DQN), which achieved…

Systems and Control · Electrical Eng. & Systems 2025-07-14 Klinsmann Agyei , Pouria Sarhadi , Daniel Polani

In this thesis, I propose a family of fully decentralized deep multi-agent reinforcement learning (MARL) algorithms to achieve high, real-time performance in network-level traffic signal control. In this approach, each intersection is…

Machine Learning · Computer Science 2020-07-21 Jin Guo

We apply Deep Q-network (DQN) with the consideration of safety during the task for deciding whether to conduct the maneuver. Furthermore, we design two similar Deep Q learning frameworks with quadratic approximator for deciding how to…

Robotics · Computer Science 2019-07-31 Tianyu Shi , Pin Wang , Xuxin Cheng , Ching-Yao Chan , Ding Huang

This study proposes a novel adaptive traffic signal control method leveraging a Deep Q-Network (DQN) and Proximal Policy Optimization (PPO) to optimize signal timing by integrating variable cell length and multi-channel state…

Systems and Control · Electrical Eng. & Systems 2026-02-16 Maojiang Deng , Shoufeng Lu , Jiazhao Shi , Wen Zhang