English
Related papers

Related papers: Deep Deterministic Policy Gradient for Urban Traff…

200 papers

The combination of Artificial Intelligence (AI) and Internet-of-Things (IoT), which is denoted as AI-powered Internet-of-Things (AIoT), is capable of processing huge amount of data generated from a large number of devices and handling…

Systems and Control · Computer Science 2017-11-30 Ying Liu , Lei Liu , Wei-Peng Chen

Steering traffic in cities is a very complex task, since improving efficiency involves the coordination of many actors. Traditional approaches attempt to optimize traffic lights for a particular density and configuration of traffic. The…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 Carlos Gershenson

In this paper we design and evaluate a Deep-Reinforcement Learning agent that optimizes routing. Our agent adapts automatically to current traffic conditions and proposes tailored configurations that attempt to minimize the network delay.…

Networking and Internet Architecture · Computer Science 2017-09-22 Giorgio Stampa , Marta Arias , David Sanchez-Charles , Victor Muntes-Mulero , Albert Cabellos

Autonomous ground vehicle (UGV) navigation has the potential to revolutionize the transportation system by increasing accessibility to disabled people, ensure safety and convenience of use. However, UGV requires extensive and efficient…

Robotics · Computer Science 2024-03-25 Kabirat Olayemi , Mien Van , Sean McLoone , Yuzhu Sun , Jack Close , Nguyen Minh Nhat , Stephen McIlvanna

Reinforcement learning algorithms require a large amount of samples; this often limits their real-world applications on even simple tasks. Such a challenge is more outstanding in multi-agent tasks, as each step of operation is more costly…

Machine Learning · Computer Science 2022-09-05 Yali Du , Chengdong Ma , Yuchen Liu , Runji Lin , Hao Dong , Jun Wang , Yaodong Yang

Traffic light detection is a challenging problem in the context of self-driving cars and driver assistance systems. While most existing systems produce good results on large traffic lights, detecting small and tiny ones is often overlooked.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Tom Sanitz , Christian Wilms , Simone Frintrop

Distributed online optimization and game have been increasingly researched in the last decade, mostly motivated by its wide applications in sensor networks, robotics (e.g., distributed target tracking and formation control), smart grids,…

Machine Learning · Computer Science 2023-01-24 Xiuxian Li , Lihua Xie , Na Li

Traffic Signal Control (TSC) is a crucial component in urban traffic management, aiming to optimize road network efficiency and reduce congestion. Traditional TSC methods, primarily based on transportation engineering and reinforcement…

Artificial Intelligence · Computer Science 2024-12-18 Siqi Lai , Zhao Xu , Weijia Zhang , Hao Liu , Hui Xiong

In modern transportation systems, an enormous amount of traffic data is generated every day. This has led to rapid progress in short-term traffic prediction (STTP), in which deep learning methods have recently been applied. In traffic…

Machine Learning · Computer Science 2020-09-03 Kyungeun Lee , Moonjung Eo , Euna Jung , Yoonjin Yoon , Wonjong Rhee

A macroscopic model is proposed to depict the traffic dynamics involved in urban traffic systems. The link dynamics are described based on the cell-transmission model and bounded by the link capacities, while the flow dynamics are proposed…

Optimization and Control · Mathematics 2020-02-25 Yicheng Zhang

Deep Reinforcement Learning (DRL) techniques have received significant attention in control and decision-making algorithms. Most applications involve complex decision-making systems, justified by the algorithms' computational power and…

Systems and Control · Electrical Eng. & Systems 2024-02-28 Fatemeh Tavakkoli , Pouria Sarhadi , Benoit Clement , Wasif Naeem

Deep Reinforcement Learning (DRL) is regarded as a potential method for car-following control and has been mostly studied to support a single following vehicle. However, it is more challenging to learn a stable and efficient car-following…

Systems and Control · Electrical Eng. & Systems 2022-11-21 Tong Liu , Lei Lei , Kan Zheng , Kuan Zhang

Deep Deterministic Policy Gradient (DDPG) has been proved to be a successful reinforcement learning (RL) algorithm for continuous control tasks. However, DDPG still suffers from data insufficiency and training inefficiency, especially in…

Machine Learning · Computer Science 2019-03-05 Zhizheng Zhang , Jiale Chen , Zhibo Chen , Weiping Li

Traffic signal control has a great impact on alleviating traffic congestion in modern cities. Deep reinforcement learning (RL) has been widely used for this task in recent years, demonstrating promising performance but also facing many…

Artificial Intelligence · Computer Science 2024-04-02 Liwen Zhu , Peixi Peng , Zongqing Lu , Yonghong Tian

This paper explores the method of achieving autonomous navigation of unmanned vehicles through Deep Reinforcement Learning (DRL). The focus is on using the Deep Deterministic Policy Gradient (DDPG) algorithm to address issues in…

Robotics · Computer Science 2024-07-30 Letian Xu , Jiabei Liu , Haopeng Zhao , Tianyao Zheng , Tongzhou Jiang , Lipeng Liu

In this work, we study adaptive data-guided traffic planning and control using Reinforcement Learning (RL). We shift from the plain use of classic methods towards state-of-the-art in deep RL community. We embed several recent techniques in…

Machine Learning · Computer Science 2020-07-23 Siavash Alemzadeh , Ramin Moslemi , Ratnesh Sharma , Mehran Mesbahi

To safely and efficiently navigate in complex urban traffic, autonomous vehicles must make responsible predictions in relation to surrounding traffic-agents (vehicles, bicycles, pedestrians, etc.). A challenging and critical task is to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Yuexin Ma , Xinge Zhu , Sibo Zhang , Ruigang Yang , Wenping Wang , Dinesh Manocha

This paper proposes a new framework for distributed optimization, called distributed aggregative optimization, which allows local objective functions to be dependent not only on their own decision variables, but also on the average of…

Optimization and Control · Mathematics 2020-05-28 Xiuxian Li , Lihua Xie , Yiguang Hong

City-scale traffic signal control (TSC) involves thousands of heterogeneous intersections with varying topologies, making cooperative decision-making across intersections particularly challenging. Given the prohibitive computational cost of…

Systems and Control · Electrical Eng. & Systems 2025-08-07 Jinwei Zeng , Chao Yu , Xinyi Yang , Wenxuan Ao , Qianyue Hao , Jian Yuan , Yong Li , Yu Wang , Huazhong Yang

City-scale traffic volume prediction plays a pivotal role in intelligent transportation systems, yet remains a challenge due to the inherent incompleteness and bias in observational data. Although deep learning-based methods have shown…

Machine Learning · Computer Science 2025-06-04 Shiyu Shen , Bin Pan , Guirong Xue