English
Related papers

Related papers: Deep Deterministic Policy Gradient for Urban Traff…

200 papers

Smart traffic lights in intelligent transportation systems (ITSs) are envisioned to greatly increase traffic efficiency and reduce congestion. Deep reinforcement learning (DRL) is a promising approach to adaptively control traffic lights…

Machine Learning · Computer Science 2025-05-08 Ming Zhu , Xiao-Yang Liu , Sem Borst , Anwar Walid

The problem of mixed static and dynamic obstacle avoidance is essential for path planning in highly dynamic environment. However, the paths formed by grid edges can be longer than the true shortest paths in the terrain since their headings…

Artificial Intelligence · Computer Science 2021-03-01 Junxiao Xue , Xiangyan Kong , Bowei Dong , Mingliang Xu

Deep Reinforcement Learning is gaining increasing attention thanks to its capability to learn complex policies in high-dimensional settings. Recent advancements utilize a dual-network architecture to learn optimal policies through the…

Machine Learning · Computer Science 2025-10-14 Alberto Sinigaglia , Niccolò Turcato , Ruggero Carli , Gian Antonio Susto

Intelligent transportation systems (ITSs) are envisioned to be crucial for smart cities, which aims at improving traffic flow to improve the life quality of urban residents and reducing congestion to improve the efficiency of commuting.…

Multiagent Systems · Computer Science 2019-12-17 Wenhang Bao , Xiao-yang Liu

Traffic prediction plays an essential role in intelligent transportation system. Accurate traffic prediction can assist route planing, guide vehicle dispatching, and mitigate traffic congestion. This problem is challenging due to the…

Signal Processing · Electrical Eng. & Systems 2021-03-22 Xueyan Yin , Genze Wu , Jinze Wei , Yanming Shen , Heng Qi , Baocai Yin

Advances in mobile communication capabilities open the door for closer integration of pre-hospital and in-hospital care processes. For example, medical specialists can be enabled to guide on-site paramedics and can, in turn, be supplied…

Systems and Control · Electrical Eng. & Systems 2023-04-20 Steffen Gracla , Edgar Beck , Carsten Bockelmann , Armin Dekorsy

This paper considers optimal traffic signal control in smart cities, which has been taken as a complex networked system control problem. Given the interacting dynamics among traffic lights and road networks, attaining controller adaptivity…

Machine Learning · Computer Science 2023-11-08 Yao Zhang , Zhiwen Yu , Jun Zhang , Liang Wang , Tom H. Luan , Bin Guo , Chau Yuen

Traffic congestion has become one of the major problems in the urban cities according to the increasing number of vehicles in those cities, obsolete technologies used on the roads of those cities, inappropriate road design, and many other…

Multiagent Systems · Computer Science 2020-09-01 Maythem K. Abbas , Mohd N. Karsiti , Madzlan Napiah , Brahim B. Samir , Marwan Al-Jemeli

The theory of continuous-time reinforcement learning (RL) has progressed rapidly in recent years. While the ultimate objective of RL is typically to learn deterministic control policies, most existing continuous-time RL methods rely on…

Machine Learning · Computer Science 2026-03-17 Ziheng Cheng , Xin Guo , Yufei Zhang

The problem of how to take the right actions to make profits in sequential process continues to be difficult due to the quick dynamics and a significant amount of uncertainty in many application scenarios. In such complicated environments,…

Machine Learning · Computer Science 2023-10-03 Zhendong Shi , Xiaoli Wei , Ercan E. Kuruoglu

This paper tackles the challenge of coordinating traffic lights and automated vehicles at signalized intersections, formulated as a constrained finite-horizon optimal control problem. The problem falls into the category of mixed-integer…

Optimization and Control · Mathematics 2025-02-04 Azita Dabiri , Giray Önür , Sebastien Gros , Bart De Schutter

Existing ineffective and inflexible traffic light control at urban intersections can often lead to congestion in traffic flows and cause numerous problems, such as long delay and waste of energy. How to find the optimal signal timing…

Machine Learning · Computer Science 2020-09-30 Chenguang Zhao , Xiaorong Hu , Gang Wang

A profound understanding of inter-agent relationships and motion behaviors is important to achieve high-quality planning when navigating in complex scenarios, especially at urban traffic intersections. We present a trajectory prediction…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Yuzhen Zhang , Wentong Wang , Weizhi Guo , Pei Lv , Mingliang Xu , Wei Chen , Dinesh Manocha

The coordination of large-scale, decentralised systems, such as a fleet of Electric Vehicles (EVs) in a Vehicle-to-Grid (V2G) network, presents a significant challenge for modern control systems. While collaborative Digital Twins have been…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-01 Zhengchang Hua , Panagiotis Oikonomou , Karim Djemame , Nikos Tziritas , Georgios Theodoropoulos

Traffic congestion in dense urban centers presents an economical and environmental burden. In recent years, the availability of vehicle-to-anything communication allows for the transmission of detailed vehicle states to the infrastructure…

Urban Traffic Control (UTC) plays an essential role in Intelligent Transportation System (ITS) but remains difficult. Since model-based UTC methods may not accurately describe the complex nature of traffic dynamics in all situations,…

Artificial Intelligence · Computer Science 2018-08-27 Yilun Lin , Xingyuan Dai , Li Li , Fei-Yue Wang

Reinforcement learning algorithms such as the deep deterministic policy gradient algorithm (DDPG) has been widely used in continuous control tasks. However, the model-free DDPG algorithm suffers from high sample complexity. In this paper we…

Machine Learning · Computer Science 2019-11-14 Qingpeng Cai , Ling Pan , Pingzhong Tang

Traffic signal controllers play an essential role in today's traffic system. However, the majority of them currently is not sufficiently flexible or adaptive to generate optimal traffic schedules. In this paper we present an approach to…

Machine Learning · Computer Science 2021-05-05 Shengchao Yan , Jingwei Zhang , Daniel Büscher , Wolfram Burgard

Reinforcement Learning (RL) applied to financial problems has been the subject of a lively area of research. The use of RL for optimal trading strategies that exploit latent information in the market is, to the best of our knowledge, not…

Trading and Market Microstructure · Quantitative Finance 2025-11-04 Andrea Macrì , Sebastian Jaimungal , Fabrizio Lillo

Transportation is a major contributor to CO2 emissions, making it essential to optimize traffic networks to reduce energy-related emissions. This paper presents a novel approach to traffic network control using Differentiable Predictive…

Systems and Control · Electrical Eng. & Systems 2024-06-18 Renukanandan Tumu , Wenceslao Shaw Cortez , Ján Drgoňa , Draguna L. Vrabie , Sonja Glavaski