English
Related papers

Related papers: Congested Urban Networks Tend to Be Insensitive to…

200 papers

We apply deep reinforcement learning (DRL) to design of a networked controller with network delays to complete a temporal control task that is described by a signal temporal logic (STL) formula. STL is useful to deal with a specification…

Systems and Control · Electrical Eng. & Systems 2022-03-29 Junya Ikemoto , Toshimitsu Ushio

Multi-agent Deep Reinforcement Learning (MADRL) based traffic signal control becomes a popular research topic in recent years. To alleviate the scalability issue of completely centralized RL techniques and the non-stationarity issue of…

Artificial Intelligence · Computer Science 2023-09-08 Hankang Gu , Shangbo Wang , Xiaoguang Ma , Dongyao Jia , Guoqiang Mao , Eng Gee Lim , Cheuk Pong Ryan Wong

Reinforcement learning (RL) emerges as a promising data-driven approach for adaptive traffic signal control (ATSC) in complex urban traffic networks, with deep neural networks substantially augmenting its learning capabilities. However,…

Artificial Intelligence · Computer Science 2025-02-25 Yuli Zhang , Shangbo Wang , Dongyao Jia , Pengfei Fan , Ruiyuan Jiang , Hankang Gu , Andy H. F. Chow

Continuous-time reinforcement learning (CTRL) provides a natural framework for sequential decision-making in dynamic environments where interactions evolve continuously over time. While CTRL has shown growing empirical success, its ability…

Machine Learning · Computer Science 2025-12-04 Runze Zhao , Yue Yu , Ruhan Wang , Chunfeng Huang , Dongruo Zhou

Recent work has shown that the introduction of autonomous vehicles (AVs) in traffic could help reduce traffic jams. Deep reinforcement learning methods demonstrate good performance in complex control problems, including autonomous vehicle…

Cryptography and Security · Computer Science 2021-09-28 Yue Wang , Esha Sarkar , Wenqing Li , Michail Maniatakos , Saif Eddin Jabari

Scheduling control problems for a family of unitary networks under heavy traffic with general interarrival and service times, probabilistic routing and an infinite horizon discounted linear holding cost are studied. Diffusion control…

Probability · Mathematics 2012-05-07 Amarjit Budhiraja , Arka P. Ghosh

Conventional control, such as model-based control, is commonly utilized in autonomous driving due to its efficiency and reliability. However, real-world autonomous driving contends with a multitude of diverse traffic scenarios that are…

Robotics · Computer Science 2024-03-08 Vindula Jayawardana , Sirui Li , Cathy Wu , Yashar Farid , Kentaro Oguchi

Random access (RA) schemes are a topic of high interest in machine-type communication (MTC). In RA protocols, backoff techniques such as exponential backoff (EB) are used to stabilize the system to avoid low throughput and excessive delays.…

Information Theory · Computer Science 2022-01-25 Muhammad Awais Jadoon , Adriano Pastore , Monica Navarro , Fernando Perez-Cruz

Urban traffic congestion is a chronic problem faced by many cities in the US and worldwide. It results in inefficient infrastructure use as well as increased vehicle fuel consumption and emission levels. Congestion is intertwined with…

Systems and Control · Electrical Eng. & Systems 2020-03-04 Youssef Bichiou , Maha Elouni , Hossam M. Abdelghaffar , Hesham A. Rakha

We present a model of traffic flow on generic urban road networks based on cellular automata. We apply this model to an existing road network in the Australian city of Melbourne, using empirical data as input. For comparison, we also apply…

Cellular Automata and Lattice Gases · Physics 2011-04-28 Jan de Gier , Timothy M Garoni , Omar Rojas

We examine a queue-based random-access algorithm where activation and deactivation rates are adapted as functions of queue lengths. We establish its heavy traffic behavior on a complete interference graph, which turns out to be highly…

Probability · Mathematics 2021-06-08 Eyal Castiel , Sem Borst , Laurent Miclo , Florian Simatos , Philip Whiting

Deep reinforcement learning (DRL) provides a promising way for learning navigation in complex autonomous driving scenarios. However, identifying the subtle cues that can indicate drastically different outcomes remains an open problem with…

Machine Learning · Computer Science 2021-03-25 Xiaobai Ma , Jiachen Li , Mykel J. Kochenderfer , David Isele , Kikuo Fujimura

A macroscopic model is proposed to depict the traffic dynamics involved in urban traffic systems. The link dynamics are described based on the cell-transmission model and bounded by the link capacities, while the flow dynamics are proposed…

Optimization and Control · Mathematics 2020-02-25 Yicheng Zhang

We study a robust control problem for dynamical flow networks. In the considered dynamical models, traffic flows along the links of a transportation network --modeled as a capacited multigraph-- and queues up at the nodes, whereby control…

Systems and Control · Electrical Eng. & Systems 2020-12-24 Gustav Nilsson , Giacomo Como

We present and investigate a novel and timely application domain for deep reinforcement learning (RL): Internet congestion control. Congestion control is the core networking task of modulating traffic sources' data-transmission rates to…

Networking and Internet Architecture · Computer Science 2019-05-22 Nathan Jay , Noga H. Rotman , P. Brighten Godfrey , Michael Schapira , Aviv Tamar

In reinforcement learning-based (RL-based) traffic signal control (TSC), decisions on the signal timing are made based on the available information on vehicles at a road intersection. This forms the state representation for the RL…

Systems and Control · Electrical Eng. & Systems 2024-11-13 Lawrence Francis , Blessed Guda , Ahmed Biyabani

The problem of resource constrained scheduling in a dynamic and heterogeneous wireless setting is considered here. In our setup, the available limited bandwidth resources are allocated in order to serve randomly arriving service demands,…

Machine Learning · Computer Science 2022-04-01 Apostolos Avranas , Marios Kountouris , Philippe Ciblat

Motivated by the fact that intelligent traffic control systems have become inevitable demand to cope with the risk of traffic congestion in urban areas, this paper develops a distributed control strategy for urban traffic networks. Since…

Systems and Control · Electrical Eng. & Systems 2020-05-06 Viet Hoang Pham , Kazunori Sakurama , Shaoshuai Mou , Hyo-Sung Ahn

This research introduces an innovative method for adaptive traffic signal control (ATSC) through the utilization of multi-objective deep reinforcement learning (DRL) techniques. The proposed approach aims to enhance control strategies at…

Machine Learning · Computer Science 2024-08-05 Shahin Mirbakhsh , Mahdi Azizi

In this work, we study adaptive data-guided traffic planning and control using Reinforcement Learning (RL). We shift from the plain use of classic methods towards state-of-the-art in deep RL community. We embed several recent techniques in…

Machine Learning · Computer Science 2020-07-23 Siavash Alemzadeh , Ramin Moslemi , Ratnesh Sharma , Mehran Mesbahi