English
Related papers

Related papers: Learning-Based vs Human-Derived Congestion Control…

200 papers

Recently, Intelligent Transportation Systems are leveraging the power of increased sensory coverage and computing power to deliver data-intensive solutions achieving higher levels of performance than traditional systems. Within Traffic…

Machine Learning · Computer Science 2021-05-03 Alvaro Cabrejas-Egea , Raymond Zhang , Neil Walton

Human-driven vehicles (HVs) amplify naturally occurring perturbations in traffic, leading to congestion--a major contributor to increased fuel consumption, higher collision risks, and reduced road capacity utilization. While previous…

Robotics · Computer Science 2024-03-26 Bibek Poudel , Weizi Li , Kevin Heaslip

In this paper, we present the combined learning-and-control (CLC) approach, which is a new way to solve optimal control problems with unknown dynamics by unifying model-based control and data-driven learning. The key idea is simple: we…

Systems and Control · Electrical Eng. & Systems 2025-10-02 Panagiotis Kounatidis , Andreas A. Malikopoulos

Motivated by recent advances in Deep Learning for robot control, this paper considers two learning algorithms in terms of how they acquire demonstrations. "Human-Centric" (HC) sampling is the standard supervised learning algorithm, where a…

Intersections are essential road infrastructures for traffic in modern metropolises. However, they can also be the bottleneck of traffic flows as a result of traffic incidents or the absence of traffic coordination mechanisms such as…

Machine Learning · Computer Science 2024-11-05 Dawei Wang , Weizi Li , Lei Zhu , Jia Pan

Urban Traffic Control (UTC) plays an essential role in Intelligent Transportation System (ITS) but remains difficult. Since model-based UTC methods may not accurately describe the complex nature of traffic dynamics in all situations,…

Artificial Intelligence · Computer Science 2018-08-27 Yilun Lin , Xingyuan Dai , Li Li , Fei-Yue Wang

Cooperative vehicle safety (CVS) systems operate based on broadcast of vehicle position and safety information to neighboring cars. The communication medium of CVS is a vehicular ad-hoc network. One of the main challenges in large scale…

Networking and Internet Architecture · Computer Science 2012-06-05 Neda Nasiriani , Yaser P. Fallah , Hariharan Krishnan

Congestion Control (CC) plays a fundamental role in optimizing traffic in Data Center Networks (DCN). Currently, DCNs mainly implement two main CC protocols: DCTCP and DCQCN. Both protocols -- and their main variants -- are based on…

Networking and Internet Architecture · Computer Science 2023-08-10 Guillermo Bernárdez , José Suárez-Varela , Xiang Shi , Shihan Xiao , Xiangle Cheng , Pere Barlet-Ros , Albert Cabellos-Aparicio

Reinforcement learning-based traffic signal control (RL-TSC) has emerged as a promising approach for improving urban mobility. However, its robustness under real-world disruptions such as traffic incidents remains largely underexplored. In…

Machine Learning · Computer Science 2025-06-18 Dang Viet Anh Nguyen , Carlos Lima Azevedo , Tomer Toledo , Filipe Rodrigues

Online reinforcement learning (RL) algorithms are often difficult to deploy in complex human-facing applications as they may learn slowly and have poor early performance. To address this, we introduce a practical algorithm for incorporating…

Artificial Intelligence · Computer Science 2022-01-03 Tong Mu , Georgios Theocharous , David Arbour , Emma Brunskill

Urban congestion remains a critical challenge, with traffic signal control (TSC) emerging as a potent solution. TSC is often modeled as a Markov Decision Process problem and then solved using reinforcement learning (RL), which has proven…

Artificial Intelligence · Computer Science 2024-07-09 Aoyu Pang , Maonan Wang , Man-On Pun , Chung Shue Chen , Xi Xiong

The optimal operation of transportation systems is often susceptible to unexpected disruptions. Many established control strategies reliant on mathematical models can struggle with real-world disruptions, leading to significant divergence…

Systems and Control · Electrical Eng. & Systems 2026-03-24 Linghang Sun , Michail A. Makridis , Alexander Genser , Cristian Axenie , Margherita Grossi , Anastasios Kouvelas

Traffic signal control (TSC) is a high-stakes domain that is growing in importance as traffic volume grows globally. An increasing number of works are applying reinforcement learning (RL) to TSC; RL can draw on an abundance of traffic data…

Artificial Intelligence · Computer Science 2022-10-05 Rex Chen , Fei Fang , Norman Sadeh

Concurrency control (CC) algorithms are important in modern transactional databases, as they enable high performance by executing transactions concurrently while ensuring correctness. However, state-of-the-art CC algorithms struggle to…

Databases · Computer Science 2026-03-11 Hexiang Pan , Shaofeng Cai , Tien Tuan Anh Dinh , Yuncheng Wu , Yeow Meng Chee , Gang Chen , Beng Chin Ooi

This paper proposes a reinforcement learning approach for traffic control with the adaptive horizon. To build the controller for the traffic network, a Q-learning-based strategy that controls the green light passing time at the network…

Systems and Control · Computer Science 2019-04-01 Wentao Chen , Tehuan Chen , Guang Lin

Legged locomotion is a complex control problem that requires both accuracy and robustness to cope with real-world challenges. Legged systems have traditionally been controlled using trajectory optimization with inverse dynamics. Such…

Robotics · Computer Science 2024-01-23 Fabian Jenelten , Junzhe He , Farbod Farshidian , Marco Hutter

Today, considerable Internet traffic is sent from the datacenter and heads for users. The characteristics of connections served by servers in datacenters are usually diverse and varied over time, with continuous upgrades in network…

Networking and Internet Architecture · Computer Science 2018-10-23 Kefan Chen , Danfeng Shan , Xiaohui Luo , Tong Zhang , Yajun Yang , Ya Zhao , Fengyuan Ren

Reinforcement Learning (RL) algorithms have found limited success beyond simulated applications, and one main reason is the absence of safety guarantees during the learning process. Real world systems would realistically fail or break…

Machine Learning · Computer Science 2019-03-22 Richard Cheng , Gabor Orosz , Richard M. Murray , Joel W. Burdick

Traffic congestion is a persistent problem in our society. Previous methods for traffic control have proven futile in alleviating current congestion levels leading researchers to explore ideas with robot vehicles given the increased…

Multiagent Systems · Computer Science 2024-02-06 Michael Villarreal , Bibek Poudel , Jia Pan , Weizi Li

Autonomous driving at unsignalized intersections is still considered a challenging application for machine learning due to the complications associated with handling complex multi-agent scenarios characterized by a high degree of…