English
Related papers

Related papers: Learning to Design City-scale Transit Routes

200 papers

Public transport routing plays a crucial role in transit network design, ensuring a satisfactory level of service for passengers. However, current routing solutions rely on traditional operational research heuristics, which can be…

Artificial Intelligence · Computer Science 2023-08-25 Nadav Shalit , Michael Fire , Dima Kagan , Eran Ben-Elia

The application of reinforcement learning (RL) to dynamic resource allocation in optical networks has been the focus of intense research activity in recent years, with almost 100 peer-reviewed papers. We present a review of progress in the…

Networking and Internet Architecture · Computer Science 2025-04-23 Michael Doherty , Robin Matzner , Rasoul Sadeghi , Polina Bayvel , Alejandra Beghelli

Trajectory Representation Learning (TRL) is a powerful tool for spatial-temporal data analysis and management. TRL aims to convert complicated raw trajectories into low-dimensional representation vectors, which can be applied to various…

Machine Learning · Computer Science 2024-03-08 Jiawei Jiang , Dayan Pan , Houxing Ren , Xiaohan Jiang , Chao Li , Jingyuan Wang

Reinforcement learning-based traffic signal control (RL-TSC) has emerged as a promising approach for improving urban mobility. However, its robustness under real-world disruptions such as traffic incidents remains largely underexplored. In…

Machine Learning · Computer Science 2025-06-18 Dang Viet Anh Nguyen , Carlos Lima Azevedo , Tomer Toledo , Filipe Rodrigues

Finding efficient routes for data packets is an essential task in computer networking. The optimal routes depend greatly on the current network topology, state and traffic demand, and they can change within milliseconds. Reinforcement…

Machine Learning · Computer Science 2024-10-15 Andreas Boltres , Niklas Freymuth , Patrick Jahnke , Holger Karl , Gerhard Neumann

Detailed routing remains one of the most complex and time-consuming steps in modern physical design due to the challenges posed by shrinking feature sizes and stricter design rules. Prior detailed routers achieve state-of-the-art results by…

Hardware Architecture · Computer Science 2025-12-04 Afsara Khan , Austin Rovinski

We approach the task of network congestion control in datacenters using Reinforcement Learning (RL). Successful congestion control algorithms can dramatically improve latency and overall network throughput. Until today, no such…

We learn end-to-end point-to-point and path-following navigation behaviors that avoid moving obstacles. These policies receive noisy lidar observations and output robot linear and angular velocities. The policies are trained in small,…

Robotics · Computer Science 2019-02-05 Hao-Tien Lewis Chiang , Aleksandra Faust , Marek Fiser , Anthony Francis

Reinforcement Learning (RL) heavily relies on the careful design of the reward function. However, accurately assigning rewards to each state-action pair in Long-Term Reinforcement Learning (LTRL) tasks remains a significant challenge. As a…

Machine Learning · Computer Science 2025-06-03 Qi Ju , Falin Hei , Zhemei Fang , Yunfeng Luo

Efficient traffic signal control (TSC) is crucial for reducing congestion, travel delays, pollution, and for ensuring road safety. Traditional approaches, such as fixed signal control and actuated control, often struggle to handle dynamic…

Systems and Control · Electrical Eng. & Systems 2025-09-29 Anirud Nandakumar , Chayan Banerjee , Lelitha Devi Vanajakshi

In recent years, end-to-end autonomous driving architectures have gained increasing attention due to their advantage in avoiding error accumulation. Most existing end-to-end autonomous driving methods are based on Imitation Learning (IL),…

Artificial Intelligence · Computer Science 2025-04-22 Yueyuan Li , Mingyang Jiang , Songan Zhang , Wei Yuan , Chunxiang Wang , Ming Yang

We propose AttendLight, an end-to-end Reinforcement Learning (RL) algorithm for the problem of traffic signal control. Previous approaches for this problem have the shortcoming that they require training for each new intersection with a…

Machine Learning · Computer Science 2020-10-13 Afshin Oroojlooy , Mohammadreza Nazari , Davood Hajinezhad , Jorge Silva

In this work, we propose a hierarchical reinforcement learning (HRL) structure which is capable of performing autonomous vehicle planning tasks in simulated environments with multiple sub-goals. In this hierarchical structure, the network…

Robotics · Computer Science 2019-11-12 Zhiqian Qiao , Zachariah Tyree , Priyantha Mudalige , Jeff Schneider , John M. Dolan

End-to-end delay is a critical attribute of quality of service (QoS) in application domains such as cloud computing and computer networks. This metric is particularly important in tandem service systems, where the end-to-end service is…

Machine Learning · Computer Science 2021-01-13 Majid Raeis , Ali Tizghadam , Alberto Leon-Garcia

Packet routing is a fundamental problem in communication networks that decides how the packets are directed from their source nodes to their destination nodes through some intermediate nodes. With the increasing complexity of network…

Artificial Intelligence · Computer Science 2021-07-29 Xuan Mai , Quanzhi Fu , Yi Chen

The resilience of urban rapid transit systems (URTs) to a rapidly evolving threat space is of much concern. Extreme rainfall events are both intensifying and growing more frequent under continuing climate change, exposing transit systems to…

Physics and Society · Physics 2024-11-01 Aran Chakraborty , Yushi Tsukimoto , August Posch , Jack Watson , Auroop Ganguly

Transportation is the backbone of the economy and urban development. Improving the efficiency, sustainability, resilience, and intelligence of transportation systems is critical and also challenging. The constantly changing traffic…

Machine Learning · Computer Science 2022-10-27 Can Li , Lei Bai , Lina Yao , S. Travis Waller , Wei Liu

Autonomous racing presents unique challenges due to its non-linear dynamics, the high speed involved, and the critical need for real-time decision-making under dynamic and unpredictable conditions. Most traditional Reinforcement Learning…

Robotics · Computer Science 2025-05-13 Benedict Hildisch , Edoardo Ghignone , Nicolas Baumann , Cheng Hu , Andrea Carron , Michele Magno

Conventional trajectory planning approaches for autonomous racing are based on the sequential execution of prediction of the opposing vehicles and subsequent trajectory planning for the ego vehicle. If the opposing vehicles do not react to…

Robotics · Computer Science 2024-07-26 Levent Ögretmen , Mo Chen , Phillip Pitschi , Boris Lohmann

Reinforcement Learning (RL) algorithms often struggle with low training efficiency. A common approach to address this challenge is integrating model-based planning algorithms, such as Monte Carlo Tree Search (MCTS) or Value Iteration (VI),…

Machine Learning · Computer Science 2025-01-08 Zidu Yin , Zhen Zhang , Dong Gong , Stefano V. Albrecht , Javen Q. Shi