English
Related papers

Related papers: Online Learning for Traffic Routing under Unknown …

200 papers

We consider online convex optimization (OCO) with multi-slot feedback delay, where an agent makes a sequence of online decisions to minimize the accumulation of time-varying convex loss functions, subject to short-term and long-term…

Information Theory · Computer Science 2021-08-17 Juncheng Wang , Ben Liang , Min Dong , Gary Boudreau , Hatem Abou-zeid

Traffic congestion has large economic and social costs. The introduction of autonomous vehicles can potentially reduce this congestion by increasing road capacity via vehicle platooning and by creating an avenue for influencing people's…

Multiagent Systems · Computer Science 2021-06-10 Erdem Bıyık , Daniel A. Lazar , Ramtin Pedarsani , Dorsa Sadigh

Network routing is a distributed decision problem which naturally admits numerical performance measures, such as the average time for a packet to travel from source to destination. OLPOMDP, a policy-gradient reinforcement learning…

Machine Learning · Computer Science 2025-12-04 Nigel Tao , Jonathan Baxter , Lex Weaver

Mobility service route design requires demand information to operate in a service region. Transit planners and operators can access various data sources including household travel survey data and mobile device location logs. However, when…

Artificial Intelligence · Computer Science 2024-09-04 Gyugeun Yoon , Joseph Y. J. Chow

Understanding travel demand and behavior, particularly route and mode choices, is critical for effective transportation planning and policy design in multi-modal systems with emerging mobility options. Multi-modal system-level data, such as…

Systems and Control · Electrical Eng. & Systems 2026-03-04 Xiaoyu Ma , Sean Qian

In Online Learning to Rank (OLTR) the aim is to find an optimal ranking model by interacting with users. When learning from user behavior, systems must interact with users while simultaneously learning from those interactions. Unlike other…

Information Retrieval · Computer Science 2017-11-28 Harrie Oosterhuis , Maarten de Rijke

Autonomous mobility-on-demand systems are a viable alternative to mitigate many transportation-related externalities in cities, such as rising vehicle volumes in urban areas and transportation-related pollution. However, the success of…

Optimization and Control · Mathematics 2024-02-22 Kai Jungel , Axel Parmentier , Maximilian Schiffer , Thibaut Vidal

We study the problem of online learning and online regret minimization when samples are drawn from a general unknown non-stationary process. We introduce the concept of a dynamic changing process with cost $K$, where the conditional…

Machine Learning · Computer Science 2023-11-14 Changlong Wu , Ananth Grama , Wojciech Szpankowski

This work aims at unveiling the potential of Transfer Learning (TL) for developing a traffic flow forecasting model in scenarios of absent data. Knowledge transfer from high-quality predictive models becomes feasible under the TL paradigm,…

Machine Learning · Computer Science 2020-05-12 Eric L. Manibardo , Ibai Laña , Javier Del Ser

Road congestion induces significant costs across the world, and road network disturbances, such as traffic accidents, can cause highly congested traffic patterns. If a planner had control over the routing of all vehicles in the network,…

Optimization and Control · Mathematics 2021-06-07 Daniel A. Lazar , Erdem Bıyık , Dorsa Sadigh , Ramtin Pedarsani

We present an algorithm for optimal guidance of users in road networks. It is a "stochastic-on-time-arrival (SOTA)"-like algorithm which calculates optimal guidance strategies with reliable paths, for road network origin-destination pairs.…

Optimization and Control · Mathematics 2016-06-30 Farida Manseur , Nadir Farhi , Habib Haj-Salem , Jean-Patrick Lebacque

We study the problem of online learning (OL) from revealed preferences: a learner wishes to learn a non-strategic agent's private utility function through observing the agent's utility-maximizing actions in a changing environment. We adopt…

Optimization and Control · Mathematics 2021-06-07 Violet Xinying Chen , Fatma Kılınç-Karzan

Trip destination prediction is an area of increasing importance in many applications such as trip planning, autonomous driving and electric vehicles. Even though this problem could be naturally addressed in an online learning paradigm where…

Machine Learning · Computer Science 2023-01-02 Victor Eberstein , Jonas Sjöblom , Nikolce Murgovski , Morteza Haghir Chehreghani

Multiple federated learning (FL) methods are proposed for traffic flow forecasting (TFF) to avoid heavy-transmission and privacy-leaking concerns resulting from the disclosure of raw data in centralized methods. However, these FL methods…

Machine Learning · Computer Science 2024-11-22 Qingxiang Liu , Sheng Sun , Yuxuan Liang , Xiaolong Xu , Min Liu , Muhammad Bilal , Yuwei Wang , Xujing Li , Yu Zheng

We study an online mixed discrete and continuous optimization problem where a decision maker interacts with an unknown environment for a number of $T$ rounds. At each round, the decision maker needs to first jointly choose a discrete and a…

Optimization and Control · Mathematics 2024-08-27 Lintao Ye , Ming Chi , Zhi-Wei Liu , Xiaoling Wang , Vijay Gupta

In this work, we investigate the online learning problem of revenue maximization in ad auctions, where the seller needs to learn the click-through rates (CTRs) of each ad candidate and charge the price of the winner through a pay-per-click…

Information Retrieval · Computer Science 2024-03-05 Zhe Feng , Christopher Liaw , Zixin Zhou

The term Delay/Disruption-Tolerant Networks (DTN) invented to describe and cover all types of long-delay, disconnected, intermittently connected networks, where mobility and outages or scheduled contacts may be experienced. This environment…

Networking and Internet Architecture · Computer Science 2021-05-06 Fuad Yimer Yesuf , M. Prathap

Rapid urbanization places increasing stress on already burdened transportation systems, resulting in delays and poor levels of service. Billions of spatiotemporal call detail records (CDRs) collected from mobile devices create new…

Physics and Society · Physics 2014-03-05 Jameson L. Toole , Serdar Colak , Fahad Alhasoun , Alexandre Evsukoff , Marta C. Gonzalez

The goal of autonomous vehicles is to navigate public roads safely and comfortably. To enforce safety, traditional planning approaches rely on handcrafted rules to generate trajectories. Machine learning-based systems, on the other hand,…

With autonomous vehicles now sharing roads with human drivers, the era of mixed autonomy brings new challenges in dealing with congestion. One cause of congestion is when vehicle users choose their routes selfishly to minimize their…

Optimization and Control · Mathematics 2021-08-05 Daniel A. Lazar , Ramtin Pedarsani