English
Related papers

Related papers: A Unified Model for the Two-stage Offline-then-Onl…

200 papers

Online Network Resource Allocation (ONRA) for service provisioning is a fundamental problem in communication networks. As a sequential decision-making under uncertainty problem, it is promising to approach ONRA via Reinforcement Learning…

Networking and Internet Architecture · Computer Science 2021-10-19 Bahador Bakhshi , Josep Mangues-Bafalluy

The integrated development of city clusters has given rise to an increasing demand for intercity travel. Intercity ride-pooling service exhibits considerable potential in upgrading traditional intercity bus services by implementing…

Systems and Control · Electrical Eng. & Systems 2024-03-21 Jinhua Si , Fang He , Xi Lin , Xindi Tang

We study online learning for optimal allocation when the resource to be allocated is time. %Examples of possible applications include job scheduling for a computing server, a driver filling a day with rides, a landlord renting an estate,…

Machine Learning · Statistics 2021-11-05 Etienne Boursier , Tristan Garrec , Vianney Perchet , Marco Scarsini

Offline reinforcement learning (RL) extends the paradigm of classical RL algorithms to purely learning from static datasets, without interacting with the underlying environment during the learning process. A key challenge of offline RL is…

Machine Learning · Computer Science 2022-06-16 Shentao Yang , Yihao Feng , Shujian Zhang , Mingyuan Zhou

We study a fundamental model of resource allocation in which a finite number of resources must be assigned in an online manner to a heterogeneous stream of customers. The customers arrive randomly over time according to known stochastic…

Optimization and Control · Mathematics 2018-05-16 Clifford Stein , Van-Anh Truong , Xinshang Wang

Reinforcement learning (RL) has shown promise for decision-making tasks in real-world applications. One practical framework involves training parameterized policy models from an offline dataset and subsequently deploying them in an online…

Machine Learning · Computer Science 2023-03-14 Ziniu Li , Ke Xu , Liu Liu , Lanqing Li , Deheng Ye , Peilin Zhao

One of the main operational challenges faced by the operators of one-way car-sharing systems is to ensure vehicle availability across the regions of the service areas with uneven patterns of rental requests. Fleet balancing strategies are…

Networking and Internet Architecture · Computer Science 2025-01-24 Riccardo Iacobucci , Raffaele Bruno , Chiara Boldrini

Ride-pooling services, such as UberPool and Lyft Shared Saver, enable a single vehicle to serve multiple customers within one shared trip. Efficient path-planning algorithms are crucial for improving the performance of such systems. For…

Systems and Control · Electrical Eng. & Systems 2025-06-06 Pengbo Zhu , Giancarlo Ferrari-Trecate , Nikolas Geroliminis

We consider a multi-stage facility reallocation problems on the real line, where a facility is being moved between time stages based on the locations reported by $n$ agents. The aim of the reallocation algorithm is to minimise the social…

Computer Science and Game Theory · Computer Science 2021-03-25 Bart de Keijzer , Dominik Wojtczak

Network virtualization allows one to build dynamic distributed systems in which resources can be dynamically allocated at locations where they are most useful. In order to fully exploit the benefits of this new technology, protocols need to…

Networking and Internet Architecture · Computer Science 2011-03-07 Dushyant Arora , Marcin Bienkowski , Anja Feldmann , Gregor Schaffrath , Stefan Schmid

Mobility-on-demand systems are transforming the way we think about the transportation of people and goods. Most research effort has been placed on scalability issues for systems with a large number of agents and simple pick-up/drop-off…

Formal Languages and Automata Theory · Computer Science 2022-08-15 Kaier Liang , Cristian-Ioan Vasile

Ride-hailing platforms (e.g., Uber, Lyft) have transformed urban mobility by enabling ride-sharing, which holds considerable promise for reducing both travel costs and total vehicle miles traveled (VMT). However, the fragmentation of these…

General Economics · Economics 2025-08-27 Xin Dong , Jose Ventura , Vikash V. Gayah

We introduce a general model of resource allocation with customer choice. In this model, there are multiple resources that are available over a finite horizon. The resources are non-replenishable and perishable. Each unit of a resource can…

Optimization and Control · Mathematics 2015-11-06 Guillermo Gallego , Anran Li , Van-Anh Truong , Xinshang Wang

We formulate offloading of computational tasks from a dynamic group of mobile agents (e.g., cars) as decentralized decision making among autonomous agents. We design an interaction mechanism that incentivizes such agents to align private…

Multiagent Systems · Computer Science 2022-08-11 Jing Tan , Ramin Khalili , Holger Karl , Artur Hecker

Offline reinforcement learning (RL) refers to the problem of learning policies entirely from a large batch of previously collected data. This problem setting offers the promise of utilizing such datasets to acquire policies without any…

Machine Learning · Computer Science 2020-11-24 Tianhe Yu , Garrett Thomas , Lantao Yu , Stefano Ermon , James Zou , Sergey Levine , Chelsea Finn , Tengyu Ma

Offline reinforcement learning (RL) presents distinct challenges as it relies solely on observational data. A central concern in this context is ensuring the safety of the learned policy by quantifying uncertainties associated with various…

Machine Learning · Computer Science 2025-07-03 Xiaocong Chen , Siyu Wang , Tong Yu , Lina Yao

A natural optimization model that formulates many online resource allocation and revenue management problems is the online linear program (LP) in which the constraint matrix is revealed column by column along with the corresponding…

Data Structures and Algorithms · Computer Science 2014-04-10 Shipra Agrawal , Zizhuo Wang , Yinyu Ye

Autonomous mobility-on-demand systems are a viable alternative to mitigate many transportation-related externalities in cities, such as rising vehicle volumes in urban areas and transportation-related pollution. However, the success of…

Optimization and Control · Mathematics 2024-02-22 Kai Jungel , Axel Parmentier , Maximilian Schiffer , Thibaut Vidal

We study the problem of fair online resource allocation via non-monetary mechanisms, where multiple agents repeatedly share a resource without monetary transfers. Previous work has shown that every agent can guarantee $1/2$ of their ideal…

Computer Science and Game Theory · Computer Science 2025-05-27 David X. Lin , Daniel Hall , Giannis Fikioris , Siddhartha Banerjee , Éva Tardos

We consider a parallel system of $m$ identical machines prone to unpredictable crashes and restarts, trying to cope with the continuous arrival of tasks to be executed. Tasks have different computational requirements (i.e., processing time…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-21 Elli Zavou , Antonio Fernández Anta