English
Related papers

Related papers: Optimal Resource Allocation with Semi-Bandit Feedb…

200 papers

We consider online learning problems under a partial observability model capturing situations where the information conveyed to the learner is between full information and bandit feedback. In the simplest variant, we assume that in addition…

Machine Learning · Computer Science 2026-04-28 Tomas Kocak , Gergely Neu , Michal Valko , Remi Munos

Contextual bandits serve as a fundamental model for many sequential decision making tasks. The most popular theoretically justified approaches are based on the optimism principle. While these algorithms can be practical, they are known to…

Machine Learning · Computer Science 2020-03-17 Botao Hao , Tor Lattimore , Csaba Szepesvari

This survey is focused on certain sequential decision-making problems that involve optimizing over probability functions. We discuss the relevance of these problems for learning and control. The survey is organized around a framework that…

Optimization and Control · Mathematics 2023-01-13 Emiland Garrabe , Giovanni Russo

We study a fair resource scheduling problem, where a set of interval jobs are to be allocated to heterogeneous machines controlled by agents. Each job is associated with release time, deadline, and processing time such that it can be…

Computer Science and Game Theory · Computer Science 2022-01-03 Bo Li , Minming Li , Ruilong Zhang

In many web applications, a recommendation is not a single item suggested to a user but a list of possibly interesting contents that may be ranked in some contexts. The combinatorial bandit problem has been studied quite extensively these…

Data Structures and Algorithms · Computer Science 2016-05-27 Hossein Vahabi , Paul Lagrée , Claire Vernade , Olivier Cappé

Human-machine complementarity is important when neither the algorithm nor the human yield dominant performance across all instances in a given domain. Most research on algorithmic decision-making solely centers on the algorithm's…

Human-Computer Interaction · Computer Science 2021-12-14 Ruijiang Gao , Maytal Saar-Tsechansky , Maria De-Arteaga , Ligong Han , Min Kyung Lee , Matthew Lease

We consider a distributed server system consisting of a large number of servers, each with limited capacity on multiple resources (CPU, memory, disk, etc.). Jobs with different rewards arrive over time and require certain amounts of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-29 Konstantinos Psychas , Javad Ghaderi

Existing approaches to resource allocation for nowadays stochastic networks are challenged to meet fast convergence and tolerable delay requirements. The present paper leverages online learning advances to facilitate stochastic resource…

Optimization and Control · Mathematics 2017-05-24 Tianyi Chen , Aryan Mokhtari , Xin Wang , Alejandro Ribeiro , Georgios B. Giannakis

We propose an exact polynomial algorithm for a resource allocation problem with convex costs and constraints on partial sums of resource consumptions, in the presence of either continuous or integer variables. No assumption of strict…

Data Structures and Algorithms · Computer Science 2014-04-29 Thibaut Vidal , Patrick Jaillet , Nelson Maculan

Sequential portfolio selection has attracted increasing interests in the machine learning and quantitative finance communities in recent years. As a mathematical framework for reinforcement learning policies, the stochastic multi-armed…

Portfolio Management · Quantitative Finance 2017-09-14 Xiaoguang Huo , Feng Fu

Algorithms with predictions is a recent framework that has been used to overcome pessimistic worst-case bounds in incomplete information settings. In the context of scheduling, very recent work has leveraged machine-learned predictions to…

Data Structures and Algorithms · Computer Science 2022-12-08 Eric Balkanski , Tingting Ou , Clifford Stein , Hao-Ting Wei

This research considers the ranking and selection with input uncertainty. The objective is to maximize the posterior probability of correctly selecting the best alternative under a fixed simulation budget, where each alternative is measured…

Optimization and Control · Mathematics 2023-05-15 Hui Xiao , Zhihong Wei

Biological brains are inherently limited in their capacity to process and store information, but are nevertheless capable of solving complex tasks with apparent ease. Intelligent behavior is related to these limitations, since resource…

Neurons and Cognition · Quantitative Biology 2020-11-16 Nisheet Patel , Luigi Acerbi , Alexandre Pouget

In this report we demonstrate the potential utility of resource allocation management systems that use virtual machine technology for sharing parallel computing resources among competing jobs. We formalize the resource allocation problem…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-06-29 Mark Stillwell , David Schanzenbach , Frédéric Vivien , Henri Casanova

A key functionality of emerging connected autonomous systems such as smart transportation systems, smart cities, and the industrial Internet-of-Things, is the ability to process and learn from data collected at different physical locations.…

Machine Learning · Computer Science 2021-01-26 Konstantinos Gatsis

How is the limited capacity of working memory efficiently used to support human linguistic behaviors? In this paper, we propose Strategic Resource Allocation (SRA) as an efficiency principle for memory encoding in sentence processing. The…

Computation and Language · Computer Science 2025-09-01 Weijie Xu , Richard Futrell

We study the combinatorial semi-bandit problem where an agent selects a subset of base arms and receives individual feedback. While this generalizes the classical multi-armed bandit and has broad applicability, its scalability is limited by…

Machine Learning · Statistics 2025-10-27 Jung-hun Kim , Milan Vojnović , Min-hwan Oh

We study the Improving Multi-Armed Bandit (IMAB) problem, where the reward obtained from an arm increases with the number of pulls it receives. This model provides an elegant abstraction for many real-world problems in domains such as…

Machine Learning · Computer Science 2022-08-22 Vishakha Patil , Vineet Nair , Ganesh Ghalme , Arindam Khan

Resource allocation and task prioritisation are key problem domains in the fields of autonomous vehicles, networking, and cloud computing. The challenge in developing efficient and robust algorithms comes from the dynamic nature of these…

Artificial Intelligence · Computer Science 2021-02-17 Niall Creech , Natalia Criado Pacheco , Simon Miles

With an ever growing number of heterogeneous applicational services running on equally heterogeneous computational systems, the problem of resource management becomes more essential. Although current solutions consider some network and time…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-05 Rui Eduardo Lopes , Duarte Raposo , Pedro V. Teixeira , Susana Sargento