English
Related papers

Related papers: Stochastic Network Utility Maximization with Unkno…

200 papers

We study a collaborative multi-agent stochastic linear bandit setting, where $N$ agents that form a network communicate locally to minimize their overall regret. In this setting, each agent has its own linear bandit problem (its own reward…

Machine Learning · Computer Science 2022-05-16 Ahmadreza Moradipari , Mohammad Ghavamzadeh , Mahnoosh Alizadeh

We study the stochastic multi-armed bandit problem with non-equivalent multiple plays where, at each step, an agent chooses not only a set of arms, but also their order, which influences reward distribution. In several problem formulations…

Machine Learning · Computer Science 2015-07-20 Aleksandr Vorobev , Gleb Gusev

Given a set of $m$ agents and a set of $n$ items, where agent $A$ has utility $u_{A,i}$ for item $i$, our goal is to allocate items to agents to maximize fairness. Specifically, the utility of an agent is the sum of its utilities for items…

Data Structures and Algorithms · Computer Science 2009-01-05 Deeparnab Chakrabarty , Julia Chuzhoy , Sanjeev Khanna

We consider the problem of sequentially allocating resources in a censored semi-bandits setup, where the learner allocates resources at each step to the arms and observes loss. The loss depends on two hidden parameters, one specific to the…

Machine Learning · Computer Science 2021-04-14 Arun Verma , Manjesh K. Hanawal , Arun Rajkumar , Raman Sankaran

This paper is concerned with the resource allocation in a multi-unmanned aerial vehicle (UAV)-aided network for providing enhanced mobile broadband (eMBB) services for user equipments. Different from most of the existing network resource…

Networking and Internet Architecture · Computer Science 2021-01-01 Xing Xi , Xianbin Cao , Peng Yang , Jingxuan Chen , Dapeng Wu

We study the problem of maximising terminal utility for an agent facing model uncertainty, in a frictionless discrete-time market with one safe asset and finitely many risky assets. We show that an optimal investment strategy exists if the…

Mathematical Finance · Quantitative Finance 2020-07-10 Miklós Rásonyi , Andrea Meireles-Rodrigues

We study the problem in which a central planner sequentially allocates a single resource to multiple strategic agents using their utility reports at each round, but without using any monetary transfers. We consider general agent utility…

Computer Science and Game Theory · Computer Science 2024-08-20 Moise Blanchard , Patrick Jaillet

This paper discusses the problem of maximizing the total data transmission utility of the computer network. The total utility is defined as the sum of the individual (corresponding to each node in the network) utilities that are concave…

Optimization and Control · Mathematics 2022-01-31 Dmitry Pasechnyuk

The maximization of Nash welfare, which equals the geometric mean of agents' utilities, is widely studied because it balances efficiency and fairness in resource allocation problems. Banerjee, Gkatzelis, Gorokh, and Jin (2022) recently…

Data Structures and Algorithms · Computer Science 2024-11-11 Zhiyi Huang , Minming Li , Xinkai Shu , Tianze Wei

Motivated by applications such as online labor markets we consider a variant of the stochastic multi-armed bandit problem where we have a collection of arms representing strategic agents with different performance characteristics. The…

Computer Science and Game Theory · Computer Science 2025-03-11 Seyed A. Esmaeili , Suho Shin , Aleksandrs Slivkins

We consider the Max $K$-Armed Bandit problem, where a learning agent is faced with several stochastic arms, each a source of i.i.d. rewards of unknown distribution. At each time step the agent chooses an arm, and observes the reward of the…

Machine Learning · Statistics 2015-12-25 Yahel David , Nahum Shimkin

To achieve high data rates and better connectivity in future communication networks, the deployment of different types of access points (APs) is underway. In order to limit human intervention and reduce costs, the APs are expected to be…

Signal Processing · Electrical Eng. & Systems 2021-01-19 Marie Josepha Youssef , Venugopal V. Veeravalli , Joumana Farah , Charbel Abdel Nour , Catherine Douillard

We consider a resource-aware variant of the classical multi-armed bandit problem: In each round, the learner selects an arm and determines a resource limit. It then observes a corresponding (random) reward, provided the (random) amount of…

Machine Learning · Computer Science 2022-10-18 Viktor Bengs , Eyke Hüllermeier

Coordination is a desirable feature in many multi-agent systems such as robotic and socioeconomic networks. We consider a task allocation problem as a binary networked coordination game over an undirected regular graph. Each agent in the…

Systems and Control · Electrical Eng. & Systems 2023-10-02 Yifei Zhang , Marcos M. Vasconcelos

In large-scale systems there are fundamental challenges when centralised techniques are used for task allocation. The number of interactions is limited by resource constraints such as on computation, storage, and network communication. We…

Artificial Intelligence · Computer Science 2022-05-12 Niall Creech , Natalia Criado Pacheco , Simon Miles

This paper introduces a general multi-agent bandit model in which each agent is facing a finite set of arms and may communicate with other agents through a central controller in order to identify, in pure exploration, or play, in regret…

Machine Learning · Computer Science 2022-10-31 Clémence Réda , Sattar Vakili , Emilie Kaufmann

Stochastic optimization is a widely used approach for optimization under uncertainty, where uncertain input parameters are modeled by random variables. Exact or approximation algorithms have been obtained for several fundamental problems in…

Machine Learning · Computer Science 2025-08-14 Arpit Agarwal , Rohan Ghuge , Viswanath Nagarajan , Zhengjia Zhuo

We consider a novel stochastic multi-armed bandit setting, where playing an arm makes it unavailable for a fixed number of time slots thereafter. This models situations where reusing an arm too often is undesirable (e.g. making the same…

Machine Learning · Computer Science 2024-07-31 Soumya Basu , Rajat Sen , Sujay Sanghavi , Sanjay Shakkottai

We consider the problem of a learning agent who has to repeatedly play a general sum game against a strategic opponent who acts to maximize their own payoff by optimally responding against the learner's algorithm. The learning agent knows…

Computer Science and Game Theory · Computer Science 2025-02-21 Eshwar Ram Arunachaleswaran , Natalie Collina , Jon Schneider

We investigate the benefits of heterogeneity in multi-agent explore-exploit decision making where the goal of the agents is to maximize cumulative group reward. To do so we study a class of distributed stochastic bandit problems in which…

Optimization and Control · Mathematics 2020-12-03 Udari Madhushani , Naomi Leonard