English
Related papers

Related papers: Stochastic Network Utility Maximization with Unkno…

200 papers

We present a solution of a class of network utility maximization (NUM) problems using minimal communication. The constraints of the problem are inspired less by TCP-like congestion control but by problems in the area of internet of things…

Optimization and Control · Mathematics 2016-03-22 Fabian Wirth , Sonja Stuedli , Jia Yuan Yu , Martin Corless , Robert Shorten

We consider the classical multi-armed bandit problem, but with strategic arms. In this context, each arm is characterized by a bounded support reward distribution and strategically aims to maximize its own utility by potentially retaining a…

Machine Learning · Computer Science 2025-01-28 Ahmed Ben Yahmed , Clément Calauzènes , Vianney Perchet

A new class of multi agent single machine scheduling problems is introduced, where each job is associated with a self interested agent with a utility function decreasing in completion time. We aim to achieve a fair solution by maximizing…

Computer Science and Game Theory · Computer Science 2026-04-01 Gaia Nicosia , Andrea Pacifici , Ulrich Pferschy

Network utility maximization (NUM) is a well-studied problem for network traffic management and resource allocation. Because of the inherent decentralization and complexity of networks, most researches develop decentralized NUM algorithms.…

Networking and Internet Architecture · Computer Science 2024-08-19 Ying Tian , Zhiliang Wang , Xia Yin , Xingang Shi , Jiahai Yang , Han Zhang

BATS (BATched Sparse) codes are a class of efficient random linear network coding variation that has been studied for multihop wireless networks mostly in scenarios of a single communication flow. Towards sophisticated multi-flow network…

Information Theory · Computer Science 2021-09-16 Yanyan Dong , Sheng Jin , Yanzuo Chen , Shenghao Yang , Hoover H. F. Yin

Learning algorithms are often used to make decisions in sequential decision-making environments. In multi-agent settings, the decisions of each agent can affect the utilities/losses of the other agents. Therefore, if an agent is good at…

Computer Science and Game Theory · Computer Science 2024-07-09 Angelos Assos , Yuval Dagan , Constantinos Daskalakis

We consider the stochastic linear (multi-armed) contextual bandit problem with the possibility of hidden simple multi-armed bandit structure in which the rewards are independent of the contextual information. Algorithms that are designed…

Machine Learning · Statistics 2020-10-07 Niladri S. Chatterji , Vidya Muthukumar , Peter L. Bartlett

We study agents communicating over an underlying network by exchanging messages, in order to optimize their individual regret in a common nonstochastic multi-armed bandit problem. We derive regret minimization algorithms that guarantee for…

Machine Learning · Computer Science 2019-11-19 Yogev Bar-On , Yishay Mansour

We consider a distributed stochastic optimization problem in networks with finite number of nodes. Each node adjusts its action to optimize the global utility of the network, which is defined as the sum of local utilities of all nodes.…

Information Theory · Computer Science 2018-07-31 Wenjie Li , Mohamad Assaad

Network Utility Maximization (NUM) is often applied for the cross-layer design of wireless networks considering known wireless channels. However, realistic wireless channel capacities are stochastic bearing time-varying statistics,…

Systems and Control · Computer Science 2016-06-14 Eleni Stai , Michail Loulakis , Symeon Papavassiliou

Game theory has emerged as a fruitful paradigm for the design of networked multiagent systems. A fundamental component of this approach is the design of agents' utility functions so that their self-interested maximization results in a…

Computer Science and Game Theory · Computer Science 2020-03-12 Dario Paccagnan , Rahul Chandan , Jason R. Marden

A stochastic multi-user multi-armed bandit framework is used to develop algorithms for uncoordinated spectrum access. In contrast to prior work, it is assumed that rewards can be non-zero even under collisions, thus allowing for the number…

Information Theory · Computer Science 2021-01-13 Meghana Bande , Akshayaa Magesh , Venugopal V. Veeravalli

The use of cellular networks for massive machine-type communications (mMTC) is an appealing solution due to the availability of the existing infrastructure. However, the massive number of user equipments (UEs) poses a significant challenge…

Signal Processing · Electrical Eng. & Systems 2025-04-22 Ahmed O. Elmeligy , Ioannis Psaromiligkos , Au Minh

We study the cooperative stochastic $k$-armed bandit problem, where a network of $m$ agents collaborate to find the optimal action. In contrast to most prior work on this problem, which focuses on extending a specific algorithm to the…

Machine Learning · Computer Science 2024-11-01 Benjamin Howson , Sarah Filippi , Ciara Pike-Burke

We initiate a novel direction in randomized social choice by proposing a new definition of agent utility for randomized outcomes. Each agent has a preference over all outcomes and a {\em quantile} parameter. Given a {\em lottery} over the…

Computer Science and Game Theory · Computer Science 2026-03-03 Ioannis Caragiannis , Fabian Frank , Sanjukta Roy

While sequential task assignment for a single agent has been widely studied, such problems in a multi-agent setting, where the agents have heterogeneous task preferences or capabilities, remain less well-characterized. We study a…

Multiagent Systems · Computer Science 2025-10-21 Qinshuang Wei , Vaibhav Srivastava , Vijay Gupta

We introduce a bandit framework for stochastic matching under the multinomial logit (MNL) choice model. In our setting, $N$ agents on one side are assigned to $K$ arms on the other side, where each arm stochastically selects an agent from…

Machine Learning · Statistics 2026-01-30 Jung-hun Kim , Min-hwan Oh

We study network utility maximization (NUM) in the context of cellular single station association (SSA) policies, which assigns each mobile user (MU) to a single base station (BS). We measure an SSA policy in terms of the induced…

Networking and Internet Architecture · Computer Science 2015-10-22 Jeffrey Wildman , Steven Weber

Communication networks shared by many users are a widespread challenge nowadays. In this paper we address several aspects of this challenge simultaneously: learning unknown stochastic network characteristics, sharing resources with other…

Machine Learning · Computer Science 2018-08-16 Orly Avner , Shie Mannor

We study the problem of a buyer (aka auctioneer) who gains stochastic rewards by procuring multiple units of a service or item from a pool of heterogeneous strategic agents. The reward obtained for a single unit from an allocated agent…

Computer Science and Game Theory · Computer Science 2015-04-30 Satyanath Bhat , Shweta Jain , Sujit Gujar , Y. Narahari