中文
相关论文

相关论文: Unknown Delay for Adversarial Bandit Setting with …

200 篇论文

Multi-armed bandit (MAB) is a widely adopted framework for sequential decision-making under uncertainty. Traditional bandit algorithms rely solely on online data, which tends to be scarce as it must be gathered during the online phase when…

统计理论 · 数学 2026-04-23 Wenlong Ji , Yihan Pan , Ruihao Zhu , Lihua Lei

We consider a multi-armed bandit problem where the decision maker can explore and exploit different arms at every round. The exploited arm adds to the decision maker's cumulative reward (without necessarily observing the reward) while the…

机器学习 · 计算机科学 2012-07-03 Orly Avner , Shie Mannor , Ohad Shamir

In this paper, we investigate the impact of diverse user preference on learning under the stochastic multi-armed bandit (MAB) framework. We aim to show that when the user preferences are sufficiently diverse and each arm can be optimal for…

机器学习 · 计算机科学 2022-11-11 Chao Gan , Jing Yang , Ruida Zhou , Cong Shen

We consider the Scale-Free Adversarial Multi-Armed Bandit (MAB) problem with unrestricted feedback delays. In contrast to the standard assumption that all losses are $[0,1]$-bounded, in our setting, losses can fall in a general bounded…

机器学习 · 计算机科学 2023-01-27 Jiatai Huang , Yan Dai , Longbo Huang

We study a strategic version of the multi-armed bandit problem, where each arm is an individual strategic agent and we, the principal, pull one arm each round. When pulled, the arm receives some private reward $v_a$ and can choose an amount…

计算机科学与博弈论 · 计算机科学 2017-07-03 Mark Braverman , Jieming Mao , Jon Schneider , S. Matthew Weinberg

The multi-armed bandit is a concise model for the problem of iterated decision-making under uncertainty. In each round, a gambler must pull one of $K$ arms of a slot machine, without any foreknowledge of their payouts, except that they are…

数据结构与算法 · 计算机科学 2007-05-23 Varsha Dani , Thomas P. Hayes

We study a multi-armed bandit problem in a dynamic environment where arm rewards evolve in a correlated fashion according to a Markov chain. Different than much of the work on related problems, in our formulation a learning algorithm does…

机器学习 · 计算机科学 2019-03-05 Tanner Fiez , Shreyas Sekar , Lillian J. Ratliff

This paper considers a multi-armed bandit (MAB) problem in which multiple mobile agents receive rewards by sampling from a collection of spatially dispersed stochastic processes, called bandits. The goal is to formulate a decentralized…

机器学习 · 计算机科学 2020-04-01 Pathmanathan Pankayaraj , D. H. S. Maithripala , J. M. Berg

In the classic Bayesian restless multi-armed bandit (RMAB) problem, there are $N$ arms, with rewards on all arms evolving at each time as Markov chains with known parameters. A player seeks to activate $K \geq 1$ arms at each time in order…

最优化与控制 · 数学 2010-11-23 Wenhan Dai , Yi Gai , Bhaskar Krishnamachari , Qing Zhao

This paper is in the field of stochastic Multi-Armed Bandits (MABs), i.e. those sequential selection techniques able to learn online using only the feedback given by the chosen option (a.k.a. $arm$). We study a particular case of the rested…

机器学习 · 统计学 2024-11-28 Marco Fiandri , Alberto Maria Metelli , Francesco Trov`o

We study the Improving Multi-Armed Bandit (IMAB) problem, where the reward obtained from an arm increases with the number of pulls it receives. This model provides an elegant abstraction for many real-world problems in domains such as…

机器学习 · 计算机科学 2022-08-22 Vishakha Patil , Vineet Nair , Ganesh Ghalme , Arindam Khan

Sequential learning in a multi-agent resource constrained matching market has received significant interest in the past few years. We study decentralized learning in two-sided matching markets where the demand side (aka players or agents)…

机器学习 · 计算机科学 2025-06-23 Satush Parikh , Soumya Basu , Avishek Ghosh , Abishek Sankararaman

Continuously learning and leveraging the knowledge accumulated from prior tasks in order to improve future performance is a long standing machine learning problem. In this paper, we study the problem in the multi-armed bandit framework with…

机器学习 · 计算机科学 2020-12-29 Matthieu Jedor , Jonathan Louëdec , Vianney Perchet

We study incentivized exploration for the multi-armed bandit (MAB) problem with non-stationary reward distributions, where players receive compensation for exploring arms other than the greedy choice and may provide biased feedback on the…

机器学习 · 计算机科学 2024-03-19 Sourav Chakraborty , Lijun Chen

In this paper we study the online learning problem involving rested and restless multiarmed bandits with multiple plays. The system consists of a single player/user and a set of K finite-state discrete-time Markov chains (arms) with unknown…

最优化与控制 · 数学 2015-03-25 Cem Tekin , Mingyan Liu

We study a new non-stochastic federated multi-armed bandit problem with multiple agents collaborating via a communication network. The losses of the arms are assigned by an oblivious adversary that specifies the loss of each arm not only…

机器学习 · 统计学 2023-10-24 Jialin Yi , Milan Vojnović

Motivated by a number of real-world applications from domains like healthcare and sustainable transportation, in this paper we study a scenario of repeated principal-agent games within a multi-armed bandit (MAB) framework, where: the…

机器学习 · 计算机科学 2023-05-09 Ilgin Dogan , Zuo-Jun Max Shen , Anil Aswani

We consider the classical multi-armed bandit problem, but with strategic arms. In this context, each arm is characterized by a bounded support reward distribution and strategically aims to maximize its own utility by potentially retaining a…

机器学习 · 计算机科学 2025-01-28 Ahmed Ben Yahmed , Clément Calauzènes , Vianney Perchet

In this paper, we introduce a distributed version of the classical stochastic Multi-Arm Bandit (MAB) problem. Our setting consists of a large number of agents $n$ that collaboratively and simultaneously solve the same instance of $K$ armed…

机器学习 · 计算机科学 2019-11-06 Abishek Sankararaman , Ayalvadi Ganesh , Sanjay Shakkottai

We study a distributed decision-making problem in which multiple agents face the same multi-armed bandit (MAB), and each agent makes sequential choices among arms to maximize its own individual reward. The agents cooperate by sharing their…

最优化与控制 · 数学 2020-08-13 Peter Landgren , Vaibhav Srivastava , Naomi Ehrich Leonard