中文
相关论文

相关论文: Unknown Delay for Adversarial Bandit Setting with …

200 篇论文

In a conventional contextual multi-armed bandit problem, the feedback (or reward) is immediately observable after an action. Nevertheless, delayed feedback arises in numerous real-life situations and is particularly crucial in…

机器学习 · 计算机科学 2024-05-21 Kweiguu Liu , Setareh Maghsudi

We study a variant of the stochastic $K$-armed bandit problem, which we call "bandits with delayed, aggregated anonymous feedback". In this problem, when the player pulls an arm, a reward is generated, however it is not immediately…

机器学习 · 统计学 2018-06-14 Ciara Pike-Burke , Shipra Agrawal , Csaba Szepesvari , Steffen Grunewalder

We consider the problem of distributed online learning with multiple players in multi-armed bandits (MAB) models. Each player can pick among multiple arms. When a player picks an arm, it gets a reward. We consider both i.i.d. reward model…

最优化与控制 · 数学 2016-11-18 Dileep Kalathil , Naumaan Nayyar , Rahul Jain

We introduce the problem of regret minimization in adversarial multi-dueling bandits. While adversarial preferences have been studied in dueling bandits, they have not been explored in multi-dueling bandits. In this setting, the learner is…

机器学习 · 计算机科学 2024-06-27 Pratik Gajane

We formulate and study a decentralized multi-armed bandit (MAB) problem. There are M distributed players competing for N independent arms. Each arm, when played, offers i.i.d. reward according to a distribution with an unknown parameter. At…

最优化与控制 · 数学 2015-05-14 Keqin Liu , Qing Zhao

The dueling bandit problem, an essential variation of the traditional multi-armed bandit problem, has become significantly prominent recently due to its broad applications in online advertising, recommendation systems, information…

机器学习 · 计算机科学 2025-04-08 Bongsoo Yi , Yue Kang , Yao Li

In a multi-armed bandit (MAB) problem a gambler needs to choose at each round of play one of K arms, each characterized by an unknown reward distribution. Reward realizations are only observed when an arm is selected, and the gambler's…

机器学习 · 计算机科学 2019-06-11 Omar Besbes , Yonatan Gur , Assaf Zeevi

Multi-player multi-armed bandit is an increasingly relevant decision-making problem, motivated by applications to cognitive radio systems. Most research for this problem focuses exclusively on the settings that players have \textit{full…

机器学习 · 计算机科学 2022-12-14 Guojun Xiong , Jian Li

Multi armed bandit (MAB) algorithms have been increasingly used to complement or integrate with A/B tests and randomized clinical trials in e-commerce, healthcare, and policymaking. Recent developments incorporate possible delayed feedback.…

统计方法学 · 统计学 2023-07-04 Lei Shi , Jingshen Wang , Tianhao Wu

Restless multi-armed bandits (RMAB) play a central role in modeling sequential decision making problems under an instantaneous activation constraint that at most B arms can be activated at any decision epoch. Each restless arm is endowed…

机器学习 · 计算机科学 2024-05-03 Guojun Xiong , Jian Li

We study a distributed multi-armed bandit (MAB) problem over arm erasure channels, motivated by the increasing adoption of MAB algorithms over communication-constrained networks. In this setup, the learner communicates the chosen arm to…

机器学习 · 计算机科学 2026-01-21 Merve Karakas , Osama Hanna , Lin F. Yang , Christina Fragouli

We study the stochastic multi-armed bandit problem with non-equivalent multiple plays where, at each step, an agent chooses not only a set of arms, but also their order, which influences reward distribution. In several problem formulations…

机器学习 · 计算机科学 2015-07-20 Aleksandr Vorobev , Gleb Gusev

Motivated by distributed selection problems, we formulate a new variant of multi-player multi-armed bandit (MAB) model, which captures stochastic arrival of requests to each arm, as well as the policy of allocating requests to players. The…

人工智能 · 计算机科学 2024-08-21 Hong Xie , Jinyu Mo , Defu Lian , Jie Wang , Enhong Chen

In this paper, we investigate a variant of the classical stochastic Multi-armed Bandit (MAB) problem, where the payoff received by an agent (either cost or reward) is both delayed, and directly corresponds to the magnitude of the delay.…

机器学习 · 计算机科学 2024-10-16 Ofir Schlisselberg , Ido Cohen , Tal Lancewicki , Yishay Mansour

The paper addresses the Multiplayer Multi-Armed Bandit (MMAB) problem, where $M$ decision makers or players collaborate to maximize their cumulative reward. When several players select the same arm, a collision occurs and no reward is…

机器学习 · 计算机科学 2019-10-29 Alexandre Proutiere , Po-An Wang

We study the stochastic combinatorial semi-bandit problem with unrestricted feedback delays under merit-based fairness constraints. This is motivated by applications such as crowdsourcing, and online advertising, where immediate feedback is…

机器学习 · 计算机科学 2024-07-30 Ziqun Chen , Kechao Cai , Zhuoyue Chen , Jinbei Zhang , John C. S. Lui

We consider a resource-aware variant of the classical multi-armed bandit problem: In each round, the learner selects an arm and determines a resource limit. It then observes a corresponding (random) reward, provided the (random) amount of…

机器学习 · 计算机科学 2022-10-18 Viktor Bengs , Eyke Hüllermeier

We study the stochastic Multiplayer Multi-Armed Bandit (MMAB) problem, where multiple players select arms to maximize their cumulative rewards. Collisions occur when two or more players select the same arm, resulting in no reward, and are…

机器学习 · 计算机科学 2025-10-09 Daoyuan Zhou , Xuchuang Wang , Lin Yang , Yang Gao

We study meta-learning for adversarial multi-armed bandits. We consider the online-within-online setup, in which a player (learner) encounters a sequence of multi-armed bandit episodes. The player's performance is measured as regret against…

机器学习 · 计算机科学 2022-07-13 Ilya Osadchiy , Kfir Y. Levy , Ron Meir

In this paper, we consider a new Multi-Armed Bandit (MAB) problem where arms are nodes in an unknown and possibly changing graph, and the agent (i) initiates random walks over the graph by pulling arms, (ii) observes the random walk…

机器学习 · 计算机科学 2022-06-28 Tianyu Wang , Lin F. Yang , Zizhuo Wang