中文
相关论文

相关论文: Survival Multiarmed Bandits with Bootstrapping Met…

200 篇论文

The (contextual) multi-armed bandit problem (MAB) provides a formalization of sequential decision-making which has many applications. However, validly evaluating MAB policies is challenging; we either resort to simulations which inherently…

机器学习 · 计算机科学 2019-08-22 Jules Kruijswijk , Petri Parvinen , Maurits Kaptein

We propose a multi-agent multi-armed bandit (MA-MAB) framework aimed at ensuring fair outcomes across agents while maximizing overall system performance. A key challenge in this setting is decision-making under limited information about arm…

机器学习 · 计算机科学 2026-01-28 Tianyi Xu , Jiaxin Liu , Nicholas Mattei , Zizhan Zheng

We study the stochastic Multi-Armed Bandit (MAB) problem with random delays in the feedback received by the algorithm. We consider two settings: the reward-dependent delay setting, where realized delays may depend on the stochastic rewards,…

机器学习 · 计算机科学 2021-06-07 Tal Lancewicki , Shahar Segal , Tomer Koren , Yishay Mansour

We study incentivized exploration for the multi-armed bandit (MAB) problem where the players receive compensation for exploring arms other than the greedy choice and may provide biased feedback on reward. We seek to understand the impact of…

机器学习 · 计算机科学 2019-12-17 Zhiyuan Liu , Huazheng Wang , Fan Shen , Kai Liu , Lijun Chen

In this paper, we consider a new Multi-Armed Bandit (MAB) problem where arms are nodes in an unknown and possibly changing graph, and the agent (i) initiates random walks over the graph by pulling arms, (ii) observes the random walk…

机器学习 · 计算机科学 2022-06-28 Tianyu Wang , Lin F. Yang , Zizhuo Wang

The problem of multi-armed bandits (MAB) asks to make sequential decisions while balancing between exploitation and exploration, and have been successfully applied to a wide range of practical scenarios. Various algorithms have been…

机器学习 · 计算机科学 2022-02-24 Xiaojin Zhang , Shuai Li , Weiwen Liu , Shengyu Zhang

Despite the great interest in the bandit problem, designing efficient algorithms for complex models remains challenging, as there is typically no analytical way to quantify uncertainty. In this paper, we propose Multiplier Bootstrap-based…

机器学习 · 计算机科学 2023-02-06 Runzhe Wan , Haoyu Wei , Branislav Kveton , Rui Song

We study collaborative learning in multi-agent Bayesian bandit problems, where strategic agents collectively solve the same bandit instance. While multiple agents can accelerate learning by sharing information, strategic agents might prefer…

机器学习 · 计算机科学 2026-05-14 Idan Barnea , Ofir Schlisselberg , Yishay Mansour

We study the multi-player stochastic multiarmed bandit (MAB) problem in an abruptly changing environment. We consider a collision model in which a player receives reward at an arm if it is the only player to select the arm. We design two…

机器学习 · 统计学 2018-12-14 Lai Wei , Vaibhav Srivastava

We consider a stochastic multi-armed bandit setting where reward must be actively queried for it to be observed. We provide tight lower and upper problem-dependent guarantees on both the regret and the number of queries. Interestingly, we…

机器学习 · 计算机科学 2022-10-28 Nadav Merlis , Yonathan Efroni , Shie Mannor

Reinforcement Learning (RL) is a widely researched area in artificial intelligence that focuses on teaching agents decision-making through interactions with their environment. A key subset includes stochastic multi-armed bandit (MAB) and…

机器学习 · 统计学 2025-02-20 Pengjie Zhou , Haoyu Wei , Huiming Zhang

Multi-armed bandit (MAB) is a widely adopted framework for sequential decision-making under uncertainty. Traditional bandit algorithms rely solely on online data, which tends to be scarce as it must be gathered during the online phase when…

统计理论 · 数学 2026-04-23 Wenlong Ji , Yihan Pan , Ruihao Zhu , Lihua Lei

The multi-armed bandit (MAB) is a classical online optimization model for the trade-off between exploration and exploitation. The traditional MAB is concerned with finding the arm that minimizes the mean cost. However, minimizing the mean…

最优化与控制 · 数学 2018-09-17 Jianyu Xu , William B. Haskell , Zhisheng Ye

We consider a multi-armed bandit problem in a setting where each arm produces a noisy reward realization which depends on an observable random covariate. As opposed to the traditional static multi-armed bandit problem, this setting allows…

统计理论 · 数学 2013-05-27 Vianney Perchet , Philippe Rigollet

This paper introduces the framework of multi-armed sampling, which serves as the sampling counterpart to the optimization problem of multi-armed bandits. Our primary motivation is to rigorously examine the exploration-exploitation trade-off…

机器学习 · 计算机科学 2026-05-14 Mohammad Pedramfar , Siamak Ravanbakhsh

The multi-armed bandit (MAB) problem is a classic example of the exploration-exploitation dilemma. It is concerned with maximising the total rewards for a gambler by sequentially pulling an arm from a multi-armed slot machine where each arm…

机器学习 · 统计学 2018-05-16 Xue Lu , Niall Adams , Nikolas Kantas

The classic multi-armed bandit (MAB) problem tackles the challenge of accruing maximum reward while making decisions under uncertainty. However, in applications, often the goal is to minimize cost subject to a constraint on the minimum…

机器学习 · 计算机科学 2026-05-11 Ishank Juneja , Carlee Joe-Wong , Osman Yağan

The batched multi-armed bandit (MAB) problem, in which rewards are collected in batches, is crucial for applications such as clinical trials. Existing research predominantly assumes light-tailed reward distributions, yet many real-world…

机器学习 · 计算机科学 2026-03-24 Yunwen Guo , Yunlun Shu , Gongyi Zhuo , Tianyu Wang

The multi-armed bandit problems have been studied mainly under the measure of expected total reward accrued over a horizon of length $T$. In this paper, we address the issue of risk in multi-armed bandit problems and develop parallel…

机器学习 · 计算机科学 2017-08-16 Sattar Vakili , Qing Zhao

We extend Bayesian multi-armed bandit (MAB) algorithms beyond their original setting by making use of sequential Monte Carlo (SMC) methods. A MAB is a sequential decision making problem where the goal is to learn a policy that maximizes…

机器学习 · 统计学 2024-04-08 Iñigo Urteaga , Chris H. Wiggins