中文
相关论文

相关论文: Arm order recognition in multi-armed bandit proble…

200 篇论文

In multi-armed bandits, the tasks of reward maximization and pure exploration are often at odds with each other. The former focuses on exploiting arms with the highest means, while the latter may require constant exploration across all…

机器学习 · 计算机科学 2024-10-22 Brian Cho , Dominik Meier , Kyra Gan , Nathan Kallus

We study a regret minimization problem with the existence of multiple best/near-optimal arms in the multi-armed bandit setting. We consider the case when the number of arms/actions is comparable or much larger than the time horizon, and…

机器学习 · 统计学 2020-10-23 Yinglun Zhu , Robert Nowak

In this paper, we propose a new multi-objective contextual multi-armed bandit (MAB) problem with two objectives, where one of the objectives dominates the other objective. Unlike single-objective MAB problems in which the learner obtains a…

机器学习 · 计算机科学 2018-06-04 Cem Tekin , Eralp Turgay

In a typical stochastic multi-armed bandit problem, the objective is often to maximize the expected sum of rewards over some time horizon $T$. While the choice of a strategy that accomplishes that is optimal with no additional information,…

机器学习 · 计算机科学 2023-11-01 Reda Alami , Mohammed Mahfoud , Mastane Achab

We study a decentralized multi-agent multi-armed bandit problem in which multiple clients are connected by time dependent random graphs provided by an environment. The reward distributions of each arm vary across clients and rewards are…

机器学习 · 计算机科学 2023-10-19 Mengfan Xu , Diego Klabjan

Contextual multi-armed bandit (MAB) algorithms have been shown promising for maximizing cumulative rewards in sequential decision tasks such as news article recommendation systems, web page ad placement algorithms, and mobile health.…

机器学习 · 统计学 2019-02-01 Gi-Soo Kim , Myunghee Cho Paik

We consider a variant of the best arm identification task in stochastic multi-armed bandits. Motivated by risk-averse decision-making problems, our goal is to identify a set of $m$ arms with the highest $\tau$-quantile values within a fixed…

机器学习 · 计算机科学 2023-02-22 Mengyan Zhang , Cheng Soon Ong

We address the M-best-arm identification problem in multi-armed bandits. A player has a limited budget to explore K arms (M<K), and once pulled, each arm yields a reward drawn (independently) from a fixed, unknown distribution. The goal is…

机器学习 · 统计学 2017-07-11 Shahin Shahrampour , Vahid Tarokh

We generalize the multiple-play multi-armed bandits (MP-MAB) problem with a shareable arm setting, in which several plays can share the same arm. Furthermore, each shareable arm has a finite reward capacity and a ''per-load'' reward…

机器学习 · 计算机科学 2022-06-20 Xuchuang Wang , Hong Xie , John C. S. Lui

This paper is in the field of stochastic Multi-Armed Bandits (MABs), i.e. those sequential selection techniques able to learn online using only the feedback given by the chosen option (a.k.a. $arm$). We study a particular case of the rested…

机器学习 · 统计学 2024-11-28 Marco Fiandri , Alberto Maria Metelli , Francesco Trov`o

Multi-armed bandit (MAB) algorithms are efficient approaches to reduce the opportunity cost of online experimentation and are used by companies to find the best product from periodically refreshed product catalogs. However, these algorithms…

机器学习 · 计算机科学 2024-12-19 Mohsen Bayati , Junyu Cao , Wanning Chen

We study incentivized exploration for the multi-armed bandit (MAB) problem where the players receive compensation for exploring arms other than the greedy choice and may provide biased feedback on reward. We seek to understand the impact of…

机器学习 · 计算机科学 2019-12-17 Zhiyuan Liu , Huazheng Wang , Fan Shen , Kai Liu , Lijun Chen

When multi-armed bandit (MAB) algorithms allocate pulls among competing arms, the resulting allocation can exhibit huge variation. This is particularly harmful in modern applications such as learning-enhanced platform operations and…

机器学习 · 计算机科学 2026-02-10 Yilun Chen , Jiaqi Lu

In a multi-armed bandit problem, an online algorithm chooses from a set of strategies in a sequence of trials so as to maximize the total payoff of the chosen strategies. While the performance of bandit algorithms with a small finite…

数据结构与算法 · 计算机科学 2008-09-30 Robert Kleinberg , Aleksandrs Slivkins , Eli Upfal

We consider a stochastic bandit problem with a possibly infinite number of arms. We write $p^*$ for the proportion of optimal arms and $\Delta$ for the minimal mean-gap between optimal and sub-optimal arms. We characterize the optimal…

机器学习 · 计算机科学 2021-11-08 Rianne de Heide , James Cheshire , Pierre Ménard , Alexandra Carpentier

This paper considers a multi-armed bandit (MAB) problem in which multiple mobile agents receive rewards by sampling from a collection of spatially dispersed stochastic processes, called bandits. The goal is to formulate a decentralized…

机器学习 · 计算机科学 2020-04-01 Pathmanathan Pankayaraj , D. H. S. Maithripala , J. M. Berg

Restless multi-armed bandits (RMAB) have been widely used to model sequential decision making problems with constraints. The decision maker (DM) aims to maximize the expected total reward over an infinite horizon under an "instantaneous…

机器学习 · 计算机科学 2023-12-25 Shufan Wang , Guojun Xiong , Jian Li

Sequential experiments are often characterized by an exploration-exploitation tradeoff that is captured by the multi-armed bandit (MAB) framework. This framework has been studied and applied, typically when at each time period feedback is…

机器学习 · 计算机科学 2020-12-22 Yonatan Gur , Ahmadreza Momeni

We consider a variant of the best arm identification (BAI) problem in multi-armed bandits (MAB) in which there are two sets of arms (source and target), and the objective is to determine the best target arm while only pulling source arms.…

机器学习 · 计算机科学 2021-12-09 Ojash Neopane , Aaditya Ramdas , Aarti Singh

Remote education has proliferated in the twenty-first century, yielding rise to intelligent tutoring systems. In particular, research has found multi-armed bandit (MAB) intelligent tutors to have notable abilities in traversing the…

计算机与社会 · 计算机科学 2024-08-15 Blake Castleman , Uzay Macar , Ansaf Salleb-Aouissi