中文
相关论文

相关论文: A two armed bandit type problem revisited

200 篇论文

The Competing Bandits framework is a recently emerging area that integrates multi-armed bandits in online learning with stable matching in game theory. While conventional models assume that all players and arms are constantly available, in…

机器学习 · 计算机科学 2026-03-23 Shinnosuke Uba , Yutaro Yamaguchi

We introduce the safe linear stochastic bandit framework---a generalization of linear stochastic bandits---where, in each stage, the learner is required to select an arm with an expected reward that is no less than a predetermined (safe)…

机器学习 · 统计学 2019-11-22 Kia Khezeli , Eilyan Bitar

The stochastic multi-armed bandit problem is well understood when the reward distributions are sub-Gaussian. In this paper we examine the bandit problem under the weaker assumption that the distributions have moments of order 1+\epsilon,…

机器学习 · 统计学 2012-09-11 Sébastien Bubeck , Nicolò Cesa-Bianchi , Gábor Lugosi

The Combinatorial Multi-Armed Bandit problem is a sequential decision-making problem in which an agent selects a set of arms on each round, observes feedback for each of these arms and aims to maximize a known reward function of the arms it…

机器学习 · 计算机科学 2020-07-17 Nadav Merlis , Shie Mannor

In the Best-$K$ identification problem (Best-$K$-Arm), we are given $N$ stochastic bandit arms with unknown reward distributions. Our goal is to identify the $K$ arms with the largest means with high confidence, by drawing samples from the…

机器学习 · 计算机科学 2017-05-22 Haotian Jiang , Jian Li , Mingda Qiao

Multi-player multi-armed bandit is an increasingly relevant decision-making problem, motivated by applications to cognitive radio systems. Most research for this problem focuses exclusively on the settings that players have \textit{full…

机器学习 · 计算机科学 2022-12-14 Guojun Xiong , Jian Li

We study a strategic version of the multi-armed bandit problem, where each arm is an individual strategic agent and we, the principal, pull one arm each round. When pulled, the arm receives some private reward $v_a$ and can choose an amount…

计算机科学与博弈论 · 计算机科学 2017-07-03 Mark Braverman , Jieming Mao , Jon Schneider , S. Matthew Weinberg

This paper proposes a new method for the K-armed dueling bandit problem, a variation on the regular K-armed bandit problem that offers only relative feedback about pairs of arms. Our approach extends the Upper Confidence Bound algorithm to…

机器学习 · 计算机科学 2013-12-18 Masrour Zoghi , Shimon Whiteson , Remi Munos , Maarten de Rijke

Contextual bandits are a form of multi-armed bandit in which the agent has access to predictive side information (known as the context) for each arm at each time step, and have been used to model personalized news recommendation, ad…

机器学习 · 统计学 2017-05-25 Aniket Anand Deshmukh , Urun Dogan , Clayton Scott

The stochastic multi-armed bandit problem is a well-known model for studying the exploration-exploitation trade-off. It has significant possible applications in adaptive clinical trials, which allow for dynamic changes in the treatment…

机器学习 · 计算机科学 2019-06-11 Hossein Aboutalebi , Doina Precup , Tibor Schuster

The multi-armed bandit(MAB) problem is a simple yet powerful framework that has been extensively studied in the context of decision-making under uncertainty. In many real-world applications, such as robotic applications, selecting an arm…

机器学习 · 计算机科学 2023-03-21 Tianpeng Zhang , Kasper Johansson , Na Li

In the classical multi-armed bandit problem, instance-dependent algorithms attain improved performance on "easy" problems with a gap between the best and second-best arm. Are similar guarantees possible for contextual bandits? While…

机器学习 · 计算机科学 2020-10-08 Dylan J. Foster , Alexander Rakhlin , David Simchi-Levi , Yunzong Xu

We consider the problem of fitting a reinforcement learning (RL) model to some given behavioral data under a multi-armed bandit environment. These models have received much attention in recent years for characterizing human and animal…

计算工程、金融与科学 · 计算机科学 2026-03-27 Hao Zhu , Jasper Hoffmann , Baohe Zhang , Joschka Boedecker

The dueling bandits problem is an online learning framework for learning from pairwise preference feedback, and is particularly well-suited for modeling settings that elicit subjective or implicit human feedback. In this paper, we study the…

机器学习 · 计算机科学 2017-05-02 Yanan Sui , Vincent Zhuang , Joel W. Burdick , Yisong Yue

We extend the adversarial/non-stochastic multi-play multi-armed bandit (MPMAB) to the case where the number of arms to play is variable. The work is motivated by the fact that the resources allocated to scan different critical locations in…

机器学习 · 计算机科学 2021-10-28 Yiyang Wang , Neda Masoud

Motivated by cognitive radio networks, we consider the stochastic multiplayer multi-armed bandit problem, where several players pull arms simultaneously and collisions occur if one of them is pulled by several players at the same stage. We…

机器学习 · 计算机科学 2019-11-20 Etienne Boursier , Vianney Perchet

We consider a stochastic bandit problem with a possibly infinite number of arms. We write $p^*$ for the proportion of optimal arms and $\Delta$ for the minimal mean-gap between optimal and sub-optimal arms. We characterize the optimal…

机器学习 · 计算机科学 2021-11-08 Rianne de Heide , James Cheshire , Pierre Ménard , Alexandra Carpentier

We study a variation of the classical multi-armed bandits problem. In this problem, the learner has to make a sequence of decisions, picking from a fixed set of choices. In each round, she receives as feedback only the loss incurred from…

机器学习 · 计算机科学 2017-09-18 Paresh Nakhe , Rebecca Reiffenhäuser

We study a multi-armed bandit problem in a dynamic environment where arm rewards evolve in a correlated fashion according to a Markov chain. Different than much of the work on related problems, in our formulation a learning algorithm does…

机器学习 · 计算机科学 2019-03-05 Tanner Fiez , Shreyas Sekar , Lillian J. Ratliff

The early sections of this paper present an analysis of a Markov decision model that is known as the multi-armed bandit under the assumption that the utility function of the decision maker is either linear or exponential. The analysis…

最优化与控制 · 数学 2012-03-22 Eric V. Denardo , Eugene A. Feinberg , Uriel G. Rothblum