中文
相关论文

相关论文: A two armed bandit type problem revisited

200 篇论文

Learning preferences implicit in the choices humans make is a well studied problem in both economics and computer science. However, most work makes the assumption that humans are acting (noisily) optimally with respect to their preferences.…

机器学习 · 计算机科学 2019-01-28 Lawrence Chan , Dylan Hadfield-Menell , Siddhartha Srinivasa , Anca Dragan

Reinforcement learning involves decision making in dynamic and uncertain environments and constitutes a crucial element of artificial intelligence. In our previous work, we experimentally demonstrated that the ultrafast chaotic oscillatory…

The RKHS bandit problem (also called kernelized multi-armed bandit problem) is an online optimization problem of non-linear functions with noisy feedback. Although the problem has been extensively studied, there are unsatisfactory results…

机器学习 · 计算机科学 2021-07-27 Sho Takemori , Masahiro Sato

We introduce a new graphical bilinear bandit problem where a learner (or a \emph{central entity}) allocates arms to the nodes of a graph and observes for each edge a noisy bilinear reward representing the interaction between the two end…

机器学习 · 计算机科学 2021-06-14 Geovani Rizk , Albert Thomas , Igor Colin , Rida Laraki , Yann Chevaleyre

The combinatorial stochastic semi-bandit problem is an extension of the classical multi-armed bandit problem in which an algorithm pulls more than one arm at each stage and the rewards of all pulled arms are revealed. One difference with…

机器学习 · 计算机科学 2016-12-07 Rémy Degenne , Vianney Perchet

We propose a novel algorithm for multi-player multi-armed bandits without collision sensing information. Our algorithm circumvents two problems shared by all state-of-the-art algorithms: it does not need as an input a lower bound on the…

机器学习 · 统计学 2022-06-07 Wei Huang , Richard Combes , Cindy Trinh

We propose and study the known-compensation multi-arm bandit (KCMAB) problem, where a system controller offers a set of arms to many short-term players for $T$ steps. In each step, one short-term player arrives to the system. Upon arrival,…

机器学习 · 计算机科学 2018-11-06 Siwei Wang , Longbo Huang

We consider a multiobjective multiarmed bandit problem with lexicographically ordered objectives. In this problem, the goal of the learner is to select arms that are lexicographic optimal as much as possible without knowing the arm reward…

机器学习 · 计算机科学 2019-07-30 Alihan Hüyük , Cem Tekin

We study a structured variant of the multi-armed bandit problem specified by a set of Bernoulli distributions $ \nu \!= \!(\nu\_{a,b})\_{a \in \mathcal{A}, b \in \mathcal{B}}$ with means $(\mu\_{a,b})\_{a \in \mathcal{A}, b \in…

信息论 · 计算机科学 2020-07-13 Hassan Saber , Pierre Ménard , Odalric-Ambrym Maillard

In a multi-armed bandit problem, an online algorithm chooses from a set of strategies in a sequence of trials so as to maximize the total payoff of the chosen strategies. While the performance of bandit algorithms with a small finite…

数据结构与算法 · 计算机科学 2008-09-30 Robert Kleinberg , Aleksandrs Slivkins , Eli Upfal

We investigate the adversarial bandit problem with multiple plays under semi-bandit feedback. We introduce a highly efficient algorithm that asymptotically achieves the performance of the best switching $m$-arm strategy with minimax optimal…

机器学习 · 计算机科学 2019-12-02 N. Mert Vural , Hakan Gokcesu , Kaan Gokcesu , Suleyman S. Kozat

We consider the problem of contextual multi-armed bandits in the setting of hypothesis transfer learning. That is, we assume having access to a previously learned model on an unobserved set of contexts, and we leverage it in order to…

机器学习 · 计算机科学 2022-11-15 Steven Bilaj , Sofien Dhouib , Setareh Maghsudi

We consider a contextual version of multi-armed bandit problem with global knapsack constraints. In each round, the outcome of pulling an arm is a scalar reward and a resource consumption vector, both dependent on the context, and the…

机器学习 · 计算机科学 2016-07-12 Shipra Agrawal , Nikhil R. Devanur , Lihong Li

We consider a policy gradient algorithm applied to a finite-arm bandit problem with Bernoulli rewards. We allow learning rates to depend on the current state of the algorithm, rather than use a deterministic time-decreasing learning rate.…

机器学习 · 计算机科学 2021-09-24 Denis Denisov , Neil Walton

We study meta-learning for adversarial multi-armed bandits. We consider the online-within-online setup, in which a player (learner) encounters a sequence of multi-armed bandit episodes. The player's performance is measured as regret against…

机器学习 · 计算机科学 2022-07-13 Ilya Osadchiy , Kfir Y. Levy , Ron Meir

In this paper, we propose a new multi-armed bandit problem called the Gambler's Ruin Bandit Problem (GRBP). In the GRBP, the learner proceeds in a sequence of rounds, where each round is a Markov Decision Process (MDP) with two actions…

机器学习 · 计算机科学 2016-09-30 Nima Akbarzadeh , Cem Tekin

We introduce a novel variant of the multi-armed bandit problem, in which bandits are streamed one at a time to the player, and at each point, the player can either choose to pull the current bandit or move on to the next bandit. Once a…

人工智能 · 计算机科学 2017-07-18 Uma Roy , Ashwath Thirmulai , Joe Zurier

We consider a stochastic multi-armed bandit (MAB) problem motivated by ``large'' action spaces, and endowed with a population of arms containing exactly $K$ arm-types, each characterized by a distinct mean reward. The decision maker is…

机器学习 · 计算机科学 2023-01-19 Anand Kalvit , Assaf Zeevi

We study a generalization of the multi-armed bandit problem with multiple plays where there is a cost associated with pulling each arm and the agent has a budget at each time that dictates how much she can expect to spend. We derive an…

机器学习 · 统计学 2019-09-13 Alexander Luedtke , Emilie Kaufmann , Antoine Chambaz

Recent work has considered natural variations of the multi-armed bandit problem, where the reward distribution of each arm is a special function of the time passed since its last pulling. In this direction, a simple (yet widely applicable)…