中文
相关论文

相关论文: A Practical Algorithm for Multiplayer Bandits when…

200 篇论文

In this paper, we investigate a largely extended version of classical MAB problem, called networked combinatorial bandit problems. In particular, we consider the setting of a decision maker over a networked bandits as follows: each time a…

机器学习 · 计算机科学 2015-03-23 Shaojie Tang , Yaqin Zhou

We address the M-best-arm identification problem in multi-armed bandits. A player has a limited budget to explore K arms (M<K), and once pulled, each arm yields a reward drawn (independently) from a fixed, unknown distribution. The goal is…

机器学习 · 统计学 2017-07-11 Shahin Shahrampour , Vahid Tarokh

In modern resource-sharing systems, multiple agents access limited resources with unknown stochastic conditions to perform tasks. When multiple agents access the same resource (arm) simultaneously, they compete for successful usage, leading…

计算机科学与博弈论 · 计算机科学 2025-03-28 Hongbo Li , Lingjie Duan

We study how the regret guarantees of nonstochastic multi-armed bandits can be improved, if the effective range of the losses in each round is small (e.g. the maximal difference between two losses in a given round). Despite a recent…

机器学习 · 计算机科学 2020-01-03 Nicolò Cesa-Bianchi , Ohad Shamir

In this paper, we introduce the notion of replicable policies in the context of stochastic bandits, one of the canonical problems in interactive learning. A policy in the bandit environment is called replicable if it pulls, with high…

机器学习 · 计算机科学 2023-02-16 Hossein Esfandiari , Alkis Kalavasis , Amin Karbasi , Andreas Krause , Vahab Mirrokni , Grigoris Velegkas

We propose an algorithm for stochastic and adversarial multiarmed bandits with switching costs, where the algorithm pays a price $\lambda$ every time it switches the arm being played. Our algorithm is based on adaptation of the Tsallis-INF…

机器学习 · 计算机科学 2021-02-22 Chloé Rouyer , Yevgeny Seldin , Nicolò Cesa-Bianchi

Multi-armed Bandit motivates methods with provable upper bounds on regret and also the counterpart lower bounds have been extensively studied in this context. Recently, Multi-agent Multi-armed Bandit has gained significant traction in…

机器学习 · 计算机科学 2023-08-17 Mengfan Xu , Diego Klabjan

We consider the problem of distributed online learning with multiple players in multi-armed bandits (MAB) models. Each player can pick among multiple arms. When a player picks an arm, it gets a reward. We consider both i.i.d. reward model…

最优化与控制 · 数学 2016-11-18 Dileep Kalathil , Naumaan Nayyar , Rahul Jain

We consider the stochastic linear (multi-armed) contextual bandit problem with the possibility of hidden simple multi-armed bandit structure in which the rewards are independent of the contextual information. Algorithms that are designed…

机器学习 · 统计学 2020-10-07 Niladri S. Chatterji , Vidya Muthukumar , Peter L. Bartlett

We consider decentralized restless multi-armed bandit problems with unknown dynamics and multiple players. The reward state of each arm transits according to an unknown Markovian rule when it is played and evolves according to an arbitrary…

最优化与控制 · 数学 2011-02-16 Haoyang Liu , Keqin Liu , Qing Zhao

We consider minimisation of dynamic regret in non-stationary bandits with a slowly varying property. Namely, we assume that arms' rewards are stochastic and independent over time, but that the absolute difference between the expected…

机器学习 · 计算机科学 2021-10-26 Ramakrishnan Krishnamurthy , Aditya Gopalan

Motivated by a natural problem in online model selection with bandit information, we introduce and analyze a best arm identification problem in the rested bandit setting, wherein arm expected losses decrease with the number of times the arm…

机器学习 · 统计学 2020-12-08 Leonardo Cella , Claudio Gentile , Massimiliano Pontil

We present simple and efficient algorithms for the batched stochastic multi-armed bandit and batched stochastic linear bandit problems. We prove bounds for their expected regrets that improve over the best-known regret bounds for any number…

数据结构与算法 · 计算机科学 2020-02-19 Hossein Esfandiari , Amin Karbasi , Abbas Mehrabian , Vahab Mirrokni

We study meta-learning for adversarial multi-armed bandits. We consider the online-within-online setup, in which a player (learner) encounters a sequence of multi-armed bandit episodes. The player's performance is measured as regret against…

机器学习 · 计算机科学 2022-07-13 Ilya Osadchiy , Kfir Y. Levy , Ron Meir

We consider the problem where $N$ agents collaboratively interact with an instance of a stochastic $K$ arm bandit problem for $K \gg N$. The agents aim to simultaneously minimize the cumulative regret over all the agents for a total of $T$…

机器学习 · 计算机科学 2021-02-18 Mridul Agarwal , Vaneet Aggarwal , Kamyar Azizzadenesheli

The multi-armed bandit (MAB) problem is an active learning framework that aims to select the best among a set of actions by sequentially observing rewards. Recently, it has become popular for a number of applications over wireless networks,…

机器学习 · 计算机科学 2021-11-12 Osama A. Hanna , Lin F. Yang , Christina Fragouli

Multiplayer bandits have recently been extensively studied because of their application to cognitive radio networks. While the literature mostly considers synchronous players, radio networks (e.g. for IoT) tend to have asynchronous devices.…

机器学习 · 计算机科学 2023-06-01 Hugo Richard , Etienne Boursier , Vianney Perchet

We discuss a multiple-play multi-armed bandit (MAB) problem in which several arms are selected at each round. Recently, Thompson sampling (TS), a randomized algorithm with a Bayesian spirit, has attracted much attention for its empirically…

机器学习 · 统计学 2019-03-22 Junpei Komiyama , Junya Honda , Hiroshi Nakagawa

The problem of matching markets has been studied for a long time in the literature due to its wide range of applications. Finding a stable matching is a common equilibrium objective in this problem. Since market participants are usually…

机器学习 · 计算机科学 2023-07-21 Fang Kong , Shuai Li

In this paper, we introduce a multi-armed bandit problem termed max-min grouped bandits, in which the arms are arranged in possibly-overlapping groups, and the goal is to find the group whose worst arm has the highest mean reward. This…

机器学习 · 统计学 2022-03-16 Zhenlin Wang , Jonathan Scarlett