中文
相关论文

相关论文: Cooperation Speeds Surfing: Use Co-Bandit!

200 篇论文

In this paper we consider the adversarial contextual bandit problem in metric spaces. The paper "Nearest neighbour with bandit feedback" tackled this problem but when there are many contexts near the decision boundary of the comparator…

机器学习 · 计算机科学 2023-12-18 Stephen Pasteris , Chris Hicks , Vasilios Mavroudis

Contextual bandit algorithms are essential for solving many real-world interactive machine learning problems. Despite multiple recent successes on statistically and computationally efficient methods, the practical behavior of these…

机器学习 · 统计学 2021-06-08 Alberto Bietti , Alekh Agarwal , John Langford

We study the problem of combining multiple bandit algorithms (that is, online learning algorithms with partial feedback) with the goal of creating a master algorithm that performs almost as well as the best base algorithm if it were to be…

机器学习 · 计算机科学 2017-06-07 Alekh Agarwal , Haipeng Luo , Behnam Neyshabur , Robert E. Schapire

We study the problem of corralling stochastic bandit algorithms, that is combining multiple bandit algorithms designed for a stochastic environment, with the goal of devising a corralling algorithm that performs almost as well as the best…

机器学习 · 计算机科学 2021-03-02 Raman Arora , Teodor V. Marinov , Mehryar Mohri

Performance of machine learning algorithms depends critically on identifying a good set of hyperparameters. While recent approaches use Bayesian optimization to adaptively select configurations, we focus on speeding up random search through…

机器学习 · 计算机科学 2018-06-20 Lisha Li , Kevin Jamieson , Giulia DeSalvo , Afshin Rostamizadeh , Ameet Talwalkar

We study exploration in Multi-Armed Bandits in a setting where $k$ players collaborate in order to identify an $\epsilon$-optimal arm. Our motivation comes from recent employment of bandit algorithms in computationally intensive,…

机器学习 · 计算机科学 2013-11-05 Eshcar Hillel , Zohar Karnin , Tomer Koren , Ronny Lempel , Oren Somekh

We study online learning with bandit feedback across multiple tasks, with the goal of improving average performance across tasks if they are similar according to some natural task-similarity measure. As the first to target the adversarial…

机器学习 · 计算机科学 2022-05-30 Maria-Florina Balcan , Keegan Harris , Mikhail Khodak , Zhiwei Steven Wu

In this work, we study sequential choice bandits with feedback. We propose bandit algorithms for a platform that personalizes users' experience to maximize its rewards. For each action directed to a given user, the platform is given a…

机器学习 · 统计学 2021-01-06 Anshuka Rangi , Massimo Franceschetti , Long Tran-Thanh

A contextual bandit problem is studied in a highly non-stationary environment, which is ubiquitous in various recommender systems due to the time-varying interests of users. Two models with disjoint and hybrid payoffs are considered to…

机器学习 · 计算机科学 2020-03-03 Xiao Xu , Fang Dong , Yanghua Li , Shaojian He , Xin Li

The multi-armed bandit (MAB) models have attracted significant research attention due to their applicability and effectiveness in various real-world scenarios such as resource allocation, online advertising, and dynamic pricing. As an…

机器学习 · 计算机科学 2024-02-13 Yandi Li , Jianxiong Guo , Yupeng Li , Tian Wang , Weijia Jia

This paper studies the adversarial graphical contextual bandits, a variant of adversarial multi-armed bandits that leverage two categories of the most common side information: \emph{contexts} and \emph{side observations}. In this setting, a…

机器学习 · 计算机科学 2021-02-18 Lingda Wang , Bingcong Li , Huozhi Zhou , Georgios B. Giannakis , Lav R. Varshney , Zhizhen Zhao

We consider regret minimization in a general collaborative multi-agent multi-armed bandit model, in which each agent faces a finite set of arms and may communicate with other agents through a central controller. The optimal arm for each…

机器学习 · 计算机科学 2023-12-18 Amitis Shidani , Sattar Vakili

We consider the problem of multiple users targeting the arms of a single multi-armed stochastic bandit. The motivation for this problem comes from cognitive radio networks, where selfish users need to coexist without any side communication…

机器学习 · 计算机科学 2014-04-23 Orly Avner , Shie Mannor

We address the problem of learning in an online, bandit setting where the learner must repeatedly select among $K$ actions, but only receives partial feedback based on its choices. We establish two new facts: First, using a new algorithm…

机器学习 · 计算机科学 2011-10-28 Alina Beygelzimer , John Langford , Lihong Li , Lev Reyzin , Robert E. Schapire

We study a decentralized cooperative stochastic multi-armed bandit problem with $K$ arms on a network of $N$ agents. In our model, the reward distribution of each arm is the same for each agent and rewards are drawn independently across…

机器学习 · 计算机科学 2019-10-25 David Martínez-Rubio , Varun Kanade , Patrick Rebeschini

Contextual bandits are a form of multi-armed bandit in which the agent has access to predictive side information (known as the context) for each arm at each time step, and have been used to model personalized news recommendation, ad…

机器学习 · 统计学 2017-05-25 Aniket Anand Deshmukh , Urun Dogan , Clayton Scott

We investigate top-$m$ arm identification, a basic problem in bandit theory, in a multi-agent learning model in which agents collaborate to learn an objective function. We are interested in designing collaborative learning algorithms that…

机器学习 · 计算机科学 2022-11-29 Nikolai Karpov , Qin Zhang

We propose a new best-of-both-worlds algorithm for bandits with variably delayed feedback. In contrast to prior work, which required prior knowledge of the maximal delay $d_{\mathrm{max}}$ and had a linear dependence of the regret on it,…

机器学习 · 计算机科学 2024-05-29 Saeed Masoudian , Julian Zimmert , Yevgeny Seldin

Contextual bandit algorithms are at the core of many applications, including recommender systems, clinical trials, and optimal portfolio selection. One of the most popular problems studied in the contextual bandit literature is to maximize…

机器学习 · 计算机科学 2023-10-24 Siddhant Chaudhary , Abhishek Sinha

Existing risk-aware multi-armed bandit models typically focus on risk measures of individual options such as variance. As a result, they cannot be directly applied to important real-world online decision making problems with correlated…

机器学习 · 计算机科学 2023-05-12 Yihan Du , Siwei Wang , Zhixuan Fang , Longbo Huang