中文
相关论文

相关论文: A General Framework for Clustering and Distributio…

200 篇论文

Combinatorial Multi-Armed Bandit with fairness constraints is a framework where multiple arms form a super arm and can be pulled in each round under uncertainty to maximize cumulative rewards while ensuring the minimum average reward…

机器学习 · 计算机科学 2025-01-14 Xiaoyi Wu , Bo Ji , Bin Li

This paper studies the problem of adaptively sampling from K distributions (arms) in order to identify the largest gap between any two adjacent means. We call this the MaxGap-bandit problem. This problem arises naturally in approximate…

机器学习 · 统计学 2019-06-04 Sumeet Katariya , Ardhendu Tripathy , Robert Nowak

We study the best-arm identification problem in multi-armed bandits with stochastic, potentially private rewards, when the goal is to identify the arm with the highest quantile at a fixed, prescribed level. First, we propose a (non-private)…

We consider the problem of model selection for two popular stochastic linear bandit settings, and propose algorithms that adapts to the unknown problem complexity. In the first setting, we consider the $K$ armed mixture bandits, where the…

机器学习 · 统计学 2020-06-17 Avishek Ghosh , Abishek Sankararaman , Kannan Ramchandran

We consider the problem of near-optimal arm identification in the fixed confidence setting of the infinitely armed bandit problem when nothing is known about the arm reservoir distribution. We (1) introduce a PAC-like framework within which…

机器学习 · 统计学 2018-05-22 Maryam Aziz , Jesse Anderton , Emilie Kaufmann , Javed Aslam

Motivated by distributed selection problems, we formulate a new variant of multi-player multi-armed bandit (MAB) model, which captures stochastic arrival of requests to each arm, as well as the policy of allocating requests to players. The…

人工智能 · 计算机科学 2024-08-21 Hong Xie , Jinyu Mo , Defu Lian , Jie Wang , Enhong Chen

In this paper we consider the contextual multi-armed bandit problem for linear payoffs under a risk-averse criterion. At each round, contexts are revealed for each arm, and the decision maker chooses one arm to pull and receives the…

机器学习 · 计算机科学 2022-06-28 Yifan Lin , Yuhao Wang , Enlu Zhou

The cross-learning contextual bandit problem with graphical feedback has recently attracted significant attention. In this setting, there is a contextual bandit with a feedback graph over the arms, and pulling an arm reveals the loss for…

机器学习 · 计算机科学 2025-02-10 Ruiyuan Huang , Zengfeng Huang

In bandit best-arm identification, an algorithm is tasked with finding the arm with highest mean reward with a specified accuracy as fast as possible. We study multi-fidelity best-arm identification, in which the algorithm can choose to…

机器学习 · 计算机科学 2025-05-27 Riccardo Poiani , Rémy Degenne , Emilie Kaufmann , Alberto Maria Metelli , Marcello Restelli

We study a variant of the classical multi-armed bandit problem (MABP) which we call as Multi-Armed Bandits with dependent arms. More specifically, multiple arms are grouped together to form a cluster, and the reward distributions of arms…

机器学习 · 计算机科学 2020-10-27 Rahul Singh , Fang Liu , Yin Sun , Ness Shroff

We study exploration in Multi-Armed Bandits in a setting where $k$ players collaborate in order to identify an $\epsilon$-optimal arm. Our motivation comes from recent employment of bandit algorithms in computationally intensive,…

机器学习 · 计算机科学 2013-11-05 Eshcar Hillel , Zohar Karnin , Tomer Koren , Ronny Lempel , Oren Somekh

We study the problem of identifying the best arm in a stochastic multi-armed bandit game. Given a set of $n$ arms indexed from $1$ to $n$, each arm $i$ is associated with an unknown reward distribution supported on $[0,1]$ with mean…

机器学习 · 计算机科学 2023-05-30 Pinyan Lu , Chao Tao , Xiaojin Zhang

We consider a budget-constrained bandit problem where each arm pull incurs a random cost, and yields a random reward in return. The objective is to maximize the total expected reward under a budget constraint on the total cost. The model is…

机器学习 · 计算机科学 2020-03-03 Semih Cayci , Atilla Eryilmaz , R. Srikant

The improving multi-armed bandits problem is a formal model for allocating effort under uncertainty, motivated by scenarios such as investing research effort into new technologies, performing clinical trials, and hyperparameter selection…

机器学习 · 计算机科学 2026-05-22 Avrim Blum , Marten Garicano , Kavya Ravichandran , Dravyansh Sharma

Given a finite set of unknown distributions or arms that can be sampled, we consider the problem of identifying the one with the maximum mean using a $\delta$-correct algorithm (an adaptive, sequential algorithm that restricts the…

机器学习 · 计算机科学 2023-11-27 Shubhada Agrawal , Sandeep Juneja , Peter Glynn

Sequential decision-making under uncertainty often involves multiple agents learning which actions (arms) yield the highest rewards through repeated interaction with a stochastic environment. This setting is commonly modeled by cooperative…

系统与控制 · 电气工程与系统科学 2026-03-25 Evagoras Makridis , Themistoklis Charalambous

In this paper, we study the stochastic combinatorial multi-armed bandit (CMAB) framework that allows a general nonlinear reward function, whose expected value may not depend only on the means of the input random variables but possibly on…

机器学习 · 计算机科学 2018-07-23 Wei Chen , Wei Hu , Fu Li , Jian Li , Yu Liu , Pinyan Lu

In this paper, we study censored Semi-Bandits, a novel variant of the semi-bandits problem. The learner is assumed to have a fixed amount of resources, which it allocates to the arms at each time step. The loss observed from an arm is…

机器学习 · 计算机科学 2020-03-26 Arun Verma , Manjesh K. Hanawal , Arun Rajkumar , Raman Sankaran

We consider a multi-armed bandit framework where the rewards obtained by pulling different arms are correlated. We develop a unified approach to leverage these reward correlations and present fundamental generalizations of classic bandit…

机器学习 · 统计学 2021-09-13 Samarth Gupta , Shreyas Chaudhari , Gauri Joshi , Osman Yağan

In many real-world applications, multiple agents seek to learn how to perform highly related yet slightly different tasks in an online bandit learning protocol. We formulate this problem as the $\epsilon$-multi-player multi-armed bandit…

机器学习 · 计算机科学 2021-07-21 Zhi Wang , Chicheng Zhang , Manish Kumar Singh , Laurel D. Riek , Kamalika Chaudhuri