中文
相关论文

相关论文: Top-k Combinatorial Bandits with Full-Bandit Feedb…

200 篇论文

We consider a budgeted combinatorial multi-armed bandit setting where, in every round, the algorithm selects a super-arm consisting of one or more arms. The goal is to minimize the total expected regret after all rounds within a limited…

机器学习 · 计算机科学 2022-02-17 Debojit Das , Shweta Jain , Sujit Gujar

In this paper, we study a variant of best-arm identification involving elements of risk sensitivity and communication constraints. Specifically, the goal of the learner is to identify the arm with the highest quantile reward, while the…

机器学习 · 统计学 2025-02-11 Ivan Lau , Jonathan Scarlett

We consider regret minimization in a general collaborative multi-agent multi-armed bandit model, in which each agent faces a finite set of arms and may communicate with other agents through a central controller. The optimal arm for each…

机器学习 · 计算机科学 2023-12-18 Amitis Shidani , Sattar Vakili

In the classical multi-armed bandit problem, d arms are available to the decision maker who pulls them sequentially in order to maximize his cumulative reward. Guarantees can be obtained on a relative quantity called regret, which scales…

机器学习 · 计算机科学 2017-06-06 Joon Kwon , Vianney Perchet , Claire Vernade

We introduce the factored bandits model, which is a framework for learning with limited (bandit) feedback, where actions can be decomposed into a Cartesian product of atomic actions. Factored bandits incorporate rank-1 bandits as a special…

机器学习 · 计算机科学 2018-10-30 Julian Zimmert , Yevgeny Seldin

We study the problem of corralling stochastic bandit algorithms, that is combining multiple bandit algorithms designed for a stochastic environment, with the goal of devising a corralling algorithm that performs almost as well as the best…

机器学习 · 计算机科学 2021-03-02 Raman Arora , Teodor V. Marinov , Mehryar Mohri

We consider the problem of best arm identification in a variant of multi-armed bandits called linked bandits. In a single interaction with linked bandits, multiple arms are played sequentially until one of them receives a positive reward.…

机器学习 · 计算机科学 2019-01-29 Anant Gupta

We address multi-armed bandits (MAB) where the objective is to maximize the cumulative reward under a probabilistic linear constraint. For a few real-world instances of this problem, constrained extensions of the well-known Thompson…

机器学习 · 计算机科学 2020-05-14 Vidit Saxena , Joseph E. Gonzalez , Joakim Jaldén

We consider a budget-constrained bandit problem where each arm pull incurs a random cost, and yields a random reward in return. The objective is to maximize the total expected reward under a budget constraint on the total cost. The model is…

机器学习 · 计算机科学 2020-03-03 Semih Cayci , Atilla Eryilmaz , R. Srikant

In this paper, we study an interesting combination of sleeping and combinatorial stochastic bandits. In the mixed model studied here, at each discrete time instant, an arbitrary \emph{availability set} is generated from a fixed set of…

机器学习 · 计算机科学 2021-06-04 Kumar Abhishek , Ganesh Ghalme , Sujit Gujar , Yadati Narahari

In this paper, we consider stochastic multi-armed bandits (MABs) with heavy-tailed rewards, whose $p$-th moment is bounded by a constant $\nu_{p}$ for $1<p\leq2$. First, we propose a novel robust estimator which does not require $\nu_{p}$…

机器学习 · 计算机科学 2021-10-28 Kyungjae Lee , Hongjun Yang , Sungbin Lim , Songhwai Oh

We track moving targets with a distributed multiple-input multiple-output (MIMO) radar, for which the transmitters and receivers are appropriately paired and selected with a limited number of radar stations. We aim to maximize the sum of…

系统与控制 · 电气工程与系统科学 2023-06-19 Yuhang Hao , Zengfu Wang , Jing Fu , Xianglong Bai , Can Li , Quan Pan

We explore a novel setting of the Multi-Armed Bandit (MAB) problem inspired from real world applications which we call bandits with "stochastic delayed composite anonymous feedback (SDCAF)". In SDCAF, the rewards on pulling arms are…

机器学习 · 计算机科学 2019-10-14 Siddhant Garg , Aditya Kumar Akash

We consider the stochastic and adversarial settings of continuum armed bandits where the arms are indexed by [0,1]^d. The reward functions r:[0,1]^d -> R are assumed to intrinsically depend on at most k coordinate variables implying…

机器学习 · 计算机科学 2014-08-25 Hemant Tyagi , Bernd Gärtner

In this paper, we consider the stochastic multi-armed bandits problem with adversarial corruptions, where the random rewards of the arms are partially modified by an adversary to fool the algorithm. We apply the policy gradient algorithm…

机器学习 · 计算机科学 2025-02-21 Jiayuan Liu , Siwei Wang , Zhixuan Fang

We consider a bandit problem which involves sequential sampling from two populations (arms). Each arm produces a noisy reward realization which depends on an observable random covariate. The goal is to maximize cumulative expected reward.…

统计理论 · 数学 2010-03-09 Philippe Rigollet , Assaf Zeevi

In this paper, we consider the problem of multi-armed bandits with a large, possibly infinite number of correlated arms. We assume that the arms have Bernoulli distributed rewards, independent across time, where the probabilities of success…

机器学习 · 计算机科学 2011-11-21 Chong Jiang , R. Srikant

We consider a multi-armed bandit setting where, at the beginning of each round, the learner receives noisy independent, and possibly biased, \emph{evaluations} of the true reward of each arm and it selects $K$ arms with the objective of…

机器学习 · 计算机科学 2022-04-13 Evrard Garcelon , Vashist Avadhanula , Alessandro Lazaric , Matteo Pirotta

In this paper, we study the stochastic version of the one-sided full information bandit problem, where we have $K$ arms $[K] = \{1, 2, \ldots, K\}$, and playing arm $i$ would gain reward from an unknown distribution for arm $i$ while…

机器学习 · 计算机科学 2019-06-21 Haoyu Zhao , Wei Chen

We study the stochastic multi-armed bandit problem with the graph-based feedback structure introduced by Mannor and Shamir. We analyze the performance of the two most prominent stochastic bandit algorithms, Thompson Sampling and Upper…

机器学习 · 计算机科学 2020-02-17 Thodoris Lykouris , Eva Tardos , Drishti Wali