中文
相关论文

相关论文: On the Finite-Time Performance of the Knowledge Gr…

200 篇论文

We consider a variant of the best arm identification task in stochastic multi-armed bandits. Motivated by risk-averse decision-making problems, our goal is to identify a set of $m$ arms with the highest $\tau$-quantile values within a fixed…

机器学习 · 计算机科学 2023-02-22 Mengyan Zhang , Cheng Soon Ong

We study the problem of best-arm identification with fixed confidence in stochastic linear bandits. The objective is to identify the best arm with a given level of certainty while minimizing the sampling budget. We devise a simple algorithm…

机器学习 · 统计学 2020-06-30 Yassir Jedra , Alexandre Proutiere

We consider optimal sequential allocation in the context of the so-called stochastic multi-armed bandit model. We describe a generic index policy, in the sense of Gittins [J. R. Stat. Soc. Ser. B Stat. Methodol. 41 (1979) 148-177], based on…

We propose and study the known-compensation multi-arm bandit (KCMAB) problem, where a system controller offers a set of arms to many short-term players for $T$ steps. In each step, one short-term player arrives to the system. Upon arrival,…

机器学习 · 计算机科学 2018-11-06 Siwei Wang , Longbo Huang

This paper studies two variants of the best arm identification (BAI) problem under the streaming model, where we have a stream of $n$ arms with reward distributions supported on $[0,1]$ with unknown means. The arms in the stream are…

机器学习 · 计算机科学 2024-10-24 Tianyuan Jin , Keke Huang , Jing Tang , Xiaokui Xiao

We investigate the problem of batched best arm identification in multi-armed bandits, where we aim to identify the best arm from a set of $n$ arms while minimizing both the number of samples and batches. We introduce an algorithm that…

机器学习 · 计算机科学 2025-01-30 Tianyuan Jin , Qin Zhang , Dongruo Zhou

We study the non-stationary stochastic multi-armed bandit problem, where the reward statistics of each arm may change several times during the course of learning. The performance of a learning algorithm is evaluated in terms of their…

机器学习 · 计算机科学 2022-03-09 Yasin Abbasi-Yadkori , Andras Gyorgy , Nevena Lazic

We present a provably optimal differentially private algorithm for the stochastic multi-arm bandit problem, as opposed to the private analogue of the UCB-algorithm [Mishra and Thakurta, 2015; Tossou and Dimitrakakis, 2016] which doesn't…

机器学习 · 统计学 2019-05-24 Touqir Sajed , Or Sheffet

We examine a multi-armed bandit problem with contextual information, where the objective is to ensure that each arm receives a minimum aggregated reward across contexts while simultaneously maximizing the total cumulative reward. This…

机器学习 · 计算机科学 2025-10-15 Ahmed Ben Yahmed , Hafedh El Ferchichi , Marc Abeille , Vianney Perchet

We present a new algorithm based on an gradient ascent for a general Active Exploration bandit problem in the fixed confidence setting. This problem encompasses several well studied problems such that the Best Arm Identification or…

机器学习 · 统计学 2019-05-21 Pierre Ménard

We consider the correlated multiarmed bandit (MAB) problem in which the rewards associated with each arm are modeled by a multivariate Gaussian random variable, and we investigate the influence of the assumptions in the Bayesian prior on…

最优化与控制 · 数学 2015-07-09 Vaibhav Srivastava , Paul Reverdy , Naomi Ehrich Leonard

A standard assumption adopted in the multi-armed bandit (MAB) framework is that the mean rewards are constant over time. This assumption can be restrictive in the business world as decision-makers often face an evolving environment where…

机器学习 · 计算机科学 2021-08-24 Ningyuan Chen , Chun Wang , Longlin Wang

We propose a new strategy for best-arm identification with fixed confidence of Gaussian variables with bounded means and unit variance. This strategy, called Exploration-Biased Sampling, is not only asymptotically optimal: it is to the best…

统计理论 · 数学 2022-03-08 Antoine Barrier , Aurélien Garivier , Tomáš Kocák

This study investigates the experimental design problem for identifying the arm with the highest expected outcome, referred to as best arm identification (BAI). In our experiments, the number of treatment-allocation rounds is fixed. During…

统计理论 · 数学 2024-03-12 Masahiro Kato

We present differentially private algorithms for the stochastic Multi-Armed Bandit (MAB) problem. This is a problem for applications such as adaptive clinical trials, experiment design, and user-targeted advertising where private…

机器学习 · 统计学 2015-11-30 Aristide Tossou , Christos Dimitrakakis

We study the problem of selecting $K$ arms with the highest expected rewards in a stochastic $n$-armed bandit game. This problem has a wide range of applications, e.g., A/B testing, crowdsourcing, simulation optimization. Our goal is to…

机器学习 · 计算机科学 2017-06-06 Jiecao Chen , Xi Chen , Qin Zhang , Yuan Zhou

We study the best-arm identification problem in linear bandit, where the rewards of the arms depend linearly on an unknown parameter $\theta^*$ and the objective is to return the arm with the largest reward. We characterize the complexity…

机器学习 · 计算机科学 2014-11-05 Marta Soare , Alessandro Lazaric , Rémi Munos

We study a grouped bandit setting where each arm comprises multiple independent sub-arms referred to as attributes. Each attribute of each arm has an independent stochastic reward. We impose the constraint that for an arm to be deemed…

机器学习 · 计算机科学 2024-12-12 Sahil Dharod , Malyala Preethi Sravani , Sakshi Heda , Sharayu Moharir

We study the problem of identifying the best arm in a stochastic multi-armed bandit game. Given a set of $n$ arms indexed from $1$ to $n$, each arm $i$ is associated with an unknown reward distribution supported on $[0,1]$ with mean…

机器学习 · 计算机科学 2023-05-30 Pinyan Lu , Chao Tao , Xiaojin Zhang

We consider a stochastic multi-armed bandit problem with i.i.d. rewards where the expected reward function is multimodal with at most m modes. We propose the first known computationally tractable algorithm for computing the solution to the…

机器学习 · 统计学 2025-10-31 William Réveillard , Richard Combes