中文
相关论文

相关论文: On the complexity of All $\varepsilon$-Best Arms I…

200 篇论文

Motivated by the task of hyperparameter optimization, we introduce the non-stochastic best-arm identification problem. Within the multi-armed bandit literature, the cumulative regret objective enjoys algorithms and analyses for both the…

机器学习 · 计算机科学 2015-03-02 Kevin Jamieson , Ameet Talwalkar

We study the stochastic linear bandit problem with multiple arms over $T$ rounds, where the covariate dimension $d$ may exceed $T$, but each arm-specific parameter vector is $s$-sparse. We begin by analyzing the sequential estimation…

统计理论 · 数学 2025-05-26 Jingyu Liu , Yanglei Song

We consider the problem of identifying the best arm in stochastic Multi-Armed Bandits (MABs) using a fixed sampling budget. Characterizing the minimal instance-specific error probability for this problem constitutes one of the important…

机器学习 · 计算机科学 2024-02-21 Po-An Wang , Ruo-Chun Tzeng , Alexandre Proutiere

We study the problem of the identification of m arms with largest means under a fixed error rate $\delta$ (fixed-confidence Top-m identification), for misspecified linear bandit models. This problem is motivated by practical applications,…

人工智能 · 计算机科学 2021-11-03 Clémence Réda , Andrea Tirinzoni , Rémy Degenne

We consider minimisation of dynamic regret in non-stationary bandits with a slowly varying property. Namely, we assume that arms' rewards are stochastic and independent over time, but that the absolute difference between the expected…

机器学习 · 计算机科学 2021-10-26 Ramakrishnan Krishnamurthy , Aditya Gopalan

We study a regret minimization problem with the existence of multiple best/near-optimal arms in the multi-armed bandit setting. We consider the case when the number of arms/actions is comparable or much larger than the time horizon, and…

机器学习 · 统计学 2020-10-23 Yinglun Zhu , Robert Nowak

We consider the best-arm identification problem in multi-armed bandits, which focuses purely on exploration. A player is given a fixed budget to explore a finite set of arms, and the rewards of each arm are drawn independently from a fixed,…

机器学习 · 统计学 2017-08-02 Shahin Shahrampour , Mohammad Noshad , Vahid Tarokh

We propose a novel technique for analyzing adaptive sampling called the {\em Simulator}. Our approach differs from the existing methods by considering not how much information could be gathered by any fixed sampling strategy, but how…

机器学习 · 计算机科学 2023-04-25 Max Simchowitz , Kevin Jamieson , Benjamin Recht

We consider best arm identification in the multi-armed bandit problem. Assuming certain continuity conditions of the prior, we characterize the rate of the Bayesian simple regret. Differing from Bayesian regret minimization (Lai, 1987), the…

机器学习 · 计算机科学 2023-07-27 Junpei Komiyama , Kaito Ariu , Masahiro Kato , Chao Qin

We examine a multi-armed bandit problem with contextual information, where the objective is to ensure that each arm receives a minimum aggregated reward across contexts while simultaneously maximizing the total cumulative reward. This…

机器学习 · 计算机科学 2025-10-15 Ahmed Ben Yahmed , Hafedh El Ferchichi , Marc Abeille , Vianney Perchet

We study fixed-confidence best arm identification in generalized linear bandits under a hybrid feedback model: at each round, the learner may query either (i) absolute reward feedback from a single arm or (ii) relative (dueling) feedback…

人工智能 · 计算机科学 2026-05-08 Qirun Zeng , Xuchuang Wang , Jiayi Shen , Xutong Liu , Fang Kong , Jinhang Zuo

Recently multi-armed bandit problem arises in many real-life scenarios where arms must be sampled in batches, due to limited time the agent can wait for the feedback. Such applications include biological experimentation and online…

机器学习 · 统计学 2023-12-22 Shengyu Cao , Simai He , Ruoqing Jiang , Jin Xu , Hongsong Yuan

We consider the problem of \textit{best arm identification} with a \textit{fixed budget $T$}, in the $K$-armed stochastic bandit setting, with arms distribution defined on $[0,1]$. We prove that any bandit strategy, for at least one bandit…

机器学习 · 统计学 2016-05-31 Alexandra Carpentier , Andrea Locatelli

In multi-armed bandits, the tasks of reward maximization and pure exploration are often at odds with each other. The former focuses on exploiting arms with the highest means, while the latter may require constant exploration across all…

机器学习 · 计算机科学 2024-10-22 Brian Cho , Dominik Meier , Kyra Gan , Nathan Kallus

We study the robust best-arm identification problem (RBAI) in the case of linear rewards. The primary objective is to identify a near-optimal robust arm, which involves selecting arms at every round and assessing their robustness by…

机器学习 · 计算机科学 2023-11-09 Wei Wang , Sattar Vakili , Ilija Bogunovic

In this paper we consider the problem of best-arm identification in multi-armed bandits in the fixed confidence setting, where the goal is to identify, with probability $1-\delta$ for some $\delta>0$, the arm with the highest mean reward in…

机器学习 · 统计学 2021-09-13 Samarth Gupta , Gauri Joshi , Osman Yağan

In this paper we revisit the fixed-confidence identification of the Pareto optimal set in a multi-objective multi-armed bandit model. As the sample complexity to identify the exact Pareto set can be very large, a relaxation allowing to…

机器学习 · 统计学 2023-11-06 Cyrille Kone , Emilie Kaufmann , Laura Richert

The 1-identification problem is a fundamental pure-exploration problem in multi-armed bandits. An agent aims to determine whether there exists an arm whose mean reward exceeds a known threshold $\mu_0$, or to output \textsf{None} otherwise.…

机器学习 · 计算机科学 2026-05-15 Zitian Li , Wang Chi Cheung

The stochastic multi-arm bandit problem has been extensively studied under standard assumptions on the arm's distribution (e.g bounded with known support, exponential family, etc). These assumptions are suitable for many real-world problems…

机器学习 · 统计学 2021-11-19 Dorian Baudry , Patrick Saux , Odalric-Ambrym Maillard

We consider the problem of finding, through adaptive sampling, which of $n$ options (arms) has the largest mean. Our objective is to determine a rule which identifies the best arm with a fixed minimum confidence using as few observations as…

机器学习 · 计算机科学 2022-03-17 MohammadJavad Azizi , Sheldon M Ross , Zhengyu Zhang