中文
相关论文

相关论文: An Optimal Elimination Algorithm for Learning a Be…

200 篇论文

We study the problem of the identification of m arms with largest means under a fixed error rate $\delta$ (fixed-confidence Top-m identification), for misspecified linear bandit models. This problem is motivated by practical applications,…

人工智能 · 计算机科学 2021-11-03 Clémence Réda , Andrea Tirinzoni , Rémy Degenne

This paper considers the optimal adaptive allocation of measurement effort for identifying the best among a finite set of options or designs. An experimenter sequentially chooses designs to measure and observes noisy signals of their…

机器学习 · 计算机科学 2018-06-11 Daniel Russo

We consider the problem of PAC learning the most valuable item from a pool of $n$ items using sequential, adaptively chosen plays of subsets of $k$ items, when, upon playing a subset, the learner receives relative feedback sampled according…

机器学习 · 计算机科学 2020-02-20 Aadirupa Saha , Aditya Gopalan

In multi-armed bandit problems, the typical goal is to identify the arm with the highest reward. This paper explores a threshold-based bandit problem, aiming to select an arm based on its relation to a prescribed threshold \(\tau \). We…

机器学习 · 计算机科学 2025-09-03 Chanakya Varude , Jay Chaudhary , Siddharth Kaushik , Prasanna Chaporkar

Motivated by an open direction in existing literature, we study the 1-identification problem, a fundamental multi-armed bandit formulation on pure exploration. The goal is to determine whether there exists an arm whose mean reward is at…

机器学习 · 计算机科学 2025-08-21 Zitian Li , Wang Chi Cheung

We consider the Multi-Armed Bandit (MAB) problem, where an agent sequentially chooses actions and observes rewards for the actions it took. While the majority of algorithms try to minimize the regret, i.e., the cumulative difference between…

机器学习 · 计算机科学 2021-09-14 Nadav Merlis , Shie Mannor

Motivated by recursive learning in Markov Decision Processes, this paper studies best-arm identification in bandit problems where each arm's reward is drawn from a multinomial distribution with a known support. We compare the performance {…

机器学习 · 计算机科学 2025-02-19 Mehrasa Ahmadipour , élise Crepon , Aurélien Garivier

We generalize the PAC (probably approximately correct) learning model to the quantum world by generalizing the concepts from classical functions to quantum processes, defining the problem of \emph{PAC learning quantum process}, and study…

量子物理 · 物理学 2021-05-20 Kai-Min Chung , Han-Hsuan Lin

While the objective in traditional multi-armed bandit problems is to find the arm with the highest mean, in many settings, finding an arm that best captures information about other arms is of interest. This objective, however, requires…

机器学习 · 计算机科学 2019-06-27 Vinay Praneeth Boda , Prashanth L. A

We consider a stochastic bandit problem with infinitely many arms. In this setting, the learner has no chance of trying all the arms even once and has to dedicate its limited number of samples only to a certain number of arms. All previous…

机器学习 · 计算机科学 2015-05-19 Alexandra Carpentier , Michal Valko

In probably approximately correct (PAC) reinforcement learning (RL), an agent is required to identify an $\epsilon$-optimal policy with probability $1-\delta$. While minimax optimal algorithms exist for this problem, its instance-dependent…

机器学习 · 计算机科学 2022-10-25 Andrea Tirinzoni , Aymen Al-Marjani , Emilie Kaufmann

We consider a bandit problem where the buget is smaller than the number of arms, which may be infinite. In this regime, the usual objective in the literature is to minimize simple regret. To analyze broad classes of distributions with…

统计理论 · 数学 2025-11-04 Emmanuel Pilliat

We propose a {\em novel} piecewise stationary linear bandit (PSLB) model, where the environment randomly samples a context from an unknown probability distribution at each changepoint, and the quality of an arm is measured by its return…

机器学习 · 计算机科学 2024-10-11 Yunlong Hou , Vincent Y. F. Tan , Zixin Zhong

We study the problem of PAC learning $\gamma$-margin halfspaces in the presence of Massart noise. Without computational considerations, the sample complexity of this learning problem is known to be $\widetilde{\Theta}(1/(\gamma^2…

机器学习 · 计算机科学 2025-01-17 Ilias Diakonikolas , Nikos Zarifis

In fixed-confidence best arm identification (BAI), the objective is to quickly identify the optimal option while controlling the probability of error below a desired threshold. Despite the plethora of BAI algorithms, existing methods…

机器学习 · 计算机科学 2026-01-05 Brian M. Cho , Nathan Kallus

We consider the problem of probably approximately correct (PAC) ranking $n$ items by adaptively eliciting subset-wise preference feedback. At each round, the learner chooses a subset of $k$ items and observes stochastic feedback indicating…

机器学习 · 计算机科学 2019-03-06 Aadirupa Saha , Aditya Gopalan

We study a sequential resource allocation problem between a fixed number of arms. On each iteration the algorithm distributes a resource among the arms in order to maximize the expected success rate. Allocating more of the resource to a…

机器学习 · 计算机科学 2018-03-29 Yuval Dagan , Koby Crammer

A fundamental problem in adversarial machine learning is to quantify how much training data is needed in the presence of evasion attacks. In this paper we address this issue within the framework of PAC learning, focusing on the class of…

机器学习 · 计算机科学 2022-05-13 Pascale Gourdeau , Varun Kanade , Marta Kwiatkowska , James Worrell

Combinatorial Multi-Armed Bandit with fairness constraints is a framework where multiple arms form a super arm and can be pulled in each round under uncertainty to maximize cumulative rewards while ensuring the minimum average reward…

机器学习 · 计算机科学 2025-01-14 Xiaoyi Wu , Bo Ji , Bin Li

This study investigates the contextual best arm identification (BAI) problem, aiming to design an adaptive experiment to identify the best treatment arm conditioned on contextual information (covariates). We consider a decision-maker who…

机器学习 · 计算机科学 2025-06-23 Masahiro Kato , Kyohei Okumura , Takuya Ishihara , Toru Kitagawa