中文
相关论文

相关论文: Best Arm Identification in Generalized Linear Band…

200 篇论文

Combinatorial bandits extend the classical bandit framework to settings where the learner selects multiple arms in each round, motivated by applications such as online recommendation and assortment optimization. While extensions of upper…

机器学习 · 计算机科学 2025-10-29 Yuxiao Wen , Yanjun Han , Zhengyuan Zhou

We study a novel pure exploration problem: the $\epsilon$-Thresholding Bandit Problem (TBP) with fixed confidence in stochastic linear bandits. We prove a lower bound for the sample complexity and extend an algorithm designed for Best Arm…

机器学习 · 统计学 2024-02-16 Eduardo Ochoa Rivera , Ambuj Tewari

We study the best-arm identification problem with fixed confidence when contextual (covariate) information is available in stochastic bandits. Although we can use contextual information in each round, we are interested in the marginalized…

机器学习 · 计算机科学 2024-02-27 Masahiro Kato , Kaito Ariu

In multi-objective decision-making with hierarchical preferences, lexicographic bandits provide a natural framework for optimizing multiple objectives in a prioritized order. In this setting, a learner repeatedly selects arms and observes…

机器学习 · 计算机科学 2025-11-11 Bo Xue , Yuanyu Wan , Zhichao Lu , Qingfu Zhang

We study the ranking problem in generalized linear bandits. At each time, the learning agent selects an ordered list of items and observes stochastic outcomes. In recommendation systems, displaying an ordered list of the most attractive…

机器学习 · 统计学 2024-01-03 Amitis Shidani , George Deligiannidis , Arnaud Doucet

We consider the fixed-confidence best arm identification (FC-BAI) problem in the Bayesian setting. This problem aims to find the arm of the largest mean with a fixed confidence level when the bandit model has been sampled from the known…

机器学习 · 统计学 2024-06-25 Kyoungseok Jang , Junpei Komiyama , Kazutoshi Yamazaki

Best arm identification (BAI) aims to identify the highest-performance arm among a set of $K$ arms by collecting stochastic samples from each arm. In real-world problems, the best arm needs to satisfy additional feasibility constraints.…

机器学习 · 计算机科学 2026-01-26 Ting Cai , Kirthevasan Kandasamy

Best arm identification (or, pure exploration) in multi-armed bandits is a fundamental problem in machine learning. In this paper we study the distributed version of this problem where we have multiple agents, and they want to learn the…

机器学习 · 计算机科学 2019-09-02 Chao Tao , Qin Zhang , Yuan Zhou

We study best-arm identification in stochastic multi-armed bandits under the fixed-confidence setting, focusing on instances with multiple optimal arms. Unlike prior work that addresses the unknown-number-of-optimal-arms case, we consider…

机器学习 · 计算机科学 2026-03-05 Lan V. Truong

We study the problem of sequential learning of the Pareto front in multi-objective multi-armed bandits. An agent is faced with K possible arms to pull. At each turn she picks one, and receives a vector-valued reward. When she thinks she has…

机器学习 · 统计学 2025-01-30 Elise Crépon , Aurélien Garivier , Wouter M Koolen

In this paper, we study a variant of best-arm identification involving elements of risk sensitivity and communication constraints. Specifically, the goal of the learner is to identify the arm with the highest quantile reward, while the…

机器学习 · 统计学 2025-02-11 Ivan Lau , Jonathan Scarlett

In this paper, we consider a new Multi-Armed Bandit (MAB) problem where arms are nodes in an unknown and possibly changing graph, and the agent (i) initiates random walks over the graph by pulling arms, (ii) observes the random walk…

机器学习 · 计算机科学 2022-06-28 Tianyu Wang , Lin F. Yang , Zizhuo Wang

In this paper, we study the stochastic combinatorial multi-armed bandit problem under semi-bandit feedback. While much work has been done on algorithms that optimize the expected reward for linear as well as some general reward functions,…

机器学习 · 计算机科学 2021-12-03 Shaarad Ayyagari , Ambedkar Dukkipati

We consider the best arm identification problem, where the goal is to identify the arm with the highest mean reward from a set of $K$ arms under a limited sampling budget. This problem models many practical scenarios such as A/B testing. We…

机器学习 · 统计学 2026-05-05 Junpei Komiyama , Kyoungseok Jang , Junya Honda

Bandit algorithms have various application in safety-critical systems, where it is important to respect the system constraints that rely on the bandit's unknown parameters at every round. In this paper, we formulate a linear stochastic…

机器学习 · 计算机科学 2019-08-19 Sanae Amani , Mahnoosh Alizadeh , Christos Thrampoulidis

We study stochastic linear optimization problem with bandit feedback. The set of arms take values in an $N$-dimensional space and belong to a bounded polyhedron described by finitely many linear inequalities. We provide a lower bound for…

机器学习 · 计算机科学 2015-09-29 Manjesh K. Hanawal , Amir Leshem , Venkatesh Saligrama

We study the pure exploration problem subject to a matroid constraint (Best-Basis) in a stochastic multi-armed bandit game. In a Best-Basis instance, we are given $n$ stochastic arms with unknown reward distributions, as well as a matroid…

机器学习 · 计算机科学 2016-05-26 Lijie Chen , Anupam Gupta , Jian Li

In several applications such as clinical trials and financial portfolio optimization, the expected value (or the average reward) does not satisfactorily capture the merits of a drug or a portfolio. In such applications, risk plays a crucial…

机器学习 · 统计学 2022-05-13 Vincent Y. F. Tan , Prashanth L. A. , Krishna Jagannathan

Mode estimation is a classical problem in statistics with a wide range of applications in machine learning. Despite this, there is little understanding in its robustness properties under possibly adversarial data contamination. In this…

机器学习 · 计算机科学 2020-03-09 Aldo Pacchiano , Heinrich Jiang , Michael I. Jordan

Contextual dueling bandit is used to model the bandit problems, where a learner's goal is to find the best arm for a given context using observed noisy human preference feedback over the selected arms for the past contexts. However,…

机器学习 · 计算机科学 2025-04-17 Arun Verma , Zhongxiang Dai , Xiaoqiang Lin , Patrick Jaillet , Bryan Kian Hsiang Low