English
Related papers

Related papers: Optimal Multi-Objective Best Arm Identification wi…

200 papers

We consider the fixed-confidence best arm identification (FC-BAI) problem in the Bayesian setting. This problem aims to find the arm of the largest mean with a fixed confidence level when the bandit model has been sampled from the known…

Machine Learning · Statistics 2024-06-25 Kyoungseok Jang , Junpei Komiyama , Kazutoshi Yamazaki

We study stochastic linear optimization problem with bandit feedback. The set of arms take values in an $N$-dimensional space and belong to a bounded polyhedron described by finitely many linear inequalities. We provide a lower bound for…

Machine Learning · Computer Science 2015-09-29 Manjesh K. Hanawal , Amir Leshem , Venkatesh Saligrama

We study the problem of the identification of m arms with largest means under a fixed error rate $\delta$ (fixed-confidence Top-m identification), for misspecified linear bandit models. This problem is motivated by practical applications,…

Artificial Intelligence · Computer Science 2021-11-03 Clémence Réda , Andrea Tirinzoni , Rémy Degenne

We study fixed budget constrained best-arm identification in grouped bandits, where each arm consists of multiple independent attributes with stochastic rewards. An arm is considered feasible only if all its attributes' means are above a…

Machine Learning · Computer Science 2026-03-05 Raunak Mukherjee , Sharayu Moharir

We study a generalization of the multi-armed bandit problem with multiple plays where there is a cost associated with pulling each arm and the agent has a budget at each time that dictates how much she can expect to spend. We derive an…

Machine Learning · Statistics 2019-09-13 Alexander Luedtke , Emilie Kaufmann , Antoine Chambaz

Combinatorial bandits extend the classical bandit framework to settings where the learner selects multiple arms in each round, motivated by applications such as online recommendation and assortment optimization. While extensions of upper…

Machine Learning · Computer Science 2025-10-29 Yuxiao Wen , Yanjun Han , Zhengyuan Zhou

We investigate the problem of batched best arm identification in multi-armed bandits, where we aim to identify the best arm from a set of $n$ arms while minimizing both the number of samples and batches. We introduce an algorithm that…

Machine Learning · Computer Science 2025-01-30 Tianyuan Jin , Qin Zhang , Dongruo Zhou

Sequential decision making under uncertainty is studied in a mixed observability domain. The goal is to maximize the amount of information obtained on a partially observable stochastic process under constraints imposed by a fully observable…

Artificial Intelligence · Computer Science 2016-03-16 Mikko Lauri , Risto Ritala

This study investigates minimax and Bayes optimal strategies for fixed-budget best-arm identification. We consider an adaptive procedure consisting of a sampling phase followed by a recommendation phase, and we design an adaptive experiment…

Econometrics · Economics 2026-02-05 Masahiro Kato

This paper introduces a general multi-agent bandit model in which each agent is facing a finite set of arms and may communicate with other agents through a central controller in order to identify, in pure exploration, or play, in regret…

Machine Learning · Computer Science 2022-10-31 Clémence Réda , Sattar Vakili , Emilie Kaufmann

We study the Stochastic Multi-armed Bandit problem under bounded arm-memory. In this setting, the arms arrive in a stream, and the number of arms that can be stored in the memory at any time, is bounded. The decision-maker can only pull…

Machine Learning · Computer Science 2020-12-10 Arnab Maiti , Vishakha Patil , Arindam Khan

We consider the combinatorial bandits problem with semi-bandit feedback under finite sampling budget constraints, in which the learner can carry out its action only for a limited number of times specified by an overall budget. The action is…

Machine Learning · Computer Science 2022-10-17 Jasmin Brandt , Viktor Bengs , Björn Haddenhorst , Eyke Hüllermeier

In this paper, we propose a new multi-objective contextual multi-armed bandit (MAB) problem with two objectives, where one of the objectives dominates the other objective. Unlike single-objective MAB problems in which the learner obtains a…

Machine Learning · Computer Science 2018-06-04 Cem Tekin , Eralp Turgay

We study the pure exploration problem subject to a matroid constraint (Best-Basis) in a stochastic multi-armed bandit game. In a Best-Basis instance, we are given $n$ stochastic arms with unknown reward distributions, as well as a matroid…

Machine Learning · Computer Science 2016-05-26 Lijie Chen , Anupam Gupta , Jian Li

In this paper, we introduce the constrained best mixed arm identification (CBMAI) problem with a fixed budget. This is a pure exploration problem in a stochastic finite armed bandit model. Each arm is associated with a reward and multiple…

Machine Learning · Computer Science 2024-05-27 Dengwang Tang , Rahul Jain , Ashutosh Nayyar , Pierluigi Nuzzo

This paper considers the problem of combinatorial multi-armed bandits with semi-bandit feedback and a cardinality constraint on the super-arm size. Existing algorithms for solving this problem typically involve two key sub-routines: (1) a…

Machine Learning · Computer Science 2025-08-14 Arpan Mukherjee , Shashanka Ubaru , Keerthiram Murugesan , Karthikeyan Shanmugam , Ali Tajer

Motivated by models of human decision making proposed to explain commonly observed deviations from conventional expected value preferences, we formulate two stochastic multi-armed bandit problems with distorted probabilities on the reward…

Machine Learning · Computer Science 2023-11-01 Ravi Kumar Kolla , Prashanth L. A. , Aditya Gopalan , Krishna Jagannathan , Michael Fu , Steve Marcus

This paper studies a multi-armed bandit (MAB) version of the range-searching problem. In its basic form, range searching considers as input a set of points (on the real line) and a collection of (real) intervals. Here, with each specified…

Machine Learning · Computer Science 2021-05-05 Siddharth Barman , Ramakrishnan Krishnamurthy , Saladi Rahul

In multi-armed bandits, the most-explored arms are the most informative, while reward maximization typically pulls only the best arm. We study the tradeoff between identifying arm means accurately and accumulating reward, and present an…

Machine Learning · Computer Science 2026-05-04 Akram Erraqabi , Alessandro Lazaric , Michal Valko , Emma Brunskill , Yun-En Liu

Multi-objective bandits have attracted increasing attention for their broad applicability, with \(d\)-dimensional reward vectors inducing Pareto regret. There has been a subtle debate over whether this added structure makes the problem…

Machine Learning · Computer Science 2026-05-08 Changkun Guan , Mengfan Xu
‹ Prev 1 4 5 6 7 8 10 Next ›