中文
相关论文

相关论文: Pure exploration in multi-armed bandits with low r…

200 篇论文

We study pure exploration in bandits, where the dimension of the feature representation can be much larger than the number of arms. To overcome the curse of dimensionality, we propose to adaptively embed the feature representation of each…

机器学习 · 统计学 2022-03-18 Yinglun Zhu , Dongruo Zhou , Ruoxi Jiang , Quanquan Gu , Rebecca Willett , Robert Nowak

In a fixed-confidence pure exploration problem in stochastic multi-armed bandits, an algorithm iteratively samples arms and should stop as early as possible and return the correct answer to a query about the arms distributions. We are…

机器学习 · 计算机科学 2025-02-04 Adrienne Tuynman , Rémy Degenne

We determine the sample complexity of pure exploration bandit problems with multiple good answers. We derive a lower bound using a new game equilibrium argument. We show how continuity and convexity properties of single-answer problems…

机器学习 · 计算机科学 2019-02-12 Rémy Degenne , Wouter M. Koolen

This paper introduces the framework of multi-armed sampling, which serves as the sampling counterpart to the optimization problem of multi-armed bandits. Our primary motivation is to rigorously examine the exploration-exploitation trade-off…

机器学习 · 计算机科学 2026-05-14 Mohammad Pedramfar , Siamak Ravanbakhsh

This work addresses the problem of regret minimization in non-stochastic multi-armed bandit problems, focusing on performance guarantees that hold with high probability. Such results are rather scarce in the literature since proving them…

机器学习 · 计算机科学 2015-11-04 Gergely Neu

We propose the first fully-adaptive algorithm for pure exploration in linear bandits---the task to find the arm with the largest expected reward, which depends on an unknown parameter linearly. While existing methods partially or entirely…

机器学习 · 统计学 2017-10-17 Liyuan Xu , Junya Honda , Masashi Sugiyama

We consider a constrained, pure exploration, stochastic multi-armed bandit formulation under a fixed budget. Each arm is associated with an unknown, possibly multi-dimensional distribution and is described by multiple attributes that are a…

机器学习 · 计算机科学 2022-11-29 Fathima Zarin Faizal , Jayakrishnan Nair

Pure exploration in multi-armed bandits has emerged as an important framework for modeling decision-making and search under uncertainty. In modern applications, however, one is often faced with a tremendously large number of options. Even…

机器学习 · 计算机科学 2022-11-22 Parth K. Thaker , Mohit Malu , Nikhil Rao , Gautam Dasarathy

This paper introduces a general multi-agent bandit model in which each agent is facing a finite set of arms and may communicate with other agents through a central controller in order to identify, in pure exploration, or play, in regret…

机器学习 · 计算机科学 2022-10-31 Clémence Réda , Sattar Vakili , Emilie Kaufmann

Pure exploration in bandits formalises multiple real-world problems, such as tuning hyper-parameters or conducting user studies to test a set of items, where different safety, resource, and fairness constraints on the decision space…

机器学习 · 计算机科学 2026-02-05 Udvas Das , Debabrota Basu

Pure exploration is one of the fundamental problems in multi-armed bandits (MAB). However, existing works mostly focus on specific pure exploration tasks, without a holistic view of the general pure exploration problem. This work fills this…

机器学习 · 统计学 2025-03-12 Di Wu , Chengshuai Shi , Ruida Zhou , Cong Shen

Multi-armed Bandit motivates methods with provable upper bounds on regret and also the counterpart lower bounds have been extensively studied in this context. Recently, Multi-agent Multi-armed Bandit has gained significant traction in…

机器学习 · 计算机科学 2023-08-17 Mengfan Xu , Diego Klabjan

We examine a multi-armed bandit problem with contextual information, where the objective is to ensure that each arm receives a minimum aggregated reward across contexts while simultaneously maximizing the total cumulative reward. This…

机器学习 · 计算机科学 2025-10-15 Ahmed Ben Yahmed , Hafedh El Ferchichi , Marc Abeille , Vianney Perchet

We consider the classical multi-armed bandit problem, but with strategic arms. In this context, each arm is characterized by a bounded support reward distribution and strategically aims to maximize its own utility by potentially retaining a…

机器学习 · 计算机科学 2025-01-28 Ahmed Ben Yahmed , Clément Calauzènes , Vianney Perchet

This paper introduces and addresses a wide class of stochastic bandit problems where the function mapping the arm to the corresponding reward exhibits some known structural properties. Most existing structures (e.g. linear, Lipschitz,…

机器学习 · 统计学 2017-11-02 Richard Combes , Stefan Magureanu , Alexandre Proutiere

We study the stochastic multi-armed bandit problem with non-equivalent multiple plays where, at each step, an agent chooses not only a set of arms, but also their order, which influences reward distribution. In several problem formulations…

机器学习 · 计算机科学 2015-07-20 Aleksandr Vorobev , Gleb Gusev

The multi-armed bandit(MAB) is a classical sequential decision problem. Most work requires assumptions about the reward distribution (e.g., bounded), while practitioners may have difficulty obtaining information about these distributions to…

机器学习 · 计算机科学 2023-12-14 Han Qi , Fei Guo , Li Zhu

Combinatorial bandits with semi-bandit feedback generalize multi-armed bandits, where the agent chooses sets of arms and observes a noisy reward for each arm contained in the chosen set. The action set satisfies a given structure such as…

机器学习 · 统计学 2021-01-22 Marc Jourdan , Mojmír Mutný , Johannes Kirschner , Andreas Krause

We study the pure exploration problem subject to a matroid constraint (Best-Basis) in a stochastic multi-armed bandit game. In a Best-Basis instance, we are given $n$ stochastic arms with unknown reward distributions, as well as a matroid…

机器学习 · 计算机科学 2016-05-26 Lijie Chen , Anupam Gupta , Jian Li

We consider the framework of stochastic multi-armed bandit problems and study the possibilities and limitations of forecasters that perform an on-line exploration of the arms. These forecasters are assessed in terms of their simple regret,…

统计理论 · 数学 2010-07-26 Sébastien Bubeck , Rémi Munos , Gilles Stoltz
‹ 上一页 1 2 3 10 下一页 ›