English
Related papers

Related papers: Near Optimal Pure Exploration in Logistic Bandits

200 papers

In a fixed-confidence pure exploration problem in stochastic multi-armed bandits, an algorithm iteratively samples arms and should stop as early as possible and return the correct answer to a query about the arms distributions. We are…

Machine Learning · Computer Science 2025-02-04 Adrienne Tuynman , Rémy Degenne

Pure exploration (aka active testing) is the fundamental task of sequentially gathering information to answer a query about a stochastic environment. Good algorithms make few mistakes and take few samples. Lower bounds (for multi-armed…

Machine Learning · Statistics 2019-06-26 Rémy Degenne , Wouter M. Koolen , Pierre Ménard

Given a set of arms $\mathcal{Z}\subset \mathbb{R}^d$ and an unknown parameter vector $\theta_\ast\in\mathbb{R}^d$, the pure exploration linear bandit problem aims to return $\arg\max_{z\in \mathcal{Z}} z^{\top}\theta_{\ast}$, with high…

Machine Learning · Statistics 2023-10-26 Zhaoqi Li , Kevin Jamieson , Lalit Jain

We consider the problem of near-optimal arm identification in the fixed confidence setting of the infinitely armed bandit problem when nothing is known about the arm reservoir distribution. We (1) introduce a PAC-like framework within which…

Machine Learning · Statistics 2018-05-22 Maryam Aziz , Jesse Anderton , Emilie Kaufmann , Javed Aslam

In this work, we develop linear bandit algorithms that automatically adapt to different environments. By plugging a novel loss estimator into the optimization problem that characterizes the instance-optimal strategy, our first algorithm not…

Machine Learning · Computer Science 2021-06-15 Chung-Wei Lee , Haipeng Luo , Chen-Yu Wei , Mengxiao Zhang , Xiaojin Zhang

We consider linear stochastic bandits where the set of actions is an ellipsoid. We provide the first known minimax optimal algorithm for this problem. We first derive a novel information-theoretic lower bound on the regret of any algorithm,…

Machine Learning · Statistics 2025-02-25 Raymond Zhang , Hedi Hadiji , Richard Combes

Stochastic linear bandits are a natural and simple generalisation of finite-armed bandits with numerous practical applications. Current approaches focus on generalising existing techniques for finite-armed bandits, notably the optimism…

Machine Learning · Statistics 2016-10-17 Tor Lattimore , Csaba Szepesvari

We study stochastic linear optimization problem with bandit feedback. The set of arms take values in an $N$-dimensional space and belong to a bounded polyhedron described by finitely many linear inequalities. We provide a lower bound for…

Machine Learning · Computer Science 2015-09-29 Manjesh K. Hanawal , Amir Leshem , Venkatesh Saligrama

We consider a stochastic multi-armed bandit problem with i.i.d. rewards where the expected reward function is multimodal with at most m modes. We propose the first known computationally tractable algorithm for computing the solution to the…

Machine Learning · Statistics 2025-10-31 William Réveillard , Richard Combes

We study stage-wise conservative linear stochastic bandits: an instance of bandit optimization, which accounts for (unknown) safety constraints that appear in applications such as online advertising and medical trials. At each stage, the…

Machine Learning · Computer Science 2020-10-02 Ahmadreza Moradipari , Christos Thrampoulidis , Mahnoosh Alizadeh

We study pure exploration with infinitely many bandit arms generated i.i.d. from an unknown distribution. Our goal is to efficiently select a single high quality arm whose average reward is, with probability $1-\delta$, within $\varepsilon$…

Machine Learning · Computer Science 2023-06-06 Xiao-Yue Gong , Mark Sellke

Bandit algorithms solve diverse sequential decision-making problems, but are often too sample-inefficient for from-scratch personalization. To substantially reduce exploration times, latent bandit algorithms exploit cross-instance structure…

Machine Learning · Computer Science 2026-05-11 Emil Carlsson , Newton Mwai , Fredrik D. Johansson

We consider a multi-armed bandit problem where payoffs are a linear function of an observed stochastic contextual variable. In the scenario where there exists a gap between optimal and suboptimal rewards, several algorithms have been…

Data Structures and Algorithms · Computer Science 2014-07-08 José Bento , Stratis Ioannidis , S. Muthukrishnan , Jinyun Yan

This paper considers the problem of maximizing an expectation function over a finite set, or finite-arm bandit problem. We first propose a naive stochastic bandit algorithm for obtaining a probably approximately correct (PAC) solution to…

Optimization and Control · Mathematics 2022-06-16 Marie Billaud-Friess , Arthur Macherey , Anthony Nouy , Clémentine Prieur

We address the problem of regret minimization in logistic contextual bandits, where a learner decides among sequential actions or arms given their respective contexts to maximize binary rewards. Using a fast inference procedure with…

Machine Learning · Statistics 2018-05-22 Bianca Dumitrascu , Karen Feng , Barbara E Engelhardt

Generalized Linear Bandits (GLBs), a natural extension of the stochastic linear bandits, has been popular and successful in recent years. However, existing GLBs scale poorly with the number of rounds and the number of arms, limiting their…

Machine Learning · Statistics 2017-10-24 Kwang-Sung Jun , Aniruddha Bhargava , Robert Nowak , Rebecca Willett

This paper proposes near-optimal algorithms for the pure-exploration linear bandit problem in the fixed confidence and fixed budget settings. Leveraging ideas from the theory of suprema of empirical processes, we provide an algorithm whose…

Machine Learning · Computer Science 2020-06-23 Julian Katz-Samuels , Lalit Jain , Zohar Karnin , Kevin Jamieson

The RKHS bandit problem (also called kernelized multi-armed bandit problem) is an online optimization problem of non-linear functions with noisy feedback. Although the problem has been extensively studied, there are unsatisfactory results…

Machine Learning · Computer Science 2021-07-27 Sho Takemori , Masahiro Sato

In this paper we adapt the nearest neighbour rule to the contextual bandit problem. Our algorithm handles the fully adversarial setting in which no assumptions at all are made about the data-generation process. When combined with a…

Machine Learning · Computer Science 2024-03-11 Stephen Pasteris , Chris Hicks , Vasilios Mavroudis

Several sparsity-constrained algorithms such as Orthogonal Matching Pursuit or the Frank-Wolfe algorithm with sparsity constraints work by iteratively selecting a novel atom to add to the current non-zero set of variables. This selection…

Machine Learning · Computer Science 2016-08-23 A Rakotomamonjy , S Koço , Liva Ralaivola