English
Related papers

Related papers: Corruption-Tolerant Gaussian Process Bandit Optimi…

200 papers

We study sequential decision-making in batched nonparametric contextual bandits, where actions are selected over a finite horizon divided into a small number of batches. Motivated by constraints in domains such as medicine and marketing --…

Machine Learning · Statistics 2025-08-04 Sakshi Arya

We introduce GLR-klUCB, a novel algorithm for the piecewise iid non-stationary bandit problem with bounded rewards. This algorithm combines an efficient bandit algorithm, kl-UCB, with an efficient, parameter-free, changepoint detector, the…

Machine Learning · Statistics 2020-12-09 Lilian Besson , Emilie Kaufmann , Odalric-Ambrym Maillard , Julien Seznec

I introduce and analyse an anytime version of the Optimally Confident UCB (OCUCB) algorithm designed for minimising the cumulative regret in finite-armed stochastic bandits with subgaussian noise. The new algorithm is simple, intuitive (in…

Machine Learning · Computer Science 2016-05-09 Tor Lattimore

In this paper, we consider the problem of Gaussian process (GP) optimization with an added robustness requirement: The returned point may be perturbed by an adversary, and we require the function value to remain as high as possible even…

Machine Learning · Statistics 2018-11-05 Ilija Bogunovic , Jonathan Scarlett , Stefanie Jegelka , Volkan Cevher

We study the linear contextual bandit problem in the presence of adversarial corruption, where the interaction between the player and a possibly infinite decision set is contaminated by an adversary that can corrupt the reward up to a…

Machine Learning · Computer Science 2021-10-26 Heyang Zhao , Dongruo Zhou , Quanquan Gu

I present the first algorithm for stochastic finite-armed bandits that simultaneously enjoys order-optimal problem-dependent regret and worst-case regret. Besides the theoretical results, the new algorithm is simple, efficient and…

Machine Learning · Computer Science 2016-02-25 Tor Lattimore

Multi-armed bandit models have proven to be useful in modeling many real world problems in the areas of control and sequential decision making with partial information. However, in many scenarios, such as those prevalent in healthcare and…

Optimization and Control · Mathematics 2024-08-27 Qinyang He , Yonatan Mintz

Black box optimisation of an unknown function from expensive and noisy evaluations is a ubiquitous problem in machine learning, academic research and industrial production. An abstraction of the problem can be formulated as a kernel based…

Machine Learning · Statistics 2023-02-02 Sattar Vakili , Danyal Ahmed , Alberto Bernacchia , Ciara Pike-Burke

This paper analyzes the problem of Gaussian process (GP) bandits with deterministic observations. The analysis uses a branch and bound algorithm that is related to the UCB algorithm of (Srinivas et al, 2010). For GPs with Gaussian…

Machine Learning · Computer Science 2012-07-03 Nando de Freitas , Alex Smola , Masrour Zoghi

Gaussian processes (GPs) enable principled computation of model uncertainty, making them attractive for safety-critical applications. Such scenarios demand that GP decisions are not only accurate, but also robust to perturbations. In this…

Machine Learning · Computer Science 2021-04-08 Andrea Patane , Arno Blaas , Luca Laurenti , Luca Cardelli , Stephen Roberts , Marta Kwiatkowska

Maximizing high-dimensional, non-convex functions through noisy observations is a notoriously hard problem, but one that arises in many applications. In this paper, we tackle this challenge by modeling the unknown function as a sample from…

Machine Learning · Computer Science 2012-07-03 Bo Chen , Rui Castro , Andreas Krause

Multivariate Gaussian is often used as a first approximation to the distribution of high-dimensional data. Determining the parameters of this distribution under various constraints is a widely studied problem in statistics, and is often…

Statistics Theory · Mathematics 2016-02-09 Samuel Balmand , Arnak Dalalyan

This paper considers two fundamental sequential decision-making problems: the problem of prediction with expert advice and the multi-armed bandit problem. We focus on stochastic regimes in which an adversary may corrupt losses, and we…

Machine Learning · Statistics 2021-09-24 Shinji Ito

Originally motivated by default risk management applications, this paper investigates a novel problem, referred to as the profitable bandit problem here. At each step, an agent chooses a subset of the K possible actions. For each action…

Machine Learning · Statistics 2018-05-09 Mastane Achab , Stephan Clémençon , Aurélien Garivier

In this paper, we analyze the continuous armed bandit problems for nonconvex cost functions under certain smoothness and sublevel set assumptions. We first derive an upper bound on the expected cumulative regret of a simple bin splitting…

Machine Learning · Computer Science 2021-03-31 Puning Zhao , Lifeng Lai

We consider Bayesian optimization in settings where observations can be adversarially biased, for example by an uncontrolled hidden confounder. Our first contribution is a reduction of the confounded setting to the dueling bandit model.…

Machine Learning · Statistics 2021-06-10 Johannes Kirschner , Andreas Krause

We consider the problem of learning to play a repeated multi-agent game with an unknown reward function. Single player online learning algorithms attain strong regret bounds when provided with full information feedback, which unfortunately…

Machine Learning · Computer Science 2019-10-29 Pier Giuseppe Sessa , Ilija Bogunovic , Maryam Kamgarpour , Andreas Krause

Bandit problems with linear or concave reward have been extensively studied, but relatively few works have studied bandits with non-concave reward. This work considers a large family of bandit problems where the unknown underlying reward…

Machine Learning · Computer Science 2021-07-12 Baihe Huang , Kaixuan Huang , Sham M. Kakade , Jason D. Lee , Qi Lei , Runzhe Wang , Jiaqi Yang

We address the problem of stochastic combinatorial semi-bandits, where a player selects among P actions from the power set of a set containing d base items. Adaptivity to the problem's structure is essential in order to obtain optimal…

Machine Learning · Computer Science 2024-11-18 Julien Zhou , Pierre Gaillard , Thibaud Rahier , Houssam Zenati , Julyan Arbel

In this work, we address the open problem of finding low-complexity near-optimal multi-armed bandit algorithms for sequential decision making problems. Existing bandit algorithms are either sub-optimal and computationally simple (e.g.,…

Machine Learning · Computer Science 2018-04-18 Fang Liu , Sinong Wang , Swapna Buccapatnam , Ness Shroff