中文
相关论文

相关论文: Improved Regret Analysis in Gaussian Process Bandi…

200 篇论文

We study the kernelized bandit problem, that involves designing an adaptive strategy for querying a noisy zeroth-order-oracle to efficiently learn about the optimizer of an unknown function $f$ with a norm bounded by $M<\infty$ in a…

机器学习 · 计算机科学 2022-03-15 Shubhanshu Shekhar , Tara Javidi

The expected improvement (EI) algorithm is one of the most popular strategies for optimization under uncertainty due to its simplicity and efficiency. Despite its popularity, the theoretical aspects of this algorithm have not been properly…

机器学习 · 计算机科学 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Svetha Venkatesh

Many applications require a learner to make sequential decisions given uncertainty regarding both the system's payoff function and safety constraints. In safety-critical systems, it is paramount that the learner's actions do not violate the…

机器学习 · 计算机科学 2020-05-06 Sanae Amani , Mahnoosh Alizadeh , Christos Thrampoulidis

We consider the problem of optimizing a black-box function based on noisy bandit feedback. Kernelized bandit algorithms have shown strong empirical and theoretical performance for this problem. They heavily rely on the assumption that the…

机器学习 · 计算机科学 2021-11-10 Ilija Bogunovic , Andreas Krause

Bayesian optimization (BO) with Gaussian process (GP) surrogate models is a powerful black-box optimization method. Acquisition functions are a critical part of a BO algorithm as they determine how the new samples are selected. Some of the…

机器学习 · 计算机科学 2024-12-30 Jingyi Wang , Haowei Wang , Cosmin G. Petra , Nai-Yuan Chiang

In the kernelized bandit problem, a learner aims to sequentially compute the optimum of a function lying in a reproducing kernel Hilbert space given only noisy evaluations at sequentially chosen points. In particular, the learner aims to…

机器学习 · 计算机科学 2023-08-15 Justin Whitehouse , Zhiwei Steven Wu , Aaditya Ramdas

This paper studies kernelized bandits (also known as Gaussian process bandits) in an adversarial environment, where the reward functions in a known reproducing kernel Hilbert space (RKHS) may be adversarially chosen at each round. We show…

机器学习 · 计算机科学 2026-05-29 Shogo Iwazaki

We consider optimizing a function network in the noise-free grey-box setting with RKHS function classes, where the exact intermediate results are observable. We assume that the structure of the network is known (but not the underlying…

机器学习 · 统计学 2024-05-14 Zihan Li , Jonathan Scarlett

We study high-probability regret bounds for adversarial $K$-armed bandits with time-varying feedback graphs over $T$ rounds. For general strongly observable graphs, we develop an algorithm that achieves the optimal regret…

机器学习 · 计算机科学 2023-01-31 Haipeng Luo , Hanghang Tong , Mengxiao Zhang , Yuheng Zhang

We study the stochastic linear bandits with parameter noise model, in which the reward of action $a$ is $a^\top \theta$ where $\theta$ is sampled i.i.d. We show a regret upper bound of $\widetilde{O} (\sqrt{d T \log (K/\delta)…

机器学习 · 计算机科学 2026-05-26 Daniel Ezer , Alon Peled-Cohen , Yishay Mansour

Adapting to a priori unknown noise level is a very important but challenging problem in sequential decision-making as efficient exploration typically requires knowledge of the noise level, which is often loosely specified. We report…

机器学习 · 统计学 2024-06-11 Kwang-Sung Jun , Jungtaek Kim

In this paper, the problem of maximizing a black-box function $f:\mathcal{X} \to \mathbb{R}$ is studied in the Bayesian framework with a Gaussian Process (GP) prior. In particular, a new algorithm for this problem is proposed, and high…

机器学习 · 统计学 2018-01-09 Shubhanshu Shekhar , Tara Javidi

Gaussian processes (GP) are a well studied Bayesian approach for the optimization of black-box functions. Despite their effectiveness in simple problems, GP-based algorithms hardly scale to high-dimensional functions, as their per-iteration…

We motivate and analyse a new Tree Search algorithm, GPTS, based on recent theoretical advances in the use of Gaussian Processes for Bandit problems. We consider tree paths as arms and we assume the target/reward function is drawn from a GP…

机器学习 · 计算机科学 2011-01-18 Louis Dorard , John Shawe-Taylor

We consider the stochastic bandit problem with a continuous set of arms, with the expected reward function over the arms assumed to be fixed but unknown. We provide two new Gaussian process-based algorithms for continuous bandit…

机器学习 · 计算机科学 2017-05-18 Sayak Ray Chowdhury , Aditya Gopalan

Specifying reward functions for complex tasks like object manipulation or driving is challenging to do by hand. Reward learning seeks to address this by learning a reward model using human feedback on selected query policies. This shifts…

机器学习 · 计算机科学 2023-02-27 Kush Bhatia , Wenshuo Guo , Jacob Steinhardt

We consider the sequential optimization of an unknown, continuous, and expensive to evaluate reward function, from noisy and adversarially corrupted observed rewards. When the corruption attacks are subject to a suitable budget $C$ and the…

机器学习 · 统计学 2022-03-30 Ilija Bogunovic , Zihan Li , Andreas Krause , Jonathan Scarlett

We study the adversarial kernel bandit problem, in which the loss at each round is induced by an arbitrary bounded element of a reproducing kernel Hilbert space (RKHS). We propose an exponential-weights algorithm built on a regularized…

机器学习 · 计算机科学 2026-05-27 Yu-Jie Zhang , Hao Qiu , Jonathan Scarlett , Kevin Jamieson

As sequential learning algorithms are increasingly applied to real life, ensuring data privacy while maintaining their utilities emerges as a timely question. In this context, regret minimisation in stochastic bandits under…

机器学习 · 统计学 2025-05-12 Achraf Azize , Yulian Wu , Junya Honda , Francesco Orabona , Shinji Ito , Debabrota Basu

In this paper, we consider the problem of black-box optimization with noisy feedback revealed in batches, where the unknown function to optimize has a bounded norm in some Reproducing Kernel Hilbert Space (RKHS). We refer to this as the…

机器学习 · 统计学 2026-03-16 Chenkai Ma , Keqin Chen , Jonathan Scarlett