English
Related papers

Related papers: Ada-BKB: Scalable Gaussian Process Optimization on…

200 papers

In this paper, we consider the time-varying Bayesian optimization problem. The unknown function at each time is assumed to lie in an RKHS (reproducing kernel Hilbert space) with a bounded norm. We adopt the general variation budget model to…

Machine Learning · Computer Science 2021-05-04 Xingyu Zhou , Ness Shroff

We consider the sequential Bayesian optimization problem with bandit feedback, adopting a formulation that allows for the reward function to vary with time. We model the reward function using a Gaussian process whose evolution obeys a…

Machine Learning · Statistics 2016-01-26 Ilija Bogunovic , Jonathan Scarlett , Volkan Cevher

In the kernelized bandit problem, a learner aims to sequentially compute the optimum of a function lying in a reproducing kernel Hilbert space given only noisy evaluations at sequentially chosen points. In particular, the learner aims to…

Machine Learning · Computer Science 2023-08-15 Justin Whitehouse , Zhiwei Steven Wu , Aaditya Ramdas

We consider black box optimization of an unknown function in the nonparametric Gaussian process setting when the noise in the observed function values can be heavy tailed. This is in contrast to existing literature that typically assumes…

Machine Learning · Computer Science 2019-09-17 Sayak Ray Chowdhury , Aditya Gopalan

In this paper, we consider the problem of sequentially optimizing a black-box function $f$ based on noisy samples and bandit feedback. We assume that $f$ is smooth in the sense of having a bounded norm in some reproducing kernel Hilbert…

Machine Learning · Statistics 2018-06-01 Jonathan Scarlett , Ilijia Bogunovic , Volkan Cevher

Bayesian optimisation requires fitting a Gaussian process model, which in turn requires specifying prior on the unknown black-box function -- most of the theoretical literature assumes this prior is known. However, it is common to have more…

Machine Learning · Computer Science 2025-02-25 Juliusz Ziomek , Masaki Adachi , Michael A. Osborne

Many applications require a learner to make sequential decisions given uncertainty regarding both the system's payoff function and safety constraints. In safety-critical systems, it is paramount that the learner's actions do not violate the…

Machine Learning · Computer Science 2020-05-06 Sanae Amani , Mahnoosh Alizadeh , Christos Thrampoulidis

This paper addresses the Bayesian optimization problem (also referred to as the Bayesian setting of the Gaussian process bandit), where the learner seeks to minimize the regret under a function drawn from a known Gaussian process (GP).…

Machine Learning · Computer Science 2025-12-12 Shogo Iwazaki

Sequential optimization of black-box functions from noisy evaluations has been widely studied, with Gaussian Process bandit algorithms such as GP-UCB guaranteeing no-regret in stationary settings. However, for time-varying objectives, it is…

Machine Learning · Statistics 2025-12-04 Eliabelle Mauduit , Eloïse Berthier , Andrea Simonetto

The widespread proliferation of data-driven decision-making has ushered in a recent interest in the design of privacy-preserving algorithms. In this paper, we consider the ubiquitous problem of gaussian process (GP) bandit optimization from…

Machine Learning · Statistics 2021-02-25 Abhimanyu Dubey

Gaussian Process bandit optimization has emerged as a powerful tool for optimizing noisy black box functions. One example in machine learning is hyper-parameter optimization where each evaluation of the target function requires training a…

Machine Learning · Computer Science 2016-11-15 Tarun Kathuria , Amit Deshpande , Pushmeet Kohli

Bayesian optimization with Gaussian processes (GP) is commonly used to optimize black-box functions. The Mat\'ern and the Radial Basis Function (RBF) covariance functions are used frequently, but they do not make any assumptions about the…

Machine Learning · Computer Science 2025-06-23 Huy Hoang Nguyen , Han Zhou , Matthew B. Blaschko , Aleksei Tiulpin

Bayesian optimization (BO) has become popular for sequential optimization of black-box functions. When BO is used to optimize a target function, we often have access to previous evaluations of potentially related functions. This begs the…

Machine Learning · Computer Science 2022-06-17 Zhongxiang Dai , Yizhou Chen , Haibin Yu , Bryan Kian Hsiang Low , Patrick Jaillet

We study a time-varying Bayesian optimization problem with bandit feedback, where the reward function belongs to a Reproducing Kernel Hilbert Space (RKHS). We approach the problem via an upper-confidence bound Gaussian Process algorithm,…

Optimization and Control · Mathematics 2025-10-27 Eliabelle Mauduit , Eloïse Berthier , Andrea Simonetto

Learning expressive kernels while retaining tractable inference remains a central challenge in scaling Gaussian processes (GPs) to large and complex datasets. We propose a scalable GP regressor based on deep basis kernels (DBKs). Our DBK is…

Machine Learning · Statistics 2026-02-05 Yunqin Zhu , Henry Shaowu Yuchi , Yao Xie

Many real-world optimization problems involve an expensive ground-truth oracle (e.g., human evaluation, physical experiments) and a cheap, low-fidelity prediction oracle (e.g., machine learning models, simulations). Meanwhile, abundant…

Machine Learning · Computer Science 2026-02-02 Xin Jennifer Chen , Yunjin Tong

We consider Bayesian optimization using Gaussian Process models, also referred to as kernel-based bandit optimization. We study the methodology of exploring the domain using random samples drawn from a distribution. We show that this random…

Machine Learning · Computer Science 2024-02-05 Sudeep Salgia , Sattar Vakili , Qing Zhao

Bayesian optimization is an effective technique for black-box optimization, but its applicability is typically limited to low-dimensional and small-budget problems due to the cubic complexity of computing the Gaussian process (GP)…

Machine Learning · Computer Science 2025-12-18 Yunyue Wei , Vincent Zhuang , Saraswati Soedarmadji , Yanan Sui

We study the regret minimization problem in the novel setting of generalized kernelized bandits (GKBs), where we optimize an unknown function $f^*$ belonging to a reproducing kernel Hilbert space (RKHS) having access to samples generated by…

Machine Learning · Computer Science 2025-12-12 Alberto Maria Metelli , Simone Drago , Marco Mussi

Consider the sequential optimization of a continuous, possibly non-convex, and expensive to evaluate objective function $f$. The problem can be cast as a Gaussian Process (GP) bandit where $f$ lives in a reproducing kernel Hilbert space…

Machine Learning · Statistics 2021-08-23 Sattar Vakili , Nacime Bouziani , Sepehr Jalali , Alberto Bernacchia , Da-shan Shiu