中文
相关论文

相关论文: Ada-BKB: Scalable Gaussian Process Optimization on…

200 篇论文

In this paper, we consider the time-varying Bayesian optimization problem. The unknown function at each time is assumed to lie in an RKHS (reproducing kernel Hilbert space) with a bounded norm. We adopt the general variation budget model to…

机器学习 · 计算机科学 2021-05-04 Xingyu Zhou , Ness Shroff

We consider the sequential Bayesian optimization problem with bandit feedback, adopting a formulation that allows for the reward function to vary with time. We model the reward function using a Gaussian process whose evolution obeys a…

机器学习 · 统计学 2016-01-26 Ilija Bogunovic , Jonathan Scarlett , Volkan Cevher

In the kernelized bandit problem, a learner aims to sequentially compute the optimum of a function lying in a reproducing kernel Hilbert space given only noisy evaluations at sequentially chosen points. In particular, the learner aims to…

机器学习 · 计算机科学 2023-08-15 Justin Whitehouse , Zhiwei Steven Wu , Aaditya Ramdas

We consider black box optimization of an unknown function in the nonparametric Gaussian process setting when the noise in the observed function values can be heavy tailed. This is in contrast to existing literature that typically assumes…

机器学习 · 计算机科学 2019-09-17 Sayak Ray Chowdhury , Aditya Gopalan

In this paper, we consider the problem of sequentially optimizing a black-box function $f$ based on noisy samples and bandit feedback. We assume that $f$ is smooth in the sense of having a bounded norm in some reproducing kernel Hilbert…

机器学习 · 统计学 2018-06-01 Jonathan Scarlett , Ilijia Bogunovic , Volkan Cevher

Bayesian optimisation requires fitting a Gaussian process model, which in turn requires specifying prior on the unknown black-box function -- most of the theoretical literature assumes this prior is known. However, it is common to have more…

机器学习 · 计算机科学 2025-02-25 Juliusz Ziomek , Masaki Adachi , Michael A. Osborne

Many applications require a learner to make sequential decisions given uncertainty regarding both the system's payoff function and safety constraints. In safety-critical systems, it is paramount that the learner's actions do not violate the…

机器学习 · 计算机科学 2020-05-06 Sanae Amani , Mahnoosh Alizadeh , Christos Thrampoulidis

This paper addresses the Bayesian optimization problem (also referred to as the Bayesian setting of the Gaussian process bandit), where the learner seeks to minimize the regret under a function drawn from a known Gaussian process (GP).…

机器学习 · 计算机科学 2025-12-12 Shogo Iwazaki

Sequential optimization of black-box functions from noisy evaluations has been widely studied, with Gaussian Process bandit algorithms such as GP-UCB guaranteeing no-regret in stationary settings. However, for time-varying objectives, it is…

机器学习 · 统计学 2025-12-04 Eliabelle Mauduit , Eloïse Berthier , Andrea Simonetto

The widespread proliferation of data-driven decision-making has ushered in a recent interest in the design of privacy-preserving algorithms. In this paper, we consider the ubiquitous problem of gaussian process (GP) bandit optimization from…

机器学习 · 统计学 2021-02-25 Abhimanyu Dubey

Gaussian Process bandit optimization has emerged as a powerful tool for optimizing noisy black box functions. One example in machine learning is hyper-parameter optimization where each evaluation of the target function requires training a…

机器学习 · 计算机科学 2016-11-15 Tarun Kathuria , Amit Deshpande , Pushmeet Kohli

Bayesian optimization with Gaussian processes (GP) is commonly used to optimize black-box functions. The Mat\'ern and the Radial Basis Function (RBF) covariance functions are used frequently, but they do not make any assumptions about the…

机器学习 · 计算机科学 2025-06-23 Huy Hoang Nguyen , Han Zhou , Matthew B. Blaschko , Aleksei Tiulpin

Bayesian optimization (BO) has become popular for sequential optimization of black-box functions. When BO is used to optimize a target function, we often have access to previous evaluations of potentially related functions. This begs the…

机器学习 · 计算机科学 2022-06-17 Zhongxiang Dai , Yizhou Chen , Haibin Yu , Bryan Kian Hsiang Low , Patrick Jaillet

We study a time-varying Bayesian optimization problem with bandit feedback, where the reward function belongs to a Reproducing Kernel Hilbert Space (RKHS). We approach the problem via an upper-confidence bound Gaussian Process algorithm,…

最优化与控制 · 数学 2025-10-27 Eliabelle Mauduit , Eloïse Berthier , Andrea Simonetto

Learning expressive kernels while retaining tractable inference remains a central challenge in scaling Gaussian processes (GPs) to large and complex datasets. We propose a scalable GP regressor based on deep basis kernels (DBKs). Our DBK is…

机器学习 · 统计学 2026-02-05 Yunqin Zhu , Henry Shaowu Yuchi , Yao Xie

Many real-world optimization problems involve an expensive ground-truth oracle (e.g., human evaluation, physical experiments) and a cheap, low-fidelity prediction oracle (e.g., machine learning models, simulations). Meanwhile, abundant…

机器学习 · 计算机科学 2026-02-02 Xin Jennifer Chen , Yunjin Tong

We consider Bayesian optimization using Gaussian Process models, also referred to as kernel-based bandit optimization. We study the methodology of exploring the domain using random samples drawn from a distribution. We show that this random…

机器学习 · 计算机科学 2024-02-05 Sudeep Salgia , Sattar Vakili , Qing Zhao

Bayesian optimization is an effective technique for black-box optimization, but its applicability is typically limited to low-dimensional and small-budget problems due to the cubic complexity of computing the Gaussian process (GP)…

机器学习 · 计算机科学 2025-12-18 Yunyue Wei , Vincent Zhuang , Saraswati Soedarmadji , Yanan Sui

We study the regret minimization problem in the novel setting of generalized kernelized bandits (GKBs), where we optimize an unknown function $f^*$ belonging to a reproducing kernel Hilbert space (RKHS) having access to samples generated by…

机器学习 · 计算机科学 2025-12-12 Alberto Maria Metelli , Simone Drago , Marco Mussi

Consider the sequential optimization of a continuous, possibly non-convex, and expensive to evaluate objective function $f$. The problem can be cast as a Gaussian Process (GP) bandit where $f$ lives in a reproducing kernel Hilbert space…

机器学习 · 统计学 2021-08-23 Sattar Vakili , Nacime Bouziani , Sepehr Jalali , Alberto Bernacchia , Da-shan Shiu