English
Related papers

Related papers: No-Regret Algorithms for Private Gaussian Process …

200 papers

A major challenge for machine learning is increasing the availability of data while respecting the privacy of individuals. Here we combine the provable privacy guarantees of the differential privacy framework with the flexibility of…

Machine Learning · Statistics 2019-01-18 Michael Thomas Smith , Max Zwiessele , Neil D. Lawrence

Gaussian processes (GPs) are non-parametric Bayesian models that are widely used for diverse prediction tasks. Previous work in adding strong privacy protection to GPs via differential privacy (DP) has been limited to protecting only the…

Machine Learning · Computer Science 2021-11-12 Antti Honkela , Laila Melkas

Many applications require optimizing an unknown, noisy function that is expensive to evaluate. We formalize this task as a multi-armed bandit problem, where the payoff function is either sampled from a Gaussian process (GP) or has low RKHS…

Machine Learning · Computer Science 2015-03-13 Niranjan Srinivas , Andreas Krause , Sham M. Kakade , Matthias Seeger

We study the noise-free Gaussian Process (GP) bandits problem, in which the learner seeks to minimize regret through noise-free observations of the black-box objective function lying on the known reproducing kernel Hilbert space (RKHS).…

Machine Learning · Computer Science 2025-12-12 Shogo Iwazaki

Differential privacy (DP) is obtained by randomizing a data analysis algorithm, which necessarily introduces a tradeoff between its utility and privacy. Many DP mechanisms are built upon one of two underlying tools: Laplace and Gaussian…

Machine Learning · Computer Science 2026-04-03 Roy Rinberg , Ilia Shumailov , Vikrant Singhal , Rachel Cummings , Nicolas Papernot

Gaussian processes (GP) are a well studied Bayesian approach for the optimization of black-box functions. Despite their effectiveness in simple problems, GP-based algorithms hardly scale to high-dimensional functions, as their per-iteration…

Machine Learning · Statistics 2019-08-28 Daniele Calandriello , Luigi Carratino , Alessandro Lazaric , Michal Valko , Lorenzo Rosasco

Contextual bandit algorithms are useful in personalized online decision-making. However, many applications such as personalized medicine and online advertising require the utilization of individual-specific information for effective…

Machine Learning · Statistics 2021-06-08 Yuxuan Han , Zhipeng Liang , Yang Wang , Jiheng Zhang

We study a time-varying Bayesian optimization problem with bandit feedback, where the reward function belongs to a Reproducing Kernel Hilbert Space (RKHS). We approach the problem via an upper-confidence bound Gaussian Process algorithm,…

Optimization and Control · Mathematics 2025-10-27 Eliabelle Mauduit , Eloïse Berthier , Andrea Simonetto

Differential privacy provides a rigorous framework to quantify data privacy, and has received considerable interest recently. A randomized mechanism satisfying $(\epsilon, \delta)$-differential privacy (DP) roughly means that, except with a…

Cryptography and Security · Computer Science 2019-12-10 Jun Zhao , Teng Wang , Tao Bai , Kwok-Yan Lam , Zhiying Xu , Shuyu Shi , Xuebin Ren , Xinyu Yang , Yang Liu , Han Yu

A continuing challenge for machine learning is providing methods to perform computation on data while ensuring the data remains private. In this paper we build on the provable privacy guarantees of differential privacy which has been…

Machine Learning · Computer Science 2019-09-23 Michael Thomas Smith , Mauricio A. Alvarez , Neil D. Lawrence

In this paper, we consider the problem of black-box optimization using Gaussian Process (GP) bandit optimization with a small number of batches. Assuming the unknown function has a low norm in the Reproducing Kernel Hilbert Space (RKHS), we…

Machine Learning · Statistics 2022-02-23 Zihan Li , Jonathan Scarlett

Consider the sequential optimization of a continuous, possibly non-convex, and expensive to evaluate objective function $f$. The problem can be cast as a Gaussian Process (GP) bandit where $f$ lives in a reproducing kernel Hilbert space…

Machine Learning · Statistics 2021-08-23 Sattar Vakili , Nacime Bouziani , Sepehr Jalali , Alberto Bernacchia , Da-shan Shiu

This paper addresses the Bayesian optimization problem (also referred to as the Bayesian setting of the Gaussian process bandit), where the learner seeks to minimize the regret under a function drawn from a known Gaussian process (GP).…

Machine Learning · Computer Science 2025-12-12 Shogo Iwazaki

In this paper, we consider the Gaussian process (GP) bandit optimization problem in a non-stationary environment. To capture external changes, the black-box function is allowed to be time-varying within a reproducing kernel Hilbert space…

Machine Learning · Computer Science 2022-03-29 Yuntian Deng , Xingyu Zhou , Baekjin Kim , Ambuj Tewari , Abhishek Gupta , Ness Shroff

In this paper, the problem of maximizing a black-box function $f:\mathcal{X} \to \mathbb{R}$ is studied in the Bayesian framework with a Gaussian Process (GP) prior. In particular, a new algorithm for this problem is proposed, and high…

Machine Learning · Statistics 2018-01-09 Shubhanshu Shekhar , Tara Javidi

Although distributed Gaussian process regression (GPR) enables multiple agents with separate datasets to jointly learn a model of the target function, its collaborative nature poses risks of private data leakage. To address this, we propose…

Systems and Control · Electrical Eng. & Systems 2025-12-08 Yeongjun Jang , Kaoru Teranishi , Jihoon Suh , Takashi Tanaka

We consider Bayesian optimization using Gaussian Process models, also referred to as kernel-based bandit optimization. We study the methodology of exploring the domain using random samples drawn from a distribution. We show that this random…

Machine Learning · Computer Science 2024-02-05 Sudeep Salgia , Sattar Vakili , Qing Zhao

In this paper, we study the problem of Gaussian process (GP) bandits under relaxed optimization criteria stating that any function value above a certain threshold is "good enough". On the theoretical side, we study various {\em lenient…

Machine Learning · Statistics 2021-05-27 Xu Cai , Selwyn Gomes , Jonathan Scarlett

In this work, we give efficient algorithms for privately estimating a Gaussian distribution in both pure and approximate differential privacy (DP) models with optimal dependence on the dimension in the sample complexity. In the pure DP…

Data Structures and Algorithms · Computer Science 2023-06-02 Daniel Alabi , Pravesh K. Kothari , Pranay Tankala , Prayaag Venkat , Fred Zhang

This paper analyses the problem of Gaussian process (GP) bandits with deterministic observations. The analysis uses a branch and bound algorithm that is related to the UCB algorithm of (Srinivas et al., 2010). For GPs with Gaussian…

Machine Learning · Computer Science 2012-03-12 Nando de Freitas , Alex Smola , Masrour Zoghi
‹ Prev 1 2 3 10 Next ›