中文
相关论文

相关论文: Gaussian Process Bandit Optimization of the Thermo…

200 篇论文

Many applications require a learner to make sequential decisions given uncertainty regarding both the system's payoff function and safety constraints. In safety-critical systems, it is paramount that the learner's actions do not violate the…

机器学习 · 计算机科学 2020-05-06 Sanae Amani , Mahnoosh Alizadeh , Christos Thrampoulidis

Gaussian Process based Bayesian Optimization is a widely applied algorithm to learn and optimize under uncertainty, well-known for its sample efficiency. However, recently -- and more frequently -- research studies have empirically…

机器学习 · 统计学 2025-05-20 Antonio Candelieri , Andrea Ponti , Francesco Archetti

This work deals with parallel optimization of expensive objective functions which are modeled as sample realizations of Gaussian processes. The study is formalized as a Bayesian optimization problem, or continuous multi-armed bandit…

机器学习 · 统计学 2019-09-04 Sébastien Marmin , Clément Chevalier , David Ginsbourger

The recently proposed Thermodynamic Variational Objective (TVO) leverages thermodynamic integration to provide a family of variational inference objectives, which both tighten and generalize the ubiquitous Evidence Lower Bound (ELBO).…

机器学习 · 计算机科学 2020-07-02 Rob Brekelmans , Vaden Masrani , Frank Wood , Greg Ver Steeg , Aram Galstyan

We consider the problem of sequentially optimizing a time-varying objective function using time-varying Bayesian optimization (TVBO). Current approaches to TVBO require prior knowledge of a constant rate of change to cope with stale data…

机器学习 · 计算机科学 2025-02-05 Paul Brunzema , Alexander von Rohr , Friedrich Solowjow , Sebastian Trimpe

Sparse Gaussian Processes are a key component of high-throughput Bayesian Optimisation (BO) loops; however, we show that existing methods for allocating their inducing points severely hamper optimisation performance. By exploiting the…

机器学习 · 计算机科学 2023-02-24 Henry B. Moss , Sebastian W. Ober , Victor Picheny

A sampling-based method is introduced to approximate the Gittins index for a general family of alternative bandit processes. The approximation consists of a truncation of the optimization horizon and support for the immediate rewards, an…

最优化与控制 · 数学 2023-07-24 Stef Baas , Richard J. Boucherie , Aleida Braaksma

Consider the sequential optimization of a continuous, possibly non-convex, and expensive to evaluate objective function $f$. The problem can be cast as a Gaussian Process (GP) bandit where $f$ lives in a reproducing kernel Hilbert space…

机器学习 · 统计学 2021-08-23 Sattar Vakili , Nacime Bouziani , Sepehr Jalali , Alberto Bernacchia , Da-shan Shiu

Bayesian Optimization (BO) is a method for globally optimizing black-box functions. While BO has been successfully applied to many scenarios, developing effective BO algorithms that scale to functions with high-dimensional domains is still…

机器学习 · 计算机科学 2024-02-13 Yihang Shen , Carl Kingsford

Gaussian Process (GP) regression is a popular and sample-efficient approach for many engineering applications, where observations are expensive to acquire, and is also a central ingredient of Bayesian optimization (BO), a highly prevailing…

机器学习 · 统计学 2025-06-06 Sébastien Da Veiga

This paper analyses the problem of Gaussian process (GP) bandits with deterministic observations. The analysis uses a branch and bound algorithm that is related to the UCB algorithm of (Srinivas et al., 2010). For GPs with Gaussian…

机器学习 · 计算机科学 2012-03-12 Nando de Freitas , Alex Smola , Masrour Zoghi

In this paper, we consider the problem of Gaussian process (GP) optimization with an added robustness requirement: The returned point may be perturbed by an adversary, and we require the function value to remain as high as possible even…

机器学习 · 统计学 2018-11-05 Ilija Bogunovic , Jonathan Scarlett , Stefanie Jegelka , Volkan Cevher

We propose a lower bound on the log marginal likelihood of Gaussian process regression models that can be computed without matrix factorisation of the full kernel matrix. We show that approximate maximum likelihood learning of model…

机器学习 · 统计学 2021-02-17 Artem Artemev , David R. Burt , Mark van der Wilk

Binary optimization is a fundamental area in computational science, with wide-ranging applications from logistics to cryptography, where the tasks are often formulated as Quadratic or Polynomial Unconstrained Binary Optimization problems…

量子物理 · 物理学 2024-12-20 Jean Cazalis , Tirth Shah , Yahui Chai , Karl Jansen , Stefan Kühn

We address the problem of Gaussian Process (GP) optimization in the presence of unknown and potentially varying adversarial perturbations. Unlike traditional robust optimization approaches that focus on maximizing performance under…

机器学习 · 计算机科学 2025-12-12 Artun Saday , Yaşar Cahit Yıldırım , Cem Tekin

Optimization problems with uncertain black-box constraints, modeled by warped Gaussian processes, have recently been considered in the Bayesian optimization setting. This work introduces a new class of constraints in which the same…

最优化与控制 · 数学 2020-06-16 Johannes Wiebe , Inês Cecílio , Jonathan Dunlop , Ruth Misener

Bandit based optimisation has a remarkable advantage over gradient based approaches due to their global perspective, which eliminates the danger of getting stuck at local optima. However, for continuous optimisation problems or problems…

人工智能 · 计算机科学 2017-05-30 Ole-Christoffer Granmo

By enabling constraint-aware online model adaptation, model predictive control using Gaussian process (GP) regression has exhibited impressive performance in real-world applications and received considerable attention in the learning-based…

最优化与控制 · 数学 2024-09-17 Amon Lahr , Andrea Zanelli , Andrea Carron , Melanie N. Zeilinger

Bayesian optimisation is an adaptive sampling strategy for constructing a Gaussian process surrogate to efficiently search for the global minimum of a black-box computational model. Gaussian processes have limited applicability in…

应用统计 · 统计学 2025-12-04 Thomas A. Archbold , Ieva Kazlauskaite , Fehmi Cirak

Thompson sampling is a heuristic algorithm for the multi-armed bandit problem which has a long tradition in machine learning. The algorithm has a Bayesian spirit in the sense that it selects arms based on posterior samples of reward…

机器学习 · 计算机科学 2021-02-15 Yi Liu , Veronika Rockova