中文
相关论文

相关论文: Ada-BKB: Scalable Gaussian Process Optimization on…

200 篇论文

A black-box optimization algorithm such as Bayesian optimization finds extremum of an unknown function by alternating inference of the underlying function and optimization of an acquisition function. In a high-dimensional space, such…

量子物理 · 物理学 2021-05-03 Syun Izawa , Koki Kitai , Shu Tanaka , Ryo Tamura , Koji Tsuda

Can one parallelize complex exploration exploitation tradeoffs? As an example, consider the problem of optimal high-throughput experimental design, where we wish to sequentially design batches of experiments in order to simultaneously learn…

机器学习 · 计算机科学 2012-07-03 Thomas Desautels , Andreas Krause , Joel Burdick

Bayesian optimization (BO ) is an effective method for optimizing expensive-to-evaluate black-box functions. While high-dimensional problems can be particularly challenging, due to the multitude of parameter choices and the potentially high…

机器学习 · 计算机科学 2025-04-09 Erik Hellsten , Carl Hvarfner , Leonard Papenmeier , Luigi Nardi

Black-box problems are common in real life like structural design, drug experiments, and machine learning. When optimizing black-box systems, decision-makers always consider multiple performances and give the final decision by comprehensive…

机器学习 · 计算机科学 2021-01-22 Wenjie Chen , Shengcai Liu , Ke Tang

In the last five years, the financial industry has been impacted by the emergence of digitalization and machine learning. In this article, we explore two methods that have undergone rapid development in recent years: Gaussian processes and…

投资组合管理 · 定量金融 2019-03-13 Joan Gonzalvez , Edmond Lezmi , Thierry Roncalli , Jiali Xu

We consider the framework of methods for unconstrained minimization that are, in each iteration, restricted to a model that is only a valid approximation to the objective function on some affine subspace containing an incumbent point. These…

最优化与控制 · 数学 2025-11-26 Matt Menickelly

This paper analyses the problem of Gaussian process (GP) bandits with deterministic observations. The analysis uses a branch and bound algorithm that is related to the UCB algorithm of (Srinivas et al., 2010). For GPs with Gaussian…

机器学习 · 计算机科学 2012-03-12 Nando de Freitas , Alex Smola , Masrour Zoghi

This paper discusses a scenario approach to robust optimization of a blackbox function in a bandit setting. We assume that the blackbox function can be modeled as a Gaussian Process (GP) for every realization of the uncertain parameter. We…

最优化与控制 · 数学 2018-05-01 Shaunak D. Bopardikar , Vaibhav Srivastava

We consider the combinatorial volatile Gaussian process (GP) semi-bandit problem. Each round, an agent is provided a set of available base arms and must select a subset of them to maximize the long-term cumulative reward. We study the…

机器学习 · 计算机科学 2025-02-13 Jack Sandberg , Niklas Åkerblom , Morteza Haghir Chehreghani

This paper investigates the problem of efficient constrained global optimization of hybrid models that are a composition of a known white-box function and an expensive multi-output black-box function subject to noisy observations, which…

机器学习 · 统计学 2023-07-31 Congwen Lu , Joel A. Paulson

Due to the increasing demand for high performance and cost reduction within the framework of complex system design, numerical optimization of computationally costly problems is an increasingly popular topic in most engineering fields. In…

最优化与控制 · 数学 2018-06-12 Julien Pelamatti , Loïc Brevault , Mathieu Balesdent , El-Ghazali Talbi , Yannick Guerin

We address the problem of Gaussian Process (GP) optimization in the presence of unknown and potentially varying adversarial perturbations. Unlike traditional robust optimization approaches that focus on maximizing performance under…

机器学习 · 计算机科学 2025-12-12 Artun Saday , Yaşar Cahit Yıldırım , Cem Tekin

Bayesian optimization (BO) based on Gaussian process models is a powerful paradigm to optimize black-box functions that are expensive to evaluate. While several BO algorithms provably converge to the global optimum of the unknown function,…

机器学习 · 统计学 2019-04-03 Felix Berkenkamp , Angela P. Schoellig , Andreas Krause

We aim to optimize a black-box function $f:\mathcal{X} \mapsto \mathbb{R}$ under the assumption that $f$ is H\"older smooth and has bounded norm in the RKHS associated with a given kernel $K$. This problem is known to have an agnostic…

机器学习 · 计算机科学 2020-05-12 Shubhanshu Shekhar , Tara Javidi

We present a data-driven Bayesian nonparametric approach for global optimization (DaBNO) of stochastic black-box function. The function value depends on the distribution of a random vector. However, this distribution is usually complex and…

最优化与控制 · 数学 2024-02-28 Haowei Wang , Xun Zhang , Szu Hui Ng , Songhao Wang

This paper studies kernelized bandits (also known as Gaussian process bandits) in an adversarial environment, where the reward functions in a known reproducing kernel Hilbert space (RKHS) may be adversarially chosen at each round. We show…

机器学习 · 计算机科学 2026-05-29 Shogo Iwazaki

Gaussian process upper confidence bound (GP-UCB) is a theoretically promising approach for black-box optimization; however, the confidence parameter $\beta$ is considerably large in the theorem and chosen heuristically in practice. Then,…

机器学习 · 计算机科学 2023-06-13 Shion Takeno , Yu Inatsu , Masayuki Karasuyama

Bayesian optimization is a powerful global optimization technique for expensive black-box functions. One of its shortcomings is that it requires auxiliary optimization of an acquisition function at each iteration. This auxiliary…

机器学习 · 统计学 2014-02-28 Ziyu Wang , Babak Shakibi , Lin Jin , Nando de Freitas

Bayesian optimization methods have been successfully applied to black box optimization problems that are expensive to evaluate. In this paper, we adapt the so-called super effcient global optimization algorithm to solve more accurately…

机器学习 · 统计学 2020-06-30 Rémy Priem , Nathalie Bartoli , Youssef Diouane , Alessandro Sgueglia

Trust Region Bayesian Optimization (TuRBO) is an effective strategy for alleviating the curse of dimensionality in high-dimensional black-box optimization. However, inappropriate lengthscale design can cause the local Gaussian process (GP)…

机器学习 · 统计学 2026-04-28 Wei-Ting Tang , Joel A. Paulson