中文
相关论文

相关论文: Gaussian Process Bandit Optimization of the Thermo…

200 篇论文

Bayesian optimization (BO) has established itself as a leading strategy for efficiently optimizing expensive-to-evaluate functions. Existing BO methods mostly rely on Gaussian process (GP) surrogate models and are not applicable to…

机器学习 · 计算机科学 2024-01-29 Yongsheng Mei , Mahdi Imani , Tian Lan

High dimensional time series are endemic in applications of machine learning such as robotics (sensor data), computational biology (gene expression data), vision (video sequences) and graphics (motion capture data). Practical nonlinear…

机器学习 · 统计学 2011-07-26 Andreas C. Damianou , Michalis K. Titsias , Neil D. Lawrence

In many scientific and engineering applications, we are tasked with the maximisation of an expensive to evaluate black box function $f$. Traditional settings for this problem assume just the availability of this single function. However, in…

We consider the problem of finding an input to a stochastic black box function such that the scalar output of the black box function is as close as possible to a target value in the sense of the expected squared error. While the…

机器学习 · 计算机科学 2023-05-16 Johannes G. Hoffer , Sascha Ranftl , Bernhard C. Geiger

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

机器学习 · 统计学 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

We develop an automated variational inference method for Bayesian structured prediction problems with Gaussian process (GP) priors and linear-chain likelihoods. Our approach does not need to know the details of the structured likelihood…

机器学习 · 统计学 2016-09-15 Pietro Galliani , Amir Dezfouli , Edwin V. Bonilla , Novi Quadrianto

In this paper, we consider algorithm-independent lower bounds for the problem of black-box optimization of functions having a bounded norm is some Reproducing Kernel Hilbert Space (RKHS), which can be viewed as a non-Bayesian Gaussian…

机器学习 · 统计学 2021-05-25 Xu Cai , Jonathan Scarlett

We propose a novel sparse spectrum approximation of Gaussian process (GP) tailored for Bayesian optimization. Whilst the current sparse spectrum methods provide desired approximations for regression problems, it is observed that this…

机器学习 · 计算机科学 2020-06-09 Ang Yang , Cheng Li , Santu Rana , Sunil Gupta , Svetha Venkatesh

Gaussian variational approximation is a popular methodology to approximate posterior distributions in Bayesian inference especially in high dimensional and large data settings. To control the computational cost while being able to capture…

机器学习 · 计算机科学 2021-04-07 Bingxin Zhou , Junbin Gao , Minh-Ngoc Tran , Richard Gerlach

We consider the problem of decision-making under uncertainty in an environment with safety constraints. Many business and industrial applications rely on real-time optimization to improve key performance indicators. In the case of unknown…

机器学习 · 计算机科学 2023-01-31 Buse Sibel Korkmaz , Marta Zagórowska , Mehmet Mercangöz

We consider the problem of optimizing an unknown (typically non-convex) function with a bounded norm in some Reproducing Kernel Hilbert Space (RKHS), based on noisy bandit feedback. We consider a novel variant of this problem in which the…

机器学习 · 统计学 2020-03-05 Ilija Bogunovic , Andreas Krause , Jonathan Scarlett

We revisit the challenge of designing online algorithms for the bandit convex optimization problem (BCO) which are also scalable to high dimensional problems. Hence, we consider algorithms that are \textit{projection-free}, i.e., based on…

机器学习 · 计算机科学 2019-10-09 Dan Garber , Ben Kretzu

Variable selection for Gaussian process models is often done using automatic relevance determination, which uses the inverse length-scale parameter of each input variable as a proxy for variable relevance. This implicitly determined…

统计方法学 · 统计学 2019-04-24 Topi Paananen , Juho Piironen , Michael Riis Andersen , Aki Vehtari

In many bandit problems, the maximal reward achievable by a policy is often unknown in advance. We consider the problem of estimating the optimal policy value in the sublinear data regime before the optimal policy is even learnable. We…

机器学习 · 计算机科学 2023-02-21 Jonathan N. Lee , Weihao Kong , Aldo Pacchiano , Vidya Muthukumar , Emma Brunskill

We present the first framework for Gaussian-process-modulated Poisson processes when the temporal data appear in the form of panel counts. Panel count data frequently arise when experimental subjects are observed only at discrete time…

机器学习 · 统计学 2018-03-13 Hongyi Ding , Young Lee , Issei Sato , Masashi Sugiyama

Partially Observable Markov Decision Processes (POMDPs) are fundamental to decision-making under uncertainty. We introduce a novel scalable approach to accelerate upper bound estimation in Point-Based Value Iteration (PBVI) algorithms, the…

最优化与控制 · 数学 2025-03-13 Siqiong Zhou , Ashif S. Iquebal , Esma S. Gel

The continuous variable quantum computing platform constitutes a promising candidate for realizing quantum advantage, as exemplified in Gaussian Boson Sampling. While noise in the experiments makes the computation attainable for classical…

量子物理 · 物理学 2025-08-11 Jonas Vinther , Michael James Kastoryano

Gaussian process optimization is a successful class of algorithms(e.g. GP-UCB) to optimize a black-box function through sequential evaluations. However, for functions with continuous domains, Gaussian process optimization has to rely on…

机器学习 · 计算机科学 2022-03-15 Marco Rando , Luigi Carratino , Silvia Villa , Lorenzo Rosasco

Generative auto-bidding has demonstrated strong performance in online advertising, yet it often suffers from data scarcity in small-scale settings with limited advertiser participation. While cross-task data sharing is a natural remedy to…

机器学习 · 计算机科学 2026-02-10 Yiqin Lv , Zhiyu Mou , Miao Xu , Jinghao Chen , Qi Wang , Yixiu Mao , Yun Qu , Rongquan Bai , Chuan Yu , Jian Xu , Bo Zheng , Xiangyang Ji

We show how to use a variational approximation to the logistic function to perform approximate inference in Bayesian networks containing discrete nodes with continuous parents. Essentially, we convert the logistic function to a Gaussian,…

人工智能 · 计算机科学 2013-01-30 Kevin Murphy