中文
相关论文

相关论文: SnAKe: Bayesian Optimization with Pathwise Explora…

200 篇论文

Bayesian Optimization is the state of the art technique for the optimization of black boxes, i.e., functions where we do not have access to their analytical expression nor its gradients, they are expensive to evaluate and its evaluation is…

人工智能 · 计算机科学 2021-01-13 Eduardo C. Garrido Merchán , Luis C. Jariego Pérez

Bayesian Optimization is a sample-efficient black-box optimization procedure that is typically applied to problems with a small number of independent objectives. However, in practice we often wish to optimize objectives defined over many…

机器学习 · 计算机科学 2021-10-29 Wesley J. Maddox , Maximilian Balandat , Andrew Gordon Wilson , Eytan Bakshy

Bayesian optimisation is a sample efficient method for finding a global optimum of expensive black-box objective functions. Historic datasets from related problems can be exploited to help improve performance of Bayesian optimisation by…

机器学习 · 计算机科学 2026-01-23 Natasha Trinkle , Huong Ha , Jeffrey Chan

Bayesian optimization is a sample-efficient method for solving expensive, black-box optimization problems. Stochastic programming concerns optimization under uncertainty where, typically, average performance is the quantity of interest. In…

机器学习 · 统计学 2025-02-19 Jack M. Buckingham , Ivo Couckuyt , Juergen Branke

This paper proposes a new randomized strategy for adaptive MCMC using Bayesian optimization. This approach applies to non-differentiable objective functions and trades off exploration and exploitation to reduce the number of potentially…

统计计算 · 统计学 2011-11-01 Nimalan Mahendran , Ziyu Wang , Firas Hamze , Nando de Freitas

We consider Bayesian optimization of an expensive-to-evaluate black-box objective function, where we also have access to cheaper approximations of the objective. In general, such approximations arise in applications such as reinforcement…

机器学习 · 统计学 2016-11-16 Matthias Poloczek , Jialei Wang , Peter I. Frazier

The increasing availability of graph-structured data motivates the task of optimising over functions defined on the node set of graphs. Traditional graph search algorithms can be applied in this case, but they may be sample-inefficient and…

机器学习 · 计算机科学 2023-10-31 Xingchen Wan , Pierre Osselin , Henry Kenlay , Binxin Ru , Michael A. Osborne , Xiaowen Dong

Model-based sequential approaches to discrete "black-box" optimization, including Bayesian optimization techniques, often access the same points multiple times for a given objective function in interest, resulting in many steps to find the…

机器学习 · 计算机科学 2023-12-29 Keisuke Morita , Yoshihiko Nishikawa , Masayuki Ohzeki

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

机器学习 · 统计学 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

In Bayesian optimisation, we often seek to minimise the black-box objective functions that arise in real-world physical systems. A primary contributor to the cost of evaluating such black-box objective functions is often the effort required…

机器学习 · 计算机科学 2024-07-04 Adam X. Yang , Laurence Aitchison , Henry B. Moss

Bayesian optimization has emerged as a strong candidate tool for global optimization of functions with expensive evaluation costs. However, due to the dynamic nature of research in Bayesian approaches, and the evolution of computing…

应用统计 · 统计学 2018-08-24 Ran Rubin

Bayesian Optimization (BO) is a widely used approach for blackbox optimization that leverages a Gaussian process (GP) model and an acquisition function to guide future sampling. While effective in low-dimensional settings, BO faces…

机器学习 · 计算机科学 2025-11-26 Pavankumar Koratikere , Leifur Leifsson

We investigate modifications to Bayesian Optimization for a resource-constrained setting of sequential experimental design where changes to certain design variables of the search space incur a switching cost. This models the scenario where…

机器学习 · 计算机科学 2024-05-16 Stefan Pricopie , Richard Allmendinger , Manuel Lopez-Ibanez , Clyde Fare , Matt Benatan , Joshua Knowles

Bayesian optimization is used in many areas of AI for the optimization of black-box processes and has achieved impressive improvements of the state of the art for a lot of applications. It intelligently explores large and complex design…

材料科学 · 物理学 2021-08-03 Lars Kotthoff , Hud Wahab , Patrick Johnson

We propose an algorithm for Bayesian functional optimisation - that is, finding the function to optimise a process - guided by experimenter beliefs and intuitions regarding the expected characteristics (length-scale, smoothness, cyclicity…

机器学习 · 计算机科学 2020-09-09 Alistair Shilton , Sunil Gupta , Santu Rana , Svetha Venkatesh

Bayesian optimization is an effective methodology for the global optimization of functions with expensive evaluations. It relies on querying a distribution over functions defined by a relatively cheap surrogate model. An accurate model for…

Bayesian optimization is a powerful global optimization technique for expensive black-box functions. One of its shortcomings is that it requires auxiliary optimization of an acquisition function at each iteration. This auxiliary…

机器学习 · 统计学 2014-02-28 Ziyu Wang , Babak Shakibi , Lin Jin , Nando de Freitas

Many expensive black-box optimisation problems are sensitive to their inputs. In these problems it makes more sense to locate a region of good designs, than a single-possibly fragile-optimal design. Expensive black-box functions can be…

机器学习 · 计算机科学 2021-12-16 Nicholas D. Sanders , Richard M. Everson , Jonathan E. Fieldsend , Alma A. M. Rahat

Active policy search combines the trial-and-error methodology from policy search with Bayesian optimization to actively find the optimal policy. First, policy search is a type of reinforcement learning which has become very popular for…

机器人学 · 计算机科学 2024-02-13 Ruben Martinez-Cantin

Bayesian Optimization (BO) is an effective approach for global optimization of black-box functions when function evaluations are expensive. Most prior works use Gaussian processes to model the black-box function, however, the use of kernels…

机器学习 · 计算机科学 2023-09-25 Dat Phan-Trong , Hung Tran-The , Sunil Gupta