中文
相关论文

相关论文: Bayesian Optimization with Binary Auxiliary Inform…

200 篇论文

Information-theoretic Bayesian optimization techniques have become popular for optimizing expensive-to-evaluate black-box functions due to their non-myopic qualities. Entropy Search and Predictive Entropy Search both consider the entropy…

机器学习 · 计算机科学 2023-01-18 Carl Hvarfner , Frank Hutter , Luigi Nardi

Bayesian optimization (BO) is a class of sample-efficient global optimization methods, where a probabilistic model conditioned on previous observations is used to determine future evaluations via the optimization of an acquisition function.…

机器学习 · 计算机科学 2020-06-22 Eric Hans Lee , David Eriksson , Bolong Cheng , Michael McCourt , David Bindel

This study investigates the application of Bayesian Optimization (BO) for the hyperparameter tuning of neural networks, specifically targeting the enhancement of Convolutional Neural Networks (CNN) for image classification tasks. Bayesian…

机器学习 · 计算机科学 2024-10-30 Gabriele Onorato

Automatic Machine Learning (Auto-ML) systems tackle the problem of automating the design of prediction models or pipelines for data science. In this paper, we present Lifelong Bayesian Optimization (LBO), an online, multitask Bayesian…

机器学习 · 统计学 2019-06-24 Yao Zhang , James Jordon , Ahmed M. Alaa , Mihaela van der Schaar

We propose MUMBO, the first high-performing yet computationally efficient acquisition function for multi-task Bayesian optimization. Here, the challenge is to perform efficient optimization by evaluating low-cost functions somehow related…

机器学习 · 计算机科学 2020-06-23 Henry B. Moss , David S. Leslie , Paul Rayson

Bayesian optimization (BO) is a powerful paradigm for derivative-free global optimization of a black-box objective function (BOF) that is expensive to evaluate. However, the overhead of BO can still be prohibitive for problems with highly…

机器学习 · 计算机科学 2019-12-18 Bin Liu

Information-theoretic Bayesian optimisation techniques have demonstrated state-of-the-art performance in tackling important global optimisation problems. However, current information-theoretic approaches require many approximations in…

机器学习 · 统计学 2018-06-07 Binxin Ru , Mark McLeod , Diego Granziol , Michael A. Osborne

Most research in Bayesian optimization (BO) has focused on \emph{direct feedback} scenarios, where one has access to exact values of some expensive-to-evaluate objective. This direction has been mainly driven by the use of BO in machine…

Quality Diversity (QD) algorithms such as MAP-Elites are a class of optimisation techniques that attempt to find a set of high-performing points from an objective function while enforcing behavioural diversity of the points over one or more…

最优化与控制 · 数学 2020-05-12 Paul Kent , Juergen Branke

Bayesian optimisation (BO) uses probabilistic surrogate models - usually Gaussian processes (GPs) - for the optimisation of expensive black-box functions. At each BO iteration, the GP hyperparameters are fit to previously-evaluated data by…

机器学习 · 计算机科学 2021-05-04 George De Ath , Richard Everson , Jonathan Fieldsend

Bayesian optimization (BO) is a popular black-box function optimization method, which makes sequential decisions based on a Bayesian model, typically a Gaussian process (GP), of the function. To ensure the quality of the model, transfer…

机器学习 · 计算机科学 2024-02-15 Zhou Fan , Xinran Han , Zi Wang

A bilevel optimization problem consists of two optimization problems nested as an upper- and a lower-level problem, in which the optimality of the lower-level problem defines a constraint for the upper-level problem. This paper considers…

机器学习 · 计算机科学 2026-02-27 Takuya Kanayama , Yuki Ito , Tomoyuki Tamura , Masayuki Karasuyama

BayesianOptimization(BO) is a sample-efficient black-box optimizer, and extensive methods have been proposed to build the absolute function response of the black-box function through a probabilistic surrogate model, including…

机器学习 · 计算机科学 2024-02-07 Xiaoxing Wang , Jiaxing Li , Chao Xue , Wei Liu , Weifeng Liu , Xiaokang Yang , Junchi Yan , Dacheng Tao

Bayesian optimization (BO) is an efficient framework for optimization of black-box objectives when function evaluations are costly and gradient information is not easily accessible. BO has been successfully applied to automate the task of…

机器学习 · 计算机科学 2024-07-09 Pallavi Mitra , Felix Biessmann

Bayesian optimization (BO) is a sample-efficient method and has been widely used for optimizing expensive black-box functions. Recently, there has been a considerable interest in BO literature in optimizing functions that are affected by…

机器学习 · 计算机科学 2023-12-22 Xiaobin Huang , Lei Song , Ke Xue , Chao Qian

Bayesian Optimization (BO) is a technique for sample-efficient black-box optimization that employs probabilistic models to identify promising input locations for evaluation. When dealing with composite-structured functions, such as f=g o h,…

机器学习 · 计算机科学 2024-07-11 Natalie Maus , Zhiyuan Jerry Lin , Maximilian Balandat , Eytan Bakshy

Bayesian optimization (BO) is a popular approach for sample-efficient optimization of black-box objective functions. While BO has been successfully applied to a wide range of scientific applications, traditional approaches to…

机器学习 · 计算机科学 2023-05-04 Natalie Maus , Kaiwen Wu , David Eriksson , Jacob Gardner

This paper studies an entropy-based multi-objective Bayesian optimization (MBO). The entropy search is successful approach to Bayesian optimization. However, for MBO, existing entropy-based methods ignore trade-off among objectives or…

机器学习 · 计算机科学 2020-02-12 Shinya Suzuki , Shion Takeno , Tomoyuki Tamura , Kazuki Shitara , Masayuki Karasuyama

Bayesian optimization (BO) is a sample-efficient global optimization algorithm for black-box functions which are expensive to evaluate. Existing literature on model based optimization in conditional parameter spaces are usually built on…

机器学习 · 统计学 2020-10-08 Xingchen Ma , Matthew B. Blaschko

In decision-making problems, the outcome of an intervention often depends on the causal relationships between system components and is highly costly to evaluate. In such settings, causal Bayesian optimization (CBO) can exploit the causal…

机器学习 · 统计学 2025-02-21 Shriya Bhatija , Paul-David Zuercher , Jakob Thumm , Thomas Bohné