中文
相关论文

相关论文: Informed Initialization for Bayesian Optimization …

200 篇论文

The key idea of Bayesian optimization is replacing an expensive target function with a cheap surrogate model. By selection of an acquisition function for Bayesian optimization, we trade off between exploration and exploitation. The…

机器学习 · 统计学 2019-02-20 Leonid Matyushin , Alexey Zaytsev , Oleg Alenkin , Andrey Ustuzhanin

Bayesian optimization (BO) is a typical approach to solve expensive optimization problems. In each iteration of BO, a Gaussian process(GP) model is trained using the previously evaluated solutions; then next candidate solutions for…

神经与进化计算 · 计算机科学 2022-06-23 Jixiang Chen , Fu Luo , Zhenkun Wang

Fast machine learning-based surrogate models are trained to emulate slow, high-fidelity engineering simulation models to accelerate engineering design tasks. This introduces uncertainty as the surrogate is only an approximation of the…

机器学习 · 统计学 2020-10-08 Paul Westermann , Ralph Evins

While Bayesian Optimization (BO) is a very popular method for optimizing expensive black-box functions, it fails to leverage the experience of domain experts. This causes BO to waste function evaluations on bad design choices (e.g., machine…

机器学习 · 计算机科学 2021-04-20 Artur Souza , Luigi Nardi , Leonardo B. Oliveira , Kunle Olukotun , Marius Lindauer , Frank Hutter

In the machine learning algorithms, the choice of the hyperparameter is often an art more than a science, requiring labor-intensive search with expert experience. Therefore, automation on hyperparameter optimization to exclude human…

机器学习 · 计算机科学 2020-12-08 Taehyeon Kim , Jaeyeon Ahn , Nakyil Kim , Seyoung Yun

Bayesian optimization is a broadly applied methodology to optimize the expensive black-box function. Despite its success, it still faces the challenge from the high-dimensional search space. To alleviate this problem, we propose a novel…

机器学习 · 计算机科学 2020-10-20 Jingfan Chen , Guanghui Zhu , Chunfeng Yuan , Yihua Huang

In the field of machine learning (ML) for materials optimization, active learning algorithms, such as Bayesian Optimization (BO), have been leveraged for guiding autonomous and high-throughput experimentation systems. However, very few…

An important experimental design problem in early-stage drug discovery is how to prioritize available compounds for testing when very little is known about the target protein. Informer based ranking (IBR) methods address the prioritization…

统计方法学 · 统计学 2023-06-26 Peng Yu , Spencer S. Ericksen , Anthony Gitter , Michael A. Newton

Bayesian optimization is an effective method for solving expensive black-box optimization problems. Most existing methods use Gaussian processes (GP) as the surrogate model for approximating the black-box objective function, it is…

机器学习 · 计算机科学 2025-12-23 Wei Peng , Jianchen Hu , Kang Liu , Qiaozhu Zhai

Bilevel optimization, a hierarchical mathematical framework where one optimization problem is nested within another, has emerged as a powerful tool for modeling complex decision-making processes in various fields such as economics,…

机器学习 · 计算机科学 2024-12-25 Omer Ekmekcioglu , Nursen Aydin , Juergen Branke

Bayesian Optimization (BO) is a key methodology for accelerating molecular discovery by estimating the mapping from molecules to their properties while seeking the optimal candidate. Typically, BO iteratively updates a probabilistic…

机器学习 · 计算机科学 2025-12-17 Qi Chen , Fabio Ramos , Alán Aspuru-Guzik , Florian Shkurti

Bayesian optimization is a sample-efficient method for solving expensive, black-box optimization problems. Stochastic programming concerns optimization under uncertainty where, typically, average performance is the quantity of interest. In…

机器学习 · 统计学 2025-02-19 Jack M. Buckingham , Ivo Couckuyt , Juergen Branke

In this paper, we propose a surrogate-assisted evolutionary algorithm (EA) for hyperparameter optimization of machine learning (ML) models. The proposed STEADE model initially estimates the objective function landscape using RadialBasis…

神经与进化计算 · 计算机科学 2020-12-14 Subhodip Biswas , Adam D Cobb , Andreea Sistrunk , Naren Ramakrishnan , Brian Jalaian

Gaussian processes are the model of choice in Bayesian optimization and active learning. Yet, they are highly dependent on cleverly chosen hyperparameters to reach their full potential, and little effort is devoted to finding good…

机器学习 · 计算机科学 2024-02-16 Carl Hvarfner , Erik Hellsten , Frank Hutter , Luigi Nardi

This paper presents novel mixed-type Bayesian optimization (BO) algorithms to accelerate the optimization of a target objective function by exploiting correlated auxiliary information of binary type that can be more cheaply obtained, such…

机器学习 · 统计学 2019-06-19 Yehong Zhang , Zhongxiang Dai , Kian Hsiang Low

Bayesian experimental design involves the optimal allocation of resources in an experiment, with the aim of optimising cost and performance. For implicit models, where the likelihood is intractable but sampling from the model is possible,…

机器学习 · 统计学 2019-02-26 Steven Kleinegesse , Michael Gutmann

Bayesian optimization (BO) has gained attention as an efficient algorithm for black-box optimization of expensive-to-evaluate systems, where the BO algorithm iteratively queries the system and suggests new trials based on a probabilistic…

机器学习 · 计算机科学 2026-03-13 Eike Cramer , Luis Kutschat , Oliver Stollenwerk , Joel A. Paulson , Alexander Mitsos

In this paper, we bridge the gap between hyperparameter optimization and ensemble learning by performing Bayesian optimization of an ensemble with regards to its hyperparameters. Our method consists in building a fixed-size ensemble,…

机器学习 · 计算机科学 2016-05-23 Julien-Charles Lévesque , Christian Gagné , Robert Sabourin

AI-assisted molecular optimization is a very active research field as it is expected to provide the next-generation drugs and molecular materials. An important difficulty is that the properties to be optimized rely on costly evaluations.…

机器学习 · 计算机科学 2025-05-19 Jules Leguy , Thomas Cauchy , Beatrice Duval , Benoit Da Mota

Bayesian optimization (BO) is a powerful paradigm for optimizing expensive black-box functions. Traditional BO methods typically rely on separate hand-crafted acquisition functions and surrogate models for the underlying function, and often…

机器学习 · 计算机科学 2025-07-10 Fengxue Zhang , Yuxin Chen