中文
相关论文

相关论文: Evaluation System for a Bayesian Optimization Serv…

200 篇论文

Numerical simulation of complex optical structures enables their optimization with respect to specific objectives. Often, optimization is done by multiple successive parameter scans, which are time consuming and computationally expensive.…

计算物理 · 物理学 2017-07-27 P. -I. Schneider , X. Garcia Santiago , C. Rockstuhl , S. Burger

Bayesian Optimization is a popular approach for optimizing expensive black-box functions. Its key idea is to use a surrogate model to approximate the objective and, importantly, quantify the associated uncertainty that allows a sequential…

机器学习 · 统计学 2025-02-05 Haoxian Chen , Henry Lam

Bayesian optimization is a sample-efficient method for solving expensive, black-box optimization problems. Stochastic programming concerns optimization under uncertainty where, typically, average performance is the quantity of interest. In…

机器学习 · 统计学 2025-02-19 Jack M. Buckingham , Ivo Couckuyt , Juergen Branke

Bayesian optimization is used in many areas of AI for the optimization of black-box processes and has achieved impressive improvements of the state of the art for a lot of applications. It intelligently explores large and complex design…

材料科学 · 物理学 2021-08-03 Lars Kotthoff , Hud Wahab , Patrick Johnson

Learning Bayesian networks is often cast as an optimization problem, where the computational task is to find a structure that maximizes a statistically motivated score. By and large, existing learning tools address this optimization problem…

机器学习 · 计算机科学 2013-01-30 Nir Friedman , Iftach Nachman , Dana Pe'er

This work aims at developing new methodologies to optimize computational costly complex systems (e.g., aeronautical engineering systems). The proposed surrogate-based method (often called Bayesian optimization) uses adaptive sampling to…

Bayesian optimization is a popular formalism for global optimization, but its computational costs limit it to expensive-to-evaluate functions. A competing, computationally more efficient, global optimization framework is optimistic…

机器学习 · 计算机科学 2022-09-05 Julia Grosse , Cheng Zhang , Philipp Hennig

This paper surveys the machine learning literature and presents in an optimization framework several commonly used machine learning approaches. Particularly, mathematical optimization models are presented for regression, classification,…

最优化与控制 · 数学 2021-01-12 Claudio Gambella , Bissan Ghaddar , Joe Naoum-Sawaya

Bayesian coresets have emerged as a promising approach for implementing scalable Bayesian inference. The Bayesian coreset problem involves selecting a (weighted) subset of the data samples, such that the posterior inference using the…

机器学习 · 统计学 2021-03-01 Jacky Y. Zhang , Rajiv Khanna , Anastasios Kyrillidis , Oluwasanmi Koyejo

This paper addresses the integration of additional information sources into a Bayesian optimization framework while ensuring that safety constraints are satisfied. The interdependencies between these information sources are modeled using an…

机器学习 · 计算机科学 2025-05-06 Jannis O. Luebsen , Annika Eichler

Bayesian Optimization (BO) is a common approach for hyperparameter optimization (HPO) in automated machine learning. Although it is well-accepted that HPO is crucial to obtain well-performing machine learning models, tuning BO's own…

机器学习 · 计算机科学 2019-08-20 Marius Lindauer , Matthias Feurer , Katharina Eggensperger , André Biedenkapp , Frank Hutter

Bayesian optimization is a sample-efficient method for black-box global optimization. How- ever, the performance of a Bayesian optimization method very much depends on its exploration strategy, i.e. the choice of acquisition function, and…

Bayesian optimization (BO) is a powerful approach to sample-efficient optimization of black-box objective functions. However, the application of BO to areas such as recommendation systems often requires taking the interpretability and…

机器学习 · 计算机科学 2023-03-06 Sulin Liu , Qing Feng , David Eriksson , Benjamin Letham , Eytan Bakshy

We present a tutorial on Bayesian optimization, a method of finding the maximum of expensive cost functions. Bayesian optimization employs the Bayesian technique of setting a prior over the objective function and combining it with evidence…

机器学习 · 计算机科学 2010-12-14 Eric Brochu , Vlad M. Cora , Nando de Freitas

Bayesian optimization is an effective method for finding extrema of a black-box function. We propose a new type of Bayesian optimization for learning user preferences in high-dimensional spaces. The central assumption is that the underlying…

机器学习 · 统计学 2020-08-17 Petrus Mikkola , Milica Todorović , Jari Järvi , Patrick Rinke , Samuel Kaski

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

人工智能 · 计算机科学 2018-11-14 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek

This paper presents an innovative optimization framework and algorithm based on the Bayes theorem, featuring adaptive conditioning and jitter. The adaptive conditioning function dynamically modifies the mean objective function in each…

最优化与控制 · 数学 2024-01-23 Sarit Maitra

The performance of Bayesian optimization (BO), a highly sample-efficient method for expensive black-box problems, is critically governed by the selection of its hyperparameters, including the kernel and acquisition functions. This presents…

机器学习 · 计算机科学 2026-05-25 Joon-Hyun Park , Mujin Cheon , Jeongsu Wi , Dong-Yeun Koh

We use the PAC-Bayesian theory for the setting of learning-to-optimize. To the best of our knowledge, we present the first framework to learn optimization algorithms with provable generalization guarantees (PAC-Bayesian bounds) and explicit…

机器学习 · 计算机科学 2025-02-26 Michael Sucker , Jalal Fadili , Peter Ochs

Bayesian Optimization is a popular tool for tuning algorithms in automatic machine learning (AutoML) systems. Current state-of-the-art methods leverage Random Forests or Gaussian processes to build a surrogate model that predicts algorithm…

机器学习 · 计算机科学 2021-01-08 Jeroen van Hoof , Joaquin Vanschoren