中文
相关论文

相关论文: Efficient Conditioning Why Pseudo Observation Batc…

200 篇论文

Bayesian optimization (BO) provides a powerful framework for optimizing black-box, expensive-to-evaluate functions. It is therefore an attractive tool for engineering design problems, typically involving multiple objectives. Thanks to the…

机器学习 · 计算机科学 2024-09-06 Navid Ansari , Alireza Javanmardi , Eyke Hüllermeier , Hans-Peter Seidel , Vahid Babaei

The probabilistic surrogates used by Bayesian optimizers make them popular methods when function evaluations are noisy or expensive to evaluate. While Bayesian optimizers are traditionally used for global optimization, their benefits are…

最优化与控制 · 数学 2026-05-14 André L. Marchildon , David W. Zingg

Fast machine learning-based surrogate models are trained to emulate slow, high-fidelity engineering simulation models to accelerate engineering design tasks. This introduces uncertainty as the surrogate is only an approximation of the…

机器学习 · 统计学 2020-10-08 Paul Westermann , Ralph Evins

Physics simulations like computational fluid dynamics (CFD) are a computational bottleneck in computer-aided design (CAD) optimization processes. To overcome this bottleneck, one requires either an optimization framework that is highly…

机器学习 · 计算机科学 2024-08-29 Harsh Vardhan , David Hyde , Umesh Timalsina , Peter Volgyesi , Janos Sztipanovits

This paper proposes novel noise-free Bayesian optimization strategies that rely on a random exploration step to enhance the accuracy of Gaussian process surrogate models. The new algorithms retain the ease of implementation of the classical…

机器学习 · 计算机科学 2024-07-18 Hwanwoo Kim , Daniel Sanz-Alonso

Bayesian optimization (BO) is a powerful framework for estimating parameters of expensive simulation models, particularly in settings where the likelihood is intractable and evaluations are costly. In stochastic models every simulation is…

统计方法学 · 统计学 2026-04-16 Arindam Fadikar , Abby Stevens , Mickael Binois , Nicholson Collier , David O'Gara , Jonathan Ozik

Surrogate models provide a quick-to-evaluate approximation to complex computational models and are essential for multi-query problems like design optimisation. The inputs of current deterministic computational models are usually…

应用统计 · 统计学 2024-10-15 Thomas A. Archbold , Ieva Kazlauskaite , Fehmi Cirak

A key drawback of the current generation of artificial decision-makers is that they do not adapt well to changes in unexpected situations. This paper addresses the situation in which an AI for aerial dog fighting, with tunable parameters…

机器学习 · 统计学 2016-12-14 Brett Israelsen , Nisar Ahmed

In many real-world optimization problems, we have prior information about what objective function values are achievable. In this paper, we study the scenario that we have either exact knowledge of the minimum value or a, possibly inexact,…

机器学习 · 计算机科学 2025-09-26 Hanyang Wang , Juergen Branke , Matthias Poloczek

Experimental (design) optimization is a key driver in designing and discovering new products and processes. Bayesian Optimization (BO) is an effective tool for optimizing expensive and black-box experimental design processes. While Bayesian…

机器学习 · 计算机科学 2024-02-28 Arun Kumar A , Alistair Shilton , Sunil Gupta , Santu Rana , Stewart Greenhill , Svetha Venkatesh

Many state-of-the-art hyperparameter optimization (HPO) algorithms rely on model-based optimizers that learn surrogate models of the target function to guide the search. Gaussian processes are the de facto surrogate model due to their…

机器学习 · 计算机科学 2023-05-08 David Salinas , Jacek Golebiowski , Aaron Klein , Matthias Seeger , Cedric Archambeau

Gaussian Processes (GPs) are widely seen as the state-of-the-art surrogate models for Bayesian optimization (BO) due to their ability to model uncertainty and their performance on tasks where correlations are easily captured (such as those…

机器学习 · 计算机科学 2024-12-13 Paul Brunzema , Mikkel Jordahn , John Willes , Sebastian Trimpe , Jasper Snoek , James Harrison

Bayesian Optimization (BO), guided by Gaussian process (GP) surrogates, has proven to be an invaluable technique for efficient, high-dimensional, black-box optimization, a critical problem inherent to many applications such as industrial…

Gaussian processes (GPs) are the main surrogate functions used for sequential modelling such as Bayesian Optimization and Active Learning. Their drawbacks are poor scaling with data and the need to run an optimization loop when using a…

机器学习 · 计算机科学 2022-11-03 Paul E. Chang , Prakhar Verma , ST John , Victor Picheny , Henry Moss , Arno Solin

Surrogate-based optimization relies on so-called infill criteria (acquisition functions) to decide which point to evaluate next. When Kriging is used as the surrogate model of choice (also called Bayesian optimization), one of the most…

神经与进化计算 · 计算机科学 2020-02-18 Frederik Rehbach , Martin Zaefferer , Boris Naujoks , Thomas Bartz-Beielstein

The purpose of this paper is twofold. On one side, we present a general framework for Bayesian optimization and we compare it with some related fields in active learning and Bayesian numerical analysis. On the other hand, Bayesian…

机器人学 · 计算机科学 2018-02-13 Ruben Martinez-Cantin

A key requirement for the current generation of artificial decision-makers is that they should adapt well to changes in unexpected situations. This paper addresses the situation in which an AI for aerial dog fighting, with tunable…

机器学习 · 统计学 2016-12-14 Brett W. Israelsen , Nisar Ahmed , Kenneth Center , Roderick Green , Winston Bennett

Bayesian optimization (BO) iteratively fits a Gaussian process (GP) surrogate to accumulated evaluations and selects new queries via an acquisition function such as expected improvement (EI). In practice, BO often concentrates evaluations…

统计方法学 · 统计学 2026-01-13 Jiguang Li , Hengrui Luo

Gaussian process (GP) based Bayesian optimization (BO) is a powerful method for optimizing black-box functions efficiently. The practical performance and theoretical guarantees of this approach depend on having the correct GP hyperparameter…

机器学习 · 统计学 2024-06-07 Huong Ha , Vu Nguyen , Hung Tran-The , Hongyu Zhang , Xiuzhen Zhang , Anton van den Hengel

Tuning control policies manually to meet high-level objectives is often time-consuming. Bayesian optimization provides a data-efficient framework for automating this process using numerical evaluations of an objective function. However,…

机器学习 · 计算机科学 2026-03-26 Lukas Theiner , Maik Pfefferkorn , Yongpeng Zhao , Sebastian Hirt , Rolf Findeisen