中文
相关论文

相关论文: Error Analysis of Surrogate Models Constructed thr…

200 篇论文

Surrogate modeling has become a valuable technique for black-box optimization tasks with expensive evaluation of the objective function. In this paper, we investigate the relationship between the predictive accuracy of surrogate models and…

神经与进化计算 · 计算机科学 2022-10-04 Zbyněk Pitra , Jan Koza , Jiří Tumpach , Martin Holeňa

We demonstrate the adaption of three established methods to the field of surrogate machine learning model development. These methods are data augmentation, custom loss functions and transfer learning. Each of these methods have seen…

机器学习 · 计算机科学 2022-11-04 H. Rhys Jones , Tingting Mu , Andrei C. Popescu , Yusuf Sulehman

Decision support systems often rely on solving complex optimization problems that may require to estimate uncertain parameters beforehand. Recent studies have shown how using traditionally trained estimators for this task can lead to…

机器学习 · 计算机科学 2025-12-19 Gaetano Signorelli , Michele Lombardi

Optimisation problems often have multiple conflicting objectives that can be computationally and/or financially expensive. Mono-surrogate Bayesian optimisation (BO) is a popular model-based approach for optimising such black-box functions.…

机器学习 · 计算机科学 2022-08-11 George De Ath , Tinkle Chugh , Alma A. M. Rahat

Bayesian optimisation (BO) has been widely used to solve problems with expensive function evaluations. In multi-objective optimisation problems, BO aims to find a set of approximated Pareto optimal solutions. There are typically two ways to…

机器学习 · 计算机科学 2022-08-16 Tinkle Chugh

Practical model building processes are often time-consuming because many different models must be trained and validated. In this paper, we introduce a novel algorithm that can be used for computing the lower and the upper bounds of model…

机器学习 · 统计学 2014-02-11 Yoshiki Suzuki , Kohei Ogawa , Yuki Shinmura , Ichiro Takeuchi

Surrogate model can replace the parametric full-order model (FOM) by an approximation model, which can significantly improve the efficiency of optimization design and reduce the complexity of engineering systems. However, due to limitations…

流体动力学 · 物理学 2025-03-18 Xu Wang , Ruiqi Huang , Jiaqing Kou , Hui Tang , Weiwei Zhang

This work is in the context of blackbox optimization where the functions defining the problem are expensive to evaluate and where no derivatives are available. A tried and tested technique is to build surrogates of the objective and the…

最优化与控制 · 数学 2022-08-18 Charles Audet , Sébastien Le Digabel , Renaud Saltet

Optimizing costly black-box functions within a constrained evaluation budget presents significant challenges in many real-world applications. Surrogate Optimization (SO) is a common resolution, yet its proprietary nature introduced by the…

机器学习 · 计算机科学 2024-10-21 Nazanin Nezami , Hadis Anahideh

Systems may depend on parameters which one may control, or which serve to optimise the system, or are imposed externally, or they could be uncertain. This last case is taken as the ``Leitmotiv'' for the following. A reduced order model is…

机器学习 · 计算机科学 2025-02-17 Hermann G. Matthies

Model merging techniques aim to integrate the abilities of multiple models into a single model. Most model merging techniques have hyperparameters, and their setting affects the performance of the merged model. Because several existing…

Bayesian optimization (BO) algorithms form a class of surrogate-based heuristics, aimed at efficiently computing high-quality solutions for numerical black-box optimization problems. The BO pipeline is highly modular, with different design…

机器学习 · 计算机科学 2022-11-18 Carolin Benjamins , Anja Jankovic , Elena Raponi , Koen van der Blom , Marius Lindauer , Carola Doerr

The acquisition function, a critical component in Bayesian optimization (BO), can often be written as the expectation of a utility function under a surrogate model. However, to ensure that acquisition functions are tractable to optimize,…

机器学习 · 计算机科学 2022-10-10 Jiaming Song , Lantao Yu , Willie Neiswanger , Stefano Ermon

We present a data-driven Bayesian nonparametric approach for global optimization (DaBNO) of stochastic black-box function. The function value depends on the distribution of a random vector. However, this distribution is usually complex and…

最优化与控制 · 数学 2024-02-28 Haowei Wang , Xun Zhang , Szu Hui Ng , Songhao Wang

We evaluate some methods designed for tensor- (or data-) based multivariate model construction (approximation and compression). To this aim, a collection of multivariate functions and an evaluation methodology are suggested. First, these…

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

Many real-world decisions are made under uncertainty by solving optimization problems using predicted quantities. This predict-then-optimize paradigm has motivated decision-focused learning, which trains models with awareness of how the…

机器学习 · 计算机科学 2025-11-10 Paula Rodriguez-Diaz , Kirk Bansak Elisabeth Paulson

Bayesian optimization (BO) is a popular method to optimize costly black-box functions. While traditional BO optimizes each new target task from scratch, meta-learning has emerged as a way to leverage knowledge from related tasks to optimize…

机器学习 · 计算机科学 2024-07-01 Jiarong Pan , Stefan Falkner , Felix Berkenkamp , Joaquin Vanschoren

The selection of the most appropriate algorithm to solve a given problem instance, known as algorithm selection, is driven by the potential to capitalize on the complementary performance of different algorithms across sets of problem…

机器学习 · 计算机科学 2024-06-12 Gjorgjina Cenikj , Ana Nikolikj , Gašper Petelin , Niki van Stein , Carola Doerr , Tome Eftimov

This paper develops a surrogate model refinement approach for the simulation of dynamical systems and the solution of optimization problems governed by dynamical systems in which surrogates replace expensive-to-compute state- and…

最优化与控制 · 数学 2025-09-08 Jonathan R. Cangelosi , Matthias Heinkenschloss