English
Related papers

Related papers: Conservative Surrogate Models for Optimization wit…

200 papers

Bayesian optimization (BO) based on Gaussian process regression (GPR) is applied to different CFD (computational fluid dynamics) problems which can be of practical relevance. The problems are i) shape optimization in a lid-driven cavity to…

Fluid Dynamics · Physics 2021-11-15 Y. Morita , S. Rezaeiravesh , N. Tabatabaei , R. Vinuesa , K. Fukagata , P. Schlatter

Methods for inference and simulation of linearly constrained Gaussian Markov Random Fields (GMRF) are computationally prohibitive when the number of constraints is large. In some cases, such as for intrinsic GMRFs, they may even be…

Methodology · Statistics 2021-06-04 David Bolin , Jonas Wallin

This paper considers the problem of optimum reconstruction in generalized sampling-reconstruction processes (GSRPs). We propose constrained GSRP, a novel framework that minimizes the reconstruction error for inputs in a subspace, subject to…

Signal Processing · Electrical Eng. & Systems 2019-10-23 Bashir Sadeghi , Runyi Yu , Vishnu Naresh Boddeti

In climate systems, physiological models, optics, and many more, surrogate models are developed to reconstruct chaotic dynamical systems. We introduce four data-driven measures using global attractor properties to evaluate the quality of…

Computational Physics · Physics 2025-06-12 Luci Fumagalli , Kathy Lüdge , Jana de Wiljes , Heikki Haario , Lina Jaurigue

In this paper, we focus on developing efficient sensitivity analysis methods for a computationally expensive objective function $f(x)$ in the case that the minimization of it has just been performed. Here "computationally expensive" means…

Machine Learning · Statistics 2015-02-24 Yilun Wang , Christine A. Shoemaker

We derive criteria for the selection of datapoints used for data-driven reduced-order modeling and other areas of supervised learning based on Gaussian process regression (GPR). While this is a well-studied area in the fields of active…

Dynamical Systems · Mathematics 2022-10-12 Themistoklis P. Sapsis , Antoine Blanchard

Many fields of science and engineering rely on running simulations with complex and computationally expensive models to understand the involved processes in the system of interest. Nevertheless, the high cost involved hamper reliable and…

Machine Learning · Computer Science 2019-12-16 Daniel Heestermans Svendsen , Luca Martino , Gustau Camps-Valls

A key drawback of the current generation of artificial decision-makers is that they do not adapt well to changes in unexpected situations. This paper addresses the situation in which an AI for aerial dog fighting, with tunable parameters…

Machine Learning · Statistics 2016-12-14 Brett Israelsen , Nisar Ahmed

Sensor-based sorting systems enable the physical separation of a material stream into two fractions. The sorting decision is based on the image data evaluation of the sensors used and is carried out using actuators. Various process…

Machine Learning · Computer Science 2025-10-24 Felix Kronenwett , Georg Maier , Thomas Längle

Offline model-based optimization seeks to optimize against a learned surrogate model without querying the true oracle objective function during optimization. Such tasks are commonly encountered in protein design, robotics, and clinical…

Machine Learning · Computer Science 2024-09-27 Michael S. Yao , Yimeng Zeng , Hamsa Bastani , Jacob Gardner , James C. Gee , Osbert Bastani

A practical approach to evaluate performance of a Gaussian process regression models (GPR) for irregularly sampled sparse time-series is introduced. The approach entails construction of a secondary autoregressive model using the fine scale…

Methodology · Statistics 2016-11-10 Mehmet Süzen , Abed Ajraou

The increased penetration of wind power introduces more operational changes of critical corridors and the traditional time-consuming transient stability constrained total transfer capability (TTC) operational planning is unable to meet the…

Systems and Control · Electrical Eng. & Systems 2020-06-30 Gao Qiu , Youbo Liu , Junyong Liu , Junbo Zhao , Lingfeng Wang , Tingjian Liu , Hongjun Gao

We consider the problem of estimating the set of all inputs that leads a system to some particular behavior. The system is modeled by an expensive-to-evaluate function, such as a computer experiment, and we are interested in its excursion…

Methodology · Statistics 2021-05-10 Dario Azzimonti , David Ginsbourger , Clément Chevalier , Julien Bect , Yann Richet

Many state-of-the-art hyperparameter optimization (HPO) algorithms rely on model-based optimizers that learn surrogate models of the target function to guide the search. Gaussian processes are the de facto surrogate model due to their…

Machine Learning · Computer Science 2023-05-08 David Salinas , Jacek Golebiowski , Aaron Klein , Matthias Seeger , Cedric Archambeau

Bayesian optimization is a technique for optimizing black-box target functions. At the core of Bayesian optimization is a surrogate model that predicts the output of the target function at previously unseen inputs to facilitate the…

Machine Learning · Computer Science 2022-03-04 Felix Jimenez , Matthias Katzfuss

Gaussian process regression (GPR) is a powerful machine learning method which has recently enjoyed wider use, in particular in physical sciences. In its original formulation, GPR uses a square matrix of covariances among training data and…

Numerical Analysis · Mathematics 2023-09-08 Sergei Manzhos , Manabu Ihara

This work presents a robust design optimization approach for a char combustion process in a limited-data setting, where simulations of the fluid-solid coupled system are computationally expensive. We integrate a polynomial dimensional…

Optimization and Control · Mathematics 2025-03-11 Yulin Guo , Dongjin Lee , Boris Kramer

Prediction+optimization is a common real-world paradigm where we have to predict problem parameters before solving the optimization problem. However, the criteria by which the prediction model is trained are often inconsistent with the goal…

Machine Learning · Computer Science 2021-11-23 Kai Yan , Jie Yan , Chuan Luo , Liting Chen , Qingwei Lin , Dongmei Zhang

Projection-based model reduction is among the most widely adopted methods for constructing parametric Reduced-Order Models (ROM). Utilizing the snapshot data from solving full-order governing equations, the Proper Orthogonal Decomposition…

Machine Learning · Statistics 2025-09-16 Xiao Liu , Jingyi Feng , Xinchao Liu

Despite the recent progress in hyperparameter optimization (HPO), available benchmarks that resemble real-world scenarios consist of a few and very large problem instances that are expensive to solve. This blocks researchers and…

Machine Learning · Computer Science 2019-11-26 Aaron Klein , Zhenwen Dai , Frank Hutter , Neil Lawrence , Javier Gonzalez