English
Related papers

Related papers: Conservative Surrogate Models for Optimization wit…

200 papers

Active learning of Gaussian process (GP) surrogates has been useful for optimizing experimental designs for physical/computer simulation experiments, and for steering data acquisition schemes in machine learning. In this paper, we develop a…

Machine Learning · Computer Science 2025-09-10 Chiwoo Park , Robert Waelder , Bonggwon Kang , Benji Maruyama , Soondo Hong , Robert Gramacy

We propose a new uncertainty estimator for gradient-free optimisation of black-box simulators using deep generative surrogate models. Optimisation of these simulators is especially challenging for stochastic simulators and higher…

Machine Learning · Computer Science 2024-11-05 Tigran Ramazyan , Mikhail Hushchyn , Denis Derkach

Stochastic inverse problems are generally solved by some form of finite sampling of a space of uncertain parameters. For computationally expensive models, surrogate response surfaces are often employed to increase the number of samples used…

Numerical Analysis · Mathematics 2018-07-04 Steven Mattis , Barbara Wohlmuth

Bayesian optimization (BO) methods often rely on the assumption that the objective function is well-behaved, but in practice, this is seldom true for real-world objectives even if noise-free observations can be collected. Common approaches,…

Machine Learning · Statistics 2020-09-10 Erik Bodin , Markus Kaiser , Ieva Kazlauskaite , Zhenwen Dai , Neill D. F. Campbell , Carl Henrik Ek

Global sensitivity analysis of complex numerical simulators is often limited by the small number of model evaluations that can be afforded. In such settings, surrogate models built from a limited set of simulations can substantially reduce…

Machine Learning · Statistics 2026-01-21 Guerlain Lambert , Céline Helbert , Claire Lauvernet

This study introduces a non-intrusive approach in the context of low-rank separated representation to construct a surrogate of high-dimensional stochastic functions, e.g., PDEs/ODEs, in order to decrease the computational cost of Markov…

Data Analysis, Statistics and Probability · Physics 2013-12-25 AbdoulAhad Validi

Quantifying uncertainties in physical or engineering systems often requires a large number of simulations of the underlying computer models that are computationally intensive. Emulators or surrogate models are often used to accelerate the…

Methodology · Statistics 2021-11-11 Junda Xiong , Xin Cai , Jinglai Li

This paper considers the creation of parametric surrogate models for applications in science and engineering where the goal is to predict high-dimensional spatiotemporal output quantities of interest, such as pressure, temperature and…

Computational Physics · Physics 2022-03-24 Chi Hoang , Kenny Chowdhary , Kookjin Lee , Jaideep Ray

Injecting greenhouse gas into deep underground reservoirs for permanent storage can inadvertently lead to fault reactivation, caprock fracturing and greenhouse gas leakage when the injection-induced stress exceeds the critical threshold.…

Computational Engineering, Finance, and Science · Computer Science 2024-10-08 Jungang Chen , Eduardo Gildin , Georgy Kompantsev

In recent years, surrogate models have been successfully used in likelihood-free inference to decrease the number of simulator evaluations. The current state-of-the-art performance for this task has been achieved by Bayesian Optimization…

Machine Learning · Computer Science 2021-10-06 Alexander Aushev , Henri Pesonen , Markus Heinonen , Jukka Corander , Samuel Kaski

The design process of centrifugal compressors requires applying an optimization process which is computationally expensive due to complex analytical equations underlying the compressor's dynamical equations. Although the regression…

Machine Learning · Computer Science 2023-09-07 Shadi Ghiasi , Guido Pazzi , Concettina Del Grosso , Giovanni De Magistris , Giacomo Veneri

Bayesian Optimization is a popular tool for tuning algorithms in automatic machine learning (AutoML) systems. Current state-of-the-art methods leverage Random Forests or Gaussian processes to build a surrogate model that predicts algorithm…

Machine Learning · Computer Science 2021-01-08 Jeroen van Hoof , Joaquin Vanschoren

Gaussian processes (GPs) are widely used in nonparametric regression, classification and spatio-temporal modeling, motivated in part by a rich literature on theoretical properties. However, a well known drawback of GPs that limits their use…

Methodology · Statistics 2011-06-29 Anjishnu Banerjee , David Dunson , Surya Tokdar

By enabling constraint-aware online model adaptation, model predictive control using Gaussian process (GP) regression has exhibited impressive performance in real-world applications and received considerable attention in the learning-based…

Optimization and Control · Mathematics 2024-09-17 Amon Lahr , Andrea Zanelli , Andrea Carron , Melanie N. Zeilinger

Gaussian Processes are widely used for regression tasks. A known limitation in the application of Gaussian Processes to regression tasks is that the computation of the solution requires performing a matrix inversion. The solution also…

Machine Learning · Computer Science 2017-08-22 Sourish Das , Sasanka Roy , Rajiv Sambasivan

We develop a systematic approach for surrogate model construction in reduced input parameter spaces. A sparse set of model evaluations in the original input space is used to approximate derivative based global sensitivity measures (DGSMs)…

Applications · Statistics 2018-06-19 Manav Vohra , Alen Alexanderian , Cosmin Safta , Sankaran Mahadevan

In offline data-driven multi-objective optimization (MOO), optimization is performed using surrogate models trained only on an offline dataset. These surrogate models contain inherent errors and uncertainty. This epistemic uncertainty can…

Neural and Evolutionary Computing · Computer Science 2026-04-30 Huanbo Lyu , Miqing Li , Shiqiao Zhou , Daniel Herring , Jelena Ninic , Zheming Zuo , Lingfeng Wang , James Andrews , Fabian Spill , Shuo Wang

In the last few years, energy efficiency has become a challenge. Not only mitigating environmental impact but reducing energy waste can lead to financial advantages. Buildings play an important role in this: they are among the biggest…

Systems and Control · Electrical Eng. & Systems 2026-01-30 B. da Costa Paulo , N. Aginako , J. Ugartemendia , I. Landa del Barrio , M. Quartulli , H. Camblong

Predictive estimation, which comprises model calibration, model prediction, and validation, is a common objective when performing inverse uncertainty quantification (UQ) in diverse scientific applications. These techniques typically require…

Numerical Analysis · Mathematics 2024-07-17 Ningxin Yang , Truong Le , Lidija Zdravković , David M. Potts

Trajectory optimization methods for motion planning attempt to generate trajectories that minimize a suitable objective function. Such methods efficiently find solutions even for high degree-of-freedom robots. However, a globally optimal…

Robotics · Computer Science 2019-07-18 Luka Petrović , Juraj Peršić , Marija Seder , Ivan Marković