English
Related papers

Related papers: Which Surrogate Works for Empirical Performance Mo…

200 papers

Numerical simulations in climate, chemistry, or astrophysics are computationally too expensive for uncertainty quantification or parameter-exploration at high-resolution. Reduced-order or surrogate models are multiple orders of magnitude…

Machine Learning · Computer Science 2022-07-26 Björn Lütjens , Catherine H. Crawford , Campbell D Watson , Christopher Hill , Dava Newman

Portfolio optimisation is a multi-objective optimisation problem (MOP), where an investor aims to optimise the conflicting criteria of maximising a portfolio's expected return whilst minimising its risk and other costs. However, selecting a…

Computational Engineering, Finance, and Science · Computer Science 2021-07-06 Terence van Zyl , Matthew Woolway , Andrew Paskaramoorthy

We consider minimizing functions for which it is expensive to compute the (possibly stochastic) gradient. Such functions are prevalent in reinforcement learning, imitation learning and adversarial training. Our target optimization framework…

Machine Learning · Computer Science 2023-06-09 Jonathan Wilder Lavington , Sharan Vaswani , Reza Babanezhad , Mark Schmidt , Nicolas Le Roux

During the design process of an autonomous underwater vehicle (AUV), the pressure vessel has a critical role. The pressure vessel contains dry electronics, power sources, and other sensors that can not be flooded. A traditional design…

Machine Learning · Computer Science 2022-07-12 Harsh Vardhan , Janos Sztipanovits

Recent developments of advanced driver-assistance systems necessitate an increasing number of tests to validate new technologies. These tests cannot be carried out on track in a reasonable amount of time and automotive groups rely on…

Machine Learning · Statistics 2022-12-16 Clara Carlier , Arnaud Franju , Matthieu Lerasle , Mathias Obrebski

This study presents a methodology to treat performance-based seismic design as an inverse engineering problem, where design parameters are directly derived to achieve specific performance objectives. By implementing explainable machine…

Machine Learning · Computer Science 2025-08-04 Mohsen Zaker Esteghamati

Many applications in machine learning require optimizing a function whose true gradient is unknown, but where surrogate gradient information (directions that may be correlated with, but not necessarily identical to, the true gradient) is…

Neural and Evolutionary Computing · Computer Science 2019-06-12 Niru Maheswaranathan , Luke Metz , George Tucker , Dami Choi , Jascha Sohl-Dickstein

With the development of artificial intelligence, simulation-based optimization problems, which present a significant challenge in the process systems engineering community, are increasingly being addressed with the surrogate-based…

Optimization and Control · Mathematics 2025-01-30 Zixuan Zhang , Xiaowei Song , Yujiao Zeng , Jie Li , Yaling Nie , Min Zhu , Jianhua Chen , Linmin Wang , Xin Xiao

The optimization of large-scale multibody systems is a numerically challenging task, in particular when considering multiple conflicting criteria at the same time. In this situation, we need to approximate the Pareto set of optimal…

Optimization and Control · Mathematics 2024-12-20 Augustina C. Amakor , Manuel B. Berkemeier , Meike Wohlleben , Walter Sextro , Sebastian Peitz

Recently, neural surrogate models have emerged as a compelling alternative to traditional simulation workflows. This is accomplished by modeling the underlying function of scientific simulations, removing the need to run expensive…

Machine Learning · Computer Science 2025-08-19 Xiaohan Wang , Zhimin Li , Joshua A. Levine , Matthew Berger

The present paper proposes a Bayesian framework for inverse problems that seamlessly integrates optimization and inversion to enable rapid surrogate modeling, accurate parameter inference, and rigorous uncertainty quantification. Bayesian…

Computational Engineering, Finance, and Science · Computer Science 2026-02-05 Mihaela Chiappetta , Massimo Carraturo , Alexander Raßloff , Markus Kästner , Ferdinando Auricchio

We consider a class of stochastic programming problems where the implicitly decision-dependent random variable follows a nonparametric regression model with heteroscedastic error. The Clarke subdifferential and surrogate functions are not…

Optimization and Control · Mathematics 2025-05-13 Boyang Shen , Junyi Liu

A machine-learning-based framework for modeling the error introduced by surrogate models of parameterized dynamical systems is proposed. The framework entails the use of high-dimensional regression techniques (e.g., random forests, LASSO)…

Numerical Analysis · Computer Science 2017-06-02 Sumeet Trehan , Kevin Carlberg , Louis J. Durlofsky

This study introduces a non-intrusive approach in the context of low-rank separated representation to construct a surrogate of high-dimensional stochastic functions, e.g., PDEs/ODEs, in order to decrease the computational cost of Markov…

Data Analysis, Statistics and Probability · Physics 2013-12-25 AbdoulAhad Validi

Understanding structure-property relations is essential to optimally design materials for specific applications. Two-scale simulations are often employed to analyze the effect of the microstructure on a component's macroscopic properties.…

Computational Engineering, Finance, and Science · Computer Science 2022-10-25 Theron Guo , Francesco A. B. Silva , Ondřej Rokoš , Karen Veroy

Existing deep learning-based surrogate models facilitate efficient data generation, but fall short in uncertainty quantification, efficient parameter space exploration, and reverse prediction. In our work, we introduce SurroFlow, a novel…

Machine Learning · Computer Science 2024-07-19 Jingyi Shen , Yuhan Duan , Han-Wei Shen

We present a framework for automatically structuring and training fast, approximate, deep neural surrogates of stochastic simulators. Unlike traditional approaches to surrogate modeling, our surrogates retain the interpretable structure and…

This chapter deals with kernel methods as a special class of techniques for surrogate modeling. Kernel methods have proven to be efficient in machine learning, pattern recognition and signal analysis due to their flexibility, excellent…

Numerical Analysis · Mathematics 2022-10-31 Gabriele Santin , Bernard Haasdonk

High-fidelity numerical simulations of partial differential equations (PDEs) given a restricted computational budget can significantly limit the number of parameter configurations considered and/or time window evaluated for modeling a given…

Machine Learning · Computer Science 2023-09-04 Paolo Conti , Mengwu Guo , Andrea Manzoni , Attilio Frangi , Steven L. Brunton , J. Nathan Kutz

Surrogate-based optimization relies on so-called infill criteria (acquisition functions) to decide which point to evaluate next. When Kriging is used as the surrogate model of choice (also called Bayesian optimization), one of the most…

Neural and Evolutionary Computing · Computer Science 2020-02-18 Frederik Rehbach , Martin Zaefferer , Boris Naujoks , Thomas Bartz-Beielstein