English
Related papers

Related papers: Sensitivity Analysis for Computationally Expensive…

200 papers

In many practical cases, a sensitivity analysis or an optimization of a complex time consuming computer code requires to build a fast running approximation of it - also called surrogate model. We consider in this paper the problem of…

Statistics Theory · Mathematics 2013-01-14 Loic Le Gratiet

Optimizing the reliability and the robustness of a design is important but often unaffordable due to high sample requirements. Surrogate models based on statistical and machine learning methods are used to increase the sample efficiency.…

Machine Learning · Statistics 2022-05-06 Can Bogoclu , Dirk Roos , Tamara Nestorović

Carefully designed activation functions can improve the performance of neural networks in many machine learning tasks. However, it is difficult for humans to construct optimal activation functions, and current activation function search…

Machine Learning · Computer Science 2023-11-10 Garrett Bingham , Risto Miikkulainen

Crystal plasticity models are a powerful tool for predicting the deformation behaviour of polycrystalline materials accounting for the underlying grain morphology and texture. These models typically have a large number of parameters, an…

Materials Science · Physics 2023-12-20 Hugh Dorward , David M. Knowles , Eralp Demir , Mahmoud Mostafavi , Matthew J. Peel

In uncertainty quantification, variance-based global sensitivity analysis quantitatively determines the effect of each input random variable on the output by partitioning the total output variance into contributions from each input.…

Numerical Analysis · Mathematics 2024-05-28 Dongjin Lee , Elle Lavichant , Boris Kramer

Gaussian process surrogates are a popular alternative to directly using computationally expensive simulation models. When the simulation output consists of many responses, dimension-reduction techniques are often employed to construct these…

Methodology · Statistics 2023-05-04 Moses Y-H. Chan , Matthew Plumlee , Stefan M. Wild

Prediction+optimization is a common real-world paradigm where we have to predict problem parameters before solving the optimization problem. However, the criteria by which the prediction model is trained are often inconsistent with the goal…

Machine Learning · Computer Science 2021-11-23 Kai Yan , Jie Yan , Chuan Luo , Liting Chen , Qingwei Lin , Dongmei Zhang

The optimization of large-scale multibody systems is a numerically challenging task, in particular when considering multiple conflicting criteria at the same time. In this situation, we need to approximate the Pareto set of optimal…

Optimization and Control · Mathematics 2024-12-20 Augustina C. Amakor , Manuel B. Berkemeier , Meike Wohlleben , Walter Sextro , Sebastian Peitz

The optimization of algorithm (hyper-)parameters is crucial for achieving peak performance across a wide range of domains, ranging from deep neural networks to solvers for hard combinatorial problems. The resulting algorithm configuration…

Artificial Intelligence · Computer Science 2017-03-31 Katharina Eggensperger , Marius Lindauer , Holger H. Hoos , Frank Hutter , Kevin Leyton-Brown

The optimization of high dimensional functions is a key issue in engineering problems but it frequently comes at a cost that is not acceptable since it usually involves a complex and expensive computer code. Engineers often overcome this…

Machine Learning · Statistics 2019-06-18 Adrien Spagnol , Rodolphe Le Riche , Sebastien Da Veiga

Various frameworks have been proposed to predict mechanical system responses by combining data from different fidelities for design optimization and uncertainty quantification as reviewed by Fern\'andez-Godino et al. and Peherstorfer et…

Data Analysis, Statistics and Probability · Physics 2017-05-09 Yiming Zhang , Nam-Ho Kim , Chanyoung Park , Raphael T. Haftka

This paper presents a novel methodology that uses surrogate models in the form of neural networks to reduce the computation time of simulation-based optimization of a reference trajectory. Simulation-based optimization is necessary when…

Optimization and Control · Mathematics 2023-03-31 Evelyn Ruff , Rebecca Russell , Matthew Stoeckle , Piero Miotto , Jonathan P. How

We present an adaptive approach to the construction of Gaussian process surrogates for Bayesian inference with expensive-to-evaluate forward models. Our method relies on the fully Bayesian approach to training Gaussian process models and…

Machine Learning · Statistics 2018-10-01 Timur Takhtaganov , Juliane Müller

We tackle the problem of quantifying failure probabilities for expensive deterministic computer experiments with stochastic inputs under a fixed budget. The computational cost of the computer simulation prohibits direct Monte Carlo (MC) and…

Methodology · Statistics 2025-07-08 Annie S. Booth , S. Ashwin Renganathan

The computational burden of running a complex computer model can make optimization impractical. Gaussian Processes (GPs) are statistical surrogates (also known as emulators) that alleviate this issue since they cheaply replace the computer…

Computation · Statistics 2019-09-11 Theodoros Mathikolonis , Serge Guillas

Many fields of science and engineering rely on running simulations with complex and computationally expensive models to understand the involved processes in the system of interest. Nevertheless, the high cost involved hamper reliable and…

Machine Learning · Computer Science 2019-12-16 Daniel Heestermans Svendsen , Luca Martino , Gustau Camps-Valls

In reliability engineering, conventional surrogate models encounter the "curse of dimensionality" as the number of random variables increases. While the active learning Kriging surrogate approaches with high-dimensional model representation…

Machine Learning · Computer Science 2025-09-10 Wenxiong Li , Hanyu Liao , Suiyin Chen

We present an algorithm for multi-objective optimization of computationally expensive problems. The proposed algorithm is based on solving a set of surrogate problems defined by models of the real one, so that only solutions estimated to be…

Neural and Evolutionary Computing · Computer Science 2021-04-20 Santiago Cuervo , Miguel Melgarejo , Angie Blanco-Cañon , Laura Reyes-Fajardo , Sergio Rojas-Galeano

Bayesian model selection provides a natural alternative to classical hypothesis testing based on p-values. While many papers mention that Bayesian model selection is frequently sensitive to prior specification on the parameters, there are…

Methodology · Statistics 2024-02-27 Christopher T. Franck , Robert B. Gramacy

The increasing use of stochastic models for describing complex phenomena warrants surrogate models that capture the reference model characteristics at a fraction of the computational cost, foregoing potentially expensive Monte Carlo…

Machine Learning · Computer Science 2024-06-10 Neil Kichler , Sher Afghan , Uwe Naumann