English
Related papers

Related papers: Deep active subspaces - a scalable method for high…

200 papers

The development of a reliable and robust surrogate model is often constrained by the dimensionality of the problem. For a system with high-dimensional inputs/outputs (I/O), conventional approaches usually use a low-dimensional manifold to…

Image and Video Processing · Electrical Eng. & Systems 2020-10-01 Xihaier Luo , Ahsan Kareem

With computational models becoming more expensive and complex, surrogate models have gained increasing attention in many scientific disciplines and are often necessary to conduct sensitivity studies, parameter optimization etc. In the…

Methodology · Statistics 2023-07-24 Matthias Fischer , Carsten Proppe

This paper addresses uncertainty quantification (UQ) for problems where scalar (or low-dimensional vector) response quantities are insufficient and, instead, full-field (very high-dimensional) responses are of interest. To do so, an…

Probability · Mathematics 2018-04-18 D. G Giovanis , M. D. Shields

We present a distributed active subspace method for training surrogate models of complex physical processes with high-dimensional inputs and function valued outputs. Specifically, we represent the model output with a truncated…

Computational Physics · Physics 2019-08-09 Hayley Guy , Alen Alexanderian , Meilin Yu

Deep Gaussian processes (DGPs) are increasingly popular as predictive models in machine learning (ML) for their non-stationary flexibility and ability to cope with abrupt regime changes in training data. Here we explore DGPs as surrogates…

Methodology · Statistics 2021-08-27 Annie Sauer , Robert B. Gramacy , David Higdon

In this work we introduce a manifold learning-based method for uncertainty quantification (UQ) in systems describing complex spatiotemporal processes. Our first objective is to identify the embedding of a set of high-dimensional data…

Data Analysis, Statistics and Probability · Physics 2022-05-18 Katiana Kontolati , Dimitrios Loukrezis , Ketson R. M. dos Santos , Dimitrios G. Giovanis , Michael D. Shields

Uncertainty quantification (UQ) plays a pivotal role in scientific machine learning, especially when surrogate models are used to approximate complex systems. Although multilayer perceptions (MLPs) are commonly employed as surrogates, they…

Numerical Analysis · Mathematics 2025-01-22 Zhiwei Gao , George Em Karniadakis

The prohibitive cost of performing Uncertainty Quantification (UQ) tasks with a very large number of input parameters can be addressed, if the response exhibits some special structure that can be discovered and exploited. Several physical…

Computational Physics · Physics 2016-02-16 Ilias Bilionis , Rohit Tripathy , Marcial Gonzalez

High-performance scientific simulations, important for comprehension of complex systems, encounter computational challenges especially when exploring extensive parameter spaces. There has been an increasing interest in developing deep…

Machine Learning · Computer Science 2024-07-15 Pradeep Bajracharya , Javier Quetzalcóatl Toledo-Marín , Geoffrey Fox , Shantenu Jha , Linwei Wang

Surrogate models provide a low computational cost alternative to evaluating expensive functions. The construction of accurate surrogate models with large numbers of independent variables is currently prohibitive because it requires a large…

Machine Learning · Computer Science 2017-08-10 Mohamed Amine Bouhlel , Joaquim R. R. A. Martins

High-fidelity numerical simulations of chaotic, high dimensional nonlinear dynamical systems are computationally expensive, necessitating the development of efficient surrogate models. Most surrogate models for such systems are…

Machine Learning · Computer Science 2026-03-16 Dibyajyoti Chakraborty , Hojin Kim , Romit Maulik

We propose an algorithmic framework, that employs active subspace techniques, for scalable global optimization of functions with low effective dimension (also referred to as low-rank functions). This proposal replaces the original…

Optimization and Control · Mathematics 2024-02-01 Coralia Cartis , Xinzhu Liang , Estelle Massart , Adilet Otemissov

We present a probabilistic deep learning methodology that enables the construction of predictive data-driven surrogates for stochastic systems. Leveraging recent advances in variational inference with implicit distributions, we put forth a…

Machine Learning · Statistics 2019-01-16 Yibo Yang , Paris Perdikaris

Inverse problems play a key role in modern image/signal processing methods. However, since they are generally ill-conditioned or ill-posed due to lack of observations, their solutions may have significant intrinsic uncertainty. Analysing…

Signal Processing · Electrical Eng. & Systems 2019-09-09 Xiaohao Cai , Marcelo Pereyra , Jason D. McEwen

Uncertainty quantification (UQ) in deep learning regression is of wide interest, as it supports critical applications including sequential decision making and risk-sensitive tasks. In heteroskedastic regression, where the uncertainty of the…

Machine Learning · Computer Science 2026-03-03 Mikkel Jordahn , Jonas Vestergaard Jensen , James Harrison , Michael Riis Andersen , Mikkel N. Schmidt

Deep generative models have been accelerating the inverse design process in material and drug design. Unlike their counterpart property predictors in typical molecular design frameworks, generative molecular design models have seen fewer…

Machine Learning · Computer Science 2024-11-06 A N M Nafiz Abeer , Sanket Jantre , Nathan M Urban , Byung-Jun Yoon

We propose a new uncertainty estimator for gradient-free optimisation of black-box simulators using deep generative surrogate models. Optimisation of these simulators is especially challenging for stochastic simulators and higher…

Machine Learning · Computer Science 2024-11-05 Tigran Ramazyan , Mikhail Hushchyn , Denis Derkach

In recent years, active subspace methods (ASMs) have become a popular means of performing subspace sensitivity analysis on black-box functions. Naively applied, however, ASMs require gradient evaluations of the target function. In the event…

Machine Learning · Statistics 2020-09-22 Nathan Wycoff , Mickael Binois , Stefan M. Wild

Surrogate strategies are used widely for uncertainty quantification of groundwater models in order to improve computational efficiency. However, their application to dynamic multiphase flow problems is hindered by the curse of…

Machine Learning · Statistics 2019-05-02 Shaoxing Mo , Yinhao Zhu , Nicholas Zabaras , Xiaoqing Shi , Jichun Wu

Image-based computational fluid dynamics (CFD) modeling enables derivation of hemodynamic information, which has become a paradigm in cardiovascular research and healthcare. Nonetheless, the predictive accuracy largely depends on precisely…

Fluid Dynamics · Physics 2021-07-20 Han Gao , Xueyu Zhu , Jian-Xun Wang