English
Related papers

Related papers: Dimensionality reduction can be used as a surrogat…

200 papers

Scientists and engineers rely on accurate mathematical models to quantify the objects of their studies, which are often high-dimensional. Unfortunately, high-dimensional models are inherently difficult, i.e. when observations are sparse or…

Machine Learning · Computer Science 2018-02-13 Robert A. Bridges , Chris Felder , Chelsey Hoff

In many mechanistic medical, biological, physical and engineered spatiotemporal dynamic models the numerical solution of partial differential equations (PDEs) can make simulations impractically slow. Biological models require the…

Soft Condensed Matter · Physics 2021-02-11 J. Quetzalcóatl Toledo-Marín , Geoffrey Fox , James P. Sluka , James A. Glazier

Stochastic simulators are non-deterministic computer models which provide a different response each time they are run, even when the input parameters are held at fixed values. They arise when additional sources of uncertainty are affecting…

Computation · Statistics 2023-02-01 Nora Lüthen , Stefano Marelli , Bruno Sudret

To address the challenges of reliability analysis in high-dimensional probability spaces, this paper proposes a new metamodeling method that couples active subspace, heteroscedastic Gaussian process, and active learning. The active subspace…

Applications · Statistics 2024-04-11 Jungho Kim , Ziqi Wang , Junho Song

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

Numerical Analysis · Mathematics 2022-08-12 Maarten V. de Hoop , Daniel Zhengyu Huang , Elizabeth Qian , Andrew M. Stuart

Reliability-based design optimization (RBDO) is traditionally formulated as a nested optimization and reliability problem. Although surrogate models are generally employed to improve efficiency, the approach remains computationally…

Computation · Statistics 2026-04-08 M. Moustapha , B. Sudret

In applications involving ordinal predictors, common approaches to reduce dimensionality are either extensions of unsupervised techniques such as principal component analysis, or variable selection procedures that rely on modeling the…

Statistics Theory · Mathematics 2017-10-13 Liliana Forzani , Rodrigo García Arancibia , Pamela Llop , Diego Tomassi

We develop a probabilistic machine learning method, which formulates a class of stochastic neural networks by a stochastic optimal control problem. An efficient stochastic gradient descent algorithm is introduced under the stochastic…

Machine Learning · Computer Science 2021-04-06 Richard Archibald , Feng Bao , Yanzhao Cao , He Zhang

We propose a general framework for machine learning based optimization under uncertainty. Our approach replaces the complex forward model by a surrogate, which is learned simultaneously in a one-shot sense when solving the optimal control…

Optimization and Control · Mathematics 2023-12-25 Philipp A. Guth , Claudia Schillings , Simon Weissmann

The quantification of uncertainties of computer simulations due to input parameter uncertainties is paramount to assess a model's credibility. For computationally expensive simulations, this is often feasible only via surrogate models that…

Methodology · Statistics 2021-08-30 Sascha Ranftl , Wolfgang von der Linden

Stochastic differential equations have been an important tool in modeling complex financial relations, equipped with the possibility of being multidimensional to better oversee complexities inherent in finance. This multidimensionality,…

Mathematical Finance · Quantitative Finance 2025-08-22 Ahmet Umur Özsoy

AI-driven surrogate modeling has become an increasingly effective alternative to physics-based simulations for 3D design, analysis, and manufacturing. These models leverage data-driven methods to predict physical quantities traditionally…

Machine Learning · Computer Science 2025-05-06 Yu-hsuan Chen , Jing Bi , Cyril Ngo Ngoc , Victor Oancea , Jonathan Cagan , Levent Burak Kara

The Linear Parameter-Varying (LPV) framework enables the construction of surrogate models of complex nonlinear and high-dimensional systems, facilitating efficient stability and performance analysis together with controller design. Despite…

Systems and Control · Electrical Eng. & Systems 2026-04-01 E. Javier Olucha , Valentin Preda , Amritam Das , Roland Tóth

This paper introduces a novel two-stage machine learning-based surrogate modeling framework to address inverse problems in scientific and engineering fields. In the first stage of the proposed framework, a machine learning model termed the…

Machine Learning · Computer Science 2024-01-05 Farhad Pourkamali-Anaraki , Jamal F. Husseini , Evan J. Pineda , Brett A. Bednarcyk , Scott E. Stapleton

In recent decades, the main focus of computer modeling has been on supporting the design and development of engineering prototyes, but it is now ubiquitous in non-traditional areas such as medical rehabilitation. Conventional modeling…

Machine Learning · Computer Science 2024-09-13 Jonas Kneifl , David Rosin , Oliver Röhrle , Jörg Fehr

The construction of efficient methods for uncertainty quantification in kinetic equations represents a challenge due to the high dimensionality of the models: often the computational costs involved become prohibitive. On the other hand,…

Numerical Analysis · Mathematics 2021-12-03 Giacomo Dimarco , Liu Liu , Lorenzo Pareschi , Xueyu Zhu

Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimization under uncertainty can be computationally expensive. In this paper, we present a novel…

Machine Learning · Computer Science 2025-10-09 Akash Yadav , Ruda Zhang

To date, the analysis of high-dimensional, computationally expensive engineering models remains a difficult challenge in risk and reliability engineering. We use a combination of dimensionality reduction and surrogate modelling termed…

Computation · Statistics 2022-06-20 Max Ehre , Iason Papaioannou , Bruno Sudret , Daniel Straub

Sufficient dimension reduction is a powerful tool to extract core information hidden in the high-dimensional data and has potentially many important applications in machine learning tasks. However, the existing nonlinear sufficient…

Machine Learning · Computer Science 2022-10-11 Siqi Liang , Yan Sun , Faming Liang

The present paper proposes a Bayesian framework for inverse problems that seamlessly integrates optimization and inversion to enable rapid surrogate modeling, accurate parameter inference, and rigorous uncertainty quantification. Bayesian…

Computational Engineering, Finance, and Science · Computer Science 2026-02-05 Mihaela Chiappetta , Massimo Carraturo , Alexander Raßloff , Markus Kästner , Ferdinando Auricchio