English
Related papers

Related papers: Variational Inference with NoFAS: Normalizing Flow…

200 papers

The increasing use of stochastic models for describing complex phenomena warrants surrogate models that capture the reference model characteristics at a fraction of the computational cost, foregoing potentially expensive Monte Carlo…

Machine Learning · Computer Science 2024-06-10 Neil Kichler , Sher Afghan , Uwe Naumann

We present a hybrid sampling-surrogate approach for reducing the computational expense of uncertainty quantification in nonlinear dynamical systems. Our motivation is to enable rapid uncertainty quantification in complex mechanical systems…

Computation · Statistics 2022-01-27 Hang Yang , Yuji Fujii , K. W. Wang , Alex A. Gorodetsky

Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimization under uncertainty can be computationally expensive. In this paper, we present a novel…

Machine Learning · Computer Science 2025-10-09 Akash Yadav , Ruda Zhang

The embedded ensemble propagation approach introduced in [49] has been demonstrated to be a powerful means of reducing the computational cost of sampling-based uncertainty quantification methods, particularly on emerging computational…

Computation · Statistics 2017-05-08 Marta D'Elia , Eric Phipps , Ahmad Rushdi , Mohamed Ebeida

Our paper deals with inferring simulator-based statistical models given some observed data. A simulator-based model is a parametrized mechanism which specifies how data are generated. It is thus also referred to as generative model. We…

Machine Learning · Statistics 2016-01-01 Michael U. Gutmann , Jukka Corander

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

Predictive estimation, which comprises model calibration, model prediction, and validation, is a common objective when performing inverse uncertainty quantification (UQ) in diverse scientific applications. These techniques typically require…

Numerical Analysis · Mathematics 2024-07-17 Ningxin Yang , Truong Le , Lidija Zdravković , David M. Potts

High-fidelity models are essential for accurately capturing nonlinear system dynamics. However, simulation of these models is often computationally too expensive and, due to their complexity, they are not directly suitable for analysis,…

Systems and Control · Electrical Eng. & Systems 2025-09-05 E. Javier Olucha , Rajiv Singh , Amritam Das , Roland Tóth

In the gravitational-wave analysis of pulsar-timing-array datasets, parameter estimation is usually performed using Markov Chain Monte Carlo methods to explore posterior probability densities. We introduce an alternative procedure that…

General Relativity and Quantum Cosmology · Physics 2024-05-16 Michele Vallisneri , Marco Crisostomi , Aaron D. Johnson , Patrick M. Meyers

We introduce the concept of decision-focused surrogate modeling for solving computationally challenging nonlinear optimization problems in real-time settings. The proposed data-driven framework seeks to learn a simpler, e.g. convex,…

Optimization and Control · Mathematics 2023-12-27 Rishabh Gupta , Qi Zhang

Simulation models are widely used in practice to facilitate decision-making in a complex, dynamic and stochastic environment. But they are computationally expensive to execute and optimize, due to lack of analytical tractability. Simulation…

Optimization and Control · Mathematics 2021-06-14 L. Jeff Hong , Xiaowei Zhang

Natural gradient methods have been used to optimise the parameters of probability distributions in a variety of settings, often resulting in fast-converging procedures. Unfortunately, for many distributions of interest, computing the…

Machine Learning · Statistics 2024-05-28 Jonathan So , Richard E. Turner

We introduce a conditional pseudo-reversible normalizing flow for constructing surrogate models of a physical model polluted by additive noise to efficiently quantify forward and inverse uncertainty propagation. Existing surrogate modeling…

Machine Learning · Computer Science 2024-04-02 Minglei Yang , Pengjun Wang , Ming Fan , Dan Lu , Yanzhao Cao , Guannan Zhang

Inverse modeling for computing a high-dimensional spatially-varying property field from indirect sparse and noisy observations is a challenging problem. This is due to the complex physical system of interest often expressed in the form of…

Computational Physics · Physics 2021-02-22 Govinda Anantha Padmanabha , Nicholas Zabaras

Discrete normalizing flows are promising generative models with advantages such as analytical log-likelihood computation and end-to-end training. However, the architectural constraints to ensure invertibility and tractable Jacobian…

Machine Learning · Computer Science 2026-05-06 Jiaru Zhang , Juanwu Lu , Xiaoyu Wu , Ziran Wang , Ruqi Zhang

In numerous applications, surrogate models are used as a replacement for accurate parameter-to-observable mappings when solving large-scale inverse problems governed by partial differential equations (PDEs). The surrogate model may be a…

Optimization and Control · Mathematics 2025-12-08 Ruanui Nicholson , Radoslav Vuchkov , Umberto Villa , Noemi Petra

We propose a multi-fidelity neural network surrogate sampling method for the uncertainty quantification of physical/biological systems described by ordinary or partial differential equations. We first generate a set of low/high-fidelity…

Numerical Analysis · Mathematics 2020-05-07 Mohammad Motamed

In engineering design and scientific computing, computational cost and predictive accuracy are intrinsically coupled. High-fidelity simulations provide accurate predictions but at substantial computational costs, while lower-fidelity…

Machine Learning · Computer Science 2026-05-11 Ahmed Mohamed Eisa Nasr , Ali Elham , Haris Moazam Sheikh

Normalizing flow (NF) has gained popularity over traditional maximum likelihood based methods due to its strong capability to model complex data distributions. However, the standard approach, which maps the observed data to a normal…

Machine Learning · Computer Science 2022-11-22 Hanze Dong , Shizhe Diao , Weizhong Zhang , Tong Zhang

In the quest for advanced propulsion and power-generation systems, high-fidelity simulations are too computationally expensive to survey the desired design space, and a new design methodology is needed that combines engineering physics,…