English
Related papers

Related papers: Composing Normalizing Flows for Inverse Problems

200 papers

Inverse problems involve making inference about unknown parameters of a physical process using observational data. This paper investigates an important class of inverse problems -- the estimation of the initial condition of a…

Methodology · Statistics 2023-02-09 Xiao Liu , Kyongmin Yeo

Uncertainty quantification provides quantitative measures on the reliability of candidate solutions of ill-posed inverse problems. Due to their sequential nature, Monte Carlo sampling methods require large numbers of sampling steps for…

Geophysics · Physics 2021-04-14 Ali Siahkoohi , Felix J. Herrmann

Inverse problems, i.e., estimating parameters of physical models from experimental data, are ubiquitous in science and engineering. The Bayesian formulation is the gold standard because it alleviates ill-posedness issues and quantifies…

Machine Learning · Statistics 2024-05-28 Sharmila Karumuri , Ilias Bilionis

Normalizing flows are a powerful class of generative models demonstrating strong performance in several speech and vision problems. In contrast to other generative models, normalizing flows are latent variable models with tractable…

Machine Learning · Computer Science 2021-08-06 Dmitry Baranchuk , Vladimir Aliev , Artem Babenko

Inverse problems aim to determine parameters from observations, a crucial task in engineering and science. Lately, generative models, especially diffusion models, have gained popularity in this area for their ability to produce realistic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Gabriel della Maggiora , Luis Alberto Croquevielle , Nikita Deshpande , Harry Horsley , Thomas Heinis , Artur Yakimovich

The need to blend observational data and mathematical models arises in many applications and leads naturally to inverse problems. Parameters appearing in the model, such as constitutive tensors, initial conditions, boundary conditions, and…

Statistics Theory · Mathematics 2010-09-16 J. Nolen , G. A. Pavliotis , A. M. Stuart

The efficient resolution of Bayesian inverse problems remains challenging due to the high computational cost of traditional sampling methods. In this paper, we propose a novel framework that integrates Conditional Flow Matching (CFM) with a…

Machine Learning · Computer Science 2025-05-20 Daniil Sherki , Ivan Oseledets , Ekaterina Muravleva

We introduce a conditional pseudo-reversible normalizing flow for constructing surrogate models of a physical model polluted by additive noise to efficiently quantify forward and inverse uncertainty propagation. Existing surrogate modeling…

Machine Learning · Computer Science 2024-04-02 Minglei Yang , Pengjun Wang , Ming Fan , Dan Lu , Yanzhao Cao , Guannan Zhang

A Normalizing Flow computes a bijective mapping from an arbitrary distribution to a predefined (e.g. normal) distribution. Such a flow can be used to address different tasks, e.g. anomaly detection, once such a mapping has been learned. In…

Quantum Physics · Physics 2024-07-23 Bodo Rosenhahn , Christoph Hirche

Inverse problems of partial differential equations are ubiquitous across various scientific disciplines and can be formulated as statistical inference problems using Bayes' theorem. To address large-scale problems, it is crucial to develop…

Numerical Analysis · Mathematics 2025-12-23 Yang Zhao , Haoyu Lu , Junxiong Jia , Tao Zhou

Flow-based generative modeling is a powerful tool for solving inverse problems in physical sciences that can be used for sampling and likelihood evaluation with much lower inference times than traditional methods. We propose to refine flows…

Machine Learning · Computer Science 2024-10-31 Benjamin Holzschuh , Nils Thuerey

Normalizing Flows are generative models that directly maximize the likelihood. Previously, the design of normalizing flows was largely constrained by the need for analytical invertibility. We overcome this constraint by a training procedure…

Machine Learning · Computer Science 2024-04-25 Felix Draxler , Peter Sorrenson , Lea Zimmermann , Armand Rousselot , Ullrich Köthe

In this study, we address causal inference when only observational data and a valid causal ordering from the causal graph are available. We introduce a set of flow models that can recover component-wise, invertible transformation of…

Machine Learning · Computer Science 2024-12-16 Minh Khoa Le , Kien Do , Truyen Tran

Bayesian posterior inference is prevalent in various machine learning problems. Variational inference provides one way to approximate the posterior distribution, however its expressive power is limited and so is the accuracy of resulting…

Machine Learning · Computer Science 2018-07-11 Guoqing Zheng , Yiming Yang , Jaime Carbonell

Foundation models have demonstrated remarkable performance across modalities such as language and vision. However, model reuse across distinct modalities (e.g., text and vision) remains limited due to the difficulty of aligning internal…

Machine Learning · Computer Science 2025-05-20 Ali Gholamzadeh , Noor Sajid

Inverse problems, which involve estimating parameters from incomplete or noisy observations, arise in various fields such as medical imaging, geophysics, and signal processing. These problems are often ill-posed, requiring regularization…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Shadab Ahamed , Eldad Haber

I describe a trick for training flow models using a prescribed rule as a surrogate for maximum likelihood. The utility of this trick is limited for non-conditional models, but an extension of the approach, applied to maximum likelihood of…

Machine Learning · Computer Science 2022-08-26 John S. Hyatt

Flow-based generative models have recently shown impressive performance for conditional generation tasks, such as text-to-image generation. However, current methods transform a general unimodal noise distribution to a specific mode of the…

Machine Learning · Computer Science 2025-02-14 Noam Issachar , Mohammad Salama , Raanan Fattal , Sagie Benaim

Two apparently unrelated fields -- normalizing flows and causality -- have recently received considerable attention in the machine learning community. In this work, we highlight an intrinsic correspondence between a simple family of…

Machine Learning · Statistics 2021-02-25 Ilyes Khemakhem , Ricardo Pio Monti , Robert Leech , Aapo Hyvärinen

The unsupervised task of aligning two or more distributions in a shared latent space has many applications including fair representations, batch effect mitigation, and unsupervised domain adaptation. Existing flow-based approaches estimate…

Machine Learning · Computer Science 2022-03-17 Zeyu Zhou , Ziyu Gong , Pradeep Ravikumar , David I. Inouye