English
Related papers

Related papers: Functional normalizing flow for statistical invers…

200 papers

The well-known discrete Fourier transform (DFT) can easily be generalized to arbitrary nodes in the spatial domain. The fast procedure for this generalization is referred to as nonequispaced fast Fourier transform (NFFT). Various…

Numerical Analysis · Mathematics 2025-06-09 Melanie Kircheis , Daniel Potts

We consider the efficient inference of finite dimensional parameters arising in the context of inverse problems. Our setup is the observation of a transformation of an unknown infinite dimensional signal $f$ corrupted by statistical noise,…

Statistics Theory · Mathematics 2026-02-03 Adel Magra , Aad van der Vaart

Diffusion models have emerged as powerful generative tools with applications in computer vision and scientific machine learning (SciML), where they have been used to solve large-scale probabilistic inverse problems. Traditionally, these…

Existing deterministic variational inference approaches for diffusion processes use simple proposals and target the marginal density of the posterior. We construct the variational process as a controlled version of the prior process and…

Machine Learning · Computer Science 2021-03-02 Christian Wildner , Heinz Koeppl

For numerous parameter and state estimation problems, assimilating new data as they become available can help produce accurate and fast inference of unknown quantities. While most existing algorithms for solving those kind of ill-posed…

Numerical Analysis · Mathematics 2022-07-28 Neil K. Chada , Marco A. Iglesias , Shuai Lu , Frank Werner

Flow matching is a recent state-of-the-art framework for generative modeling based on ordinary differential equations (ODEs). While closely related to diffusion models, it provides a more general perspective on generative modeling. Although…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jeongsol Kim , Bryan Sangwoo Kim , Jong Chul Ye

Gaussian Process Regression (GPR) is a powerful tool for nonparametric regression, but its application in a fully Bayesian fashion in high-dimensional settings is hindered by two primary challenges: the difficulty of variable selection and…

Methodology · Statistics 2025-11-11 Peter Knaus

This paper studies the inverse problem of flow matching (FM) between distributions with finite exponential moment, a problem motivated by modern generative AI applications such as the distillation of flow matching models. Uniqueness of the…

Machine Learning · Computer Science 2025-12-30 Alexander Korotin , Gudmund Pammer

Continuous normalizing flows (CNFs) construct invertible mappings between an arbitrary complex distribution and an isotropic Gaussian distribution using Neural Ordinary Differential Equations (neural ODEs). It has not been tractable on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shian Du , Yihong Luo , Wei Chen , Jian Xu , Delu Zeng

This paper presents a novel non-Gaussian inference algorithm, Normalizing Flow iSAM (NF-iSAM), for solving SLAM problems with non-Gaussian factors and/or non-linear measurement models. NF-iSAM exploits the expressive power of neural…

Robotics · Computer Science 2021-05-12 Qiangqiang Huang , Can Pu , Dehann Fourie , Kasra Khosoussi , Jonathan P. How , John J. Leonard

Physics-informed neural networks have emerged as a prominent new method for solving differential equations. While conceptually straightforward, they often suffer training difficulties that lead to relatively large discretization errors or…

Mathematical Physics · Physics 2024-03-13 Shivam Arora , Alex Bihlo , Francis Valiquette

Two fundamental problems in unsupervised learning are efficient inference for latent-variable models and robust density estimation based on large amounts of unlabeled data. Algorithms for the two tasks, such as normalizing flows and…

Machine Learning · Statistics 2018-08-02 Changyou Chen , Chunyuan Li , Liqun Chen , Wenlin Wang , Yunchen Pu , Lawrence Carin

Normalizing Flows (NFs) learn invertible mappings between the data and a Gaussian distribution. Prior works usually suffer from two limitations. First, they add random noise to training samples or VAE latents as data augmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Qinyu Zhao , Guangting Zheng , Tao Yang , Rui Zhu , Xingjian Leng , Stephen Gould , Liang Zheng

Modeling complex conditional distributions is critical in a variety of settings. Despite a long tradition of research into conditional density estimation, current methods employ either simple parametric forms or are difficult to learn in…

Machine Learning · Statistics 2018-02-15 Brian L Trippe , Richard E Turner

Solving Bayesian inference problems approximately with variational approaches can provide fast and accurate results. Capturing correlation within the approximation requires an explicit parametrization. This intrinsically limits this…

Machine Learning · Statistics 2020-01-31 Jakob Knollmüller , Torsten A. Enßlin

Discrete state spaces represent a major computational challenge to statistical inference, since the computation of normalisation constants requires summation over large or possibly infinite sets, which can be impractical. This paper…

Methodology · Statistics 2023-09-04 Takuo Matsubara , Jeremias Knoblauch , François-Xavier Briol , Chris. J. Oates

We study variational regularisation methods for inverse problems with imperfect forward operators whose errors can be modelled by order intervals in a partial order of a Banach lattice. We carry out analysis with respect to existence and…

Numerical Analysis · Mathematics 2020-12-25 Leon Bungert , Martin Burger , Yury Korolev , Carola-Bibiane Schoenlieb

Inferring dynamical models from data continues to be a significant challenge in computational biology, especially given the stochastic nature of many biological processes. We explore a common scenario in omics, where statistically…

Machine Learning · Computer Science 2025-07-31 Suryanarayana Maddu , Victor Chardès , Michael. J. Shelley

Inverse problems in physical or biological sciences often involve recovering an unknown parameter that is random. The sought-after quantity is a probability distribution of the unknown parameter, that produces data that aligns with…

Machine Learning · Statistics 2024-10-02 Qin Li , Maria Oprea , Li Wang , Yunan Yang

The numerical simulation and optimization of technical systems described by partial differential equations is expensive, especially in multi-query scenarios in which the underlying equations have to be solved for different parameters. A…

Numerical Analysis · Mathematics 2025-04-09 Franziska Griese , Fabian Hoppe , Alexander Rüttgers , Philipp Knechtges