English
Related papers

Related papers: Improving Variational Inference with Inverse Autor…

200 papers

Obtaining samples from the posterior distribution of inverse problems with expensive forward operators is challenging especially when the unknowns involve the strongly heterogeneous Earth. To meet these challenges, we propose a…

Machine Learning · Statistics 2021-01-12 Ali Siahkoohi , Gabrio Rizzuti , Mathias Louboutin , Philipp A. Witte , Felix J. Herrmann

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

Variational inference with normalizing flows (NFs) is an increasingly popular alternative to MCMC methods. In particular, NFs based on coupling layers (Real NVPs) are frequently used due to their good empirical performance. In theory,…

Machine Learning · Statistics 2024-02-27 Daniel Andrade

Flow Matching and Transformer architectures have demonstrated remarkable performance in image generation tasks, with recent work FlowAR [Ren et al., 2024] synergistically integrating both paradigms to advance synthesis fidelity. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yingyu Liang , Zhizhou Sha , Zhenmei Shi , Zhao Song , Mingda Wan

The Normalizing Flow (NF) models a general probability density by estimating an invertible transformation applied on samples drawn from a known distribution. We introduce a new type of NF, called Deep Diffeomorphic Normalizing Flow (DDNF).…

Machine Learning · Statistics 2018-11-26 Hadi Salman , Payman Yadollahpour , Tom Fletcher , Kayhan Batmanghelich

Inference models are a key component in scaling variational inference to deep latent variable models, most notably as encoder networks in variational auto-encoders (VAEs). By replacing conventional optimization-based inference with a…

Machine Learning · Computer Science 2018-07-26 Joseph Marino , Yisong Yue , Stephan Mandt

Interferometric inversion involves recovery of a signal from cross-correlations of its linear transformations. A close relative of interferometric inversion is the generalized phase retrieval problem, which consists of recovering a signal…

Signal Processing · Electrical Eng. & Systems 2020-11-10 Bariscan Yonel , Birsen Yazici

Likelihood-based deep generative models have been widely investigated for Image Anomaly Detection (IAD), particularly Normalizing Flows, yet their strict architectural invertibility needs often constrain scalability, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Liangwei Li , Lin Liu , Hanzhe Liang , Juanxiu Liu , Jing Zhang , Ruqian Hao , Xiaohui Du , Yong Liu , Pan Li

Proper regularization is crucial in inverse problems to achieve high-quality reconstruction, even with an ill-conditioned measurement system. This is particularly true for three-dimensional photoacoustic tomography, which is computationally…

Optimization and Control · Mathematics 2024-09-26 Chao Wang , Alexandre H. Thiery

Diffusion and flow-based generative models have shown strong potential for image restoration. However, image denoising under unknown and varying noise conditions remains challenging, because the learned vector fields may become inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Jigang Duan , Genwei Ma , Xu Jiang , Wenfeng Xu , Ping Yang , Xing Zhao

MeanFlow (MF) has recently been established as a framework for one-step generative modeling. However, its ``fastforward'' nature introduces key challenges in both the training objective and the guidance mechanism. First, the original MF's…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhengyang Geng , Yiyang Lu , Zongze Wu , Eli Shechtman , J. Zico Kolter , Kaiming He

Variational Bayesian phylogenetic inference (VBPI) provides a promising general variational framework for efficient estimation of phylogenetic posteriors. However, the current diagonal Lognormal branch length approximation would…

Populations and Evolution · Quantitative Biology 2020-12-02 Cheng Zhang

This paper presents a new algorithm, Accelerated Wirtinger Flow (AWF), for ptychographic image reconstruction from phaseless diffraction pattern measurements. AWF is based on combining Nesterov's acceleration approach with Wirtinger…

Image and Video Processing · Electrical Eng. & Systems 2018-06-29 Rui Xu , Mahdi Soltanolkotabi , Justin P. Haldar , Walter Unglaub , Joshua Zusman , Anthony F. J. Levi , Richard M. Leahy

To enhance low-light images to normally-exposed ones is highly ill-posed, namely that the mapping relationship between them is one-to-many. Previous works based on the pixel-wise reconstruction losses and deterministic processes fail to…

Image and Video Processing · Electrical Eng. & Systems 2021-09-14 Yufei Wang , Renjie Wan , Wenhan Yang , Haoliang Li , Lap-Pui Chau , Alex C. Kot

This paper presents normalizing flows for incremental smoothing and mapping (NF-iSAM), a novel algorithm for inferring the full posterior distribution in SLAM problems with nonlinear measurement models and non-Gaussian factors. NF-iSAM…

We report on a general and automatic data-driven background distribution shape estimation method using neural autoregressive flows (NAF), which is one of the deep generative learning methods. Data-driven background estimation is…

High Energy Physics - Phenomenology · Physics 2020-08-11 Suyong Choi , Jaehoon Lim , Hayoung Oh

A convolutional encoder-decoder-based transformer model is proposed for autoregressively training on spatio-temporal data of turbulent flows. The prediction of future fluid flow fields is based on the previously predicted fluid flow field…

Fluid Dynamics · Physics 2023-03-31 Aakash Patil , Jonathan Viquerat , Elie Hachem

Vision-Language Latent Diffusion Models (LDMs) (Rombach et al., 2022) provide powerful generative priors for inverse problems. However, existing LDM-based inverse solvers typically require a large number of neural function evaluations…

Machine Learning · Statistics 2026-05-11 Alessio Spagnoletti , Tim Y. J. Wang , Marcelo Pereyra , O. Deniz Akyildiz

In this work, we investigate the use of normalizing flows to model conditional distributions. In particular, we use our proposed method to analyze inverse problems with invertible neural networks by maximizing the posterior likelihood. Our…

Machine Learning · Computer Science 2019-11-07 Zhisheng Xiao , Qing Yan , Yali Amit

Normalizing Flows (NFs) learn invertible mappings between the data and a Gaussian distribution. Prior works usually suffer from two limitations. First, they add random noise to training samples or VAE latents as data augmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Qinyu Zhao , Guangting Zheng , Tao Yang , Rui Zhu , Xingjian Leng , Stephen Gould , Liang Zheng