English
Related papers

Related papers: Semi-Autoregressive Energy Flows: Exploring Likeli…

200 papers

A learned generative model often produces biased statistics relative to the underlying data distribution. A standard technique to correct this bias is importance sampling, where samples from the model are weighted by the likelihood ratio…

Machine Learning · Statistics 2019-11-05 Aditya Grover , Jiaming Song , Alekh Agarwal , Kenneth Tran , Ashish Kapoor , Eric Horvitz , Stefano Ermon

Deep generative frameworks including GANs and normalizing flow models have proven successful at filling in missing values in partially observed data samples by effectively learning -- either explicitly or implicitly -- complex,…

Machine Learning · Computer Science 2021-04-06 Edgar A. Bernal

While energy-based models (EBMs) exhibit a number of desirable properties, training and sampling on high-dimensional datasets remains challenging. Inspired by recent progress on diffusion probabilistic models, we present a diffusion…

Machine Learning · Computer Science 2021-03-30 Ruiqi Gao , Yang Song , Ben Poole , Ying Nian Wu , Diederik P. Kingma

A common objective in the analysis of tabular data is estimating the conditional distribution (in contrast to only producing predictions) of a set of "outcome" variables given a set of "covariates", which is sometimes referred to as the…

Machine Learning · Statistics 2024-10-08 Zhuoqun Wang , Naoki Awaya , Li Ma

This paper presents a novel framework for aligning learnable latent spaces to arbitrary target distributions by leveraging flow-based generative models as priors. Our method first pretrains a flow model on the target features to capture the…

Machine Learning · Computer Science 2026-03-17 Yizhuo Li , Yuying Ge , Yixiao Ge , Ying Shan , Ping Luo

Stochastic processes generated by non-stationary distributions are difficult to represent with conventional models such as Gaussian processes. This work presents Recurrent Autoregressive Flows as a method toward general stochastic process…

Machine Learning · Computer Science 2020-06-20 John Mern , Peter Morales , Mykel J. Kochenderfer

We introduce manifold-learning flows (M-flows), a new class of generative models that simultaneously learn the data manifold as well as a tractable probability density on that manifold. Combining aspects of normalizing flows, GANs,…

Machine Learning · Statistics 2020-11-16 Johann Brehmer , Kyle Cranmer

Flow-based methods have achieved significant success in various generative modeling tasks, capturing nuanced details within complex data distributions. However, few existing works have exploited this unique capability to resolve…

Machine Learning · Statistics 2026-02-03 Yakun Wang , Leyang Wang , Song Liu , Taiji Suzuki

Many components of data analysis in high energy physics and beyond require morphing one dataset into another. This is commonly solved via reweighting, but there are many advantages of preserving weights and shifting the data points instead.…

High Energy Physics - Phenomenology · Physics 2023-11-22 Tobias Golling , Samuel Klein , Radha Mastandrea , Benjamin Nachman , John Andrew Raine

Normalizing flows transform a latent distribution through an invertible neural network for a flexible and pleasingly simple approach to generative modelling, while preserving an exact likelihood. We propose FlowGMM, an end-to-end approach…

Machine Learning · Computer Science 2020-01-01 Pavel Izmailov , Polina Kirichenko , Marc Finzi , Andrew Gordon Wilson

Normalizing Flows (NFs) are able to model complicated distributions p(y) with strong inter-dimensional correlations and high multimodality by transforming a simple base density p(z) through an invertible neural network under the change of…

Machine Learning · Computer Science 2023-11-14 Christina Winkler , Daniel Worrall , Emiel Hoogeboom , Max Welling

Classifier-free guidance is a key component for enhancing the performance of conditional generative models across diverse tasks. While it has previously demonstrated remarkable improvements for the sample quality, it has only been…

Machine Learning · Computer Science 2023-12-11 Qinqing Zheng , Matt Le , Neta Shaul , Yaron Lipman , Aditya Grover , Ricky T. Q. Chen

Normalizing flows are generative models that provide tractable density estimation via an invertible transformation from a simple base distribution to a complex target distribution. However, this technique cannot directly model data…

Machine Learning · Statistics 2021-11-15 Brendan Leigh Ross , Jesse C. Cresswell

Normalizing flows are constructed from a base distribution with a known density and a diffeomorphism with a tractable Jacobian. The base density of a normalizing flow can be parameterised by a different normalizing flow, thus allowing maps…

Machine Learning · Computer Science 2022-11-07 Samuel Klein , John Andrew Raine , Tobias Golling

Generative Flow Networks (GFlowNets) have emerged as an innovative learning paradigm designed to address the challenge of sampling from an unnormalized probability distribution, called the reward function. This framework learns a policy on…

Machine Learning · Computer Science 2024-07-04 Anas Krichel , Nikolay Malkin , Salem Lahlou , Yoshua Bengio

Generative Flow Networks (GFlowNets) are a novel class of generative models designed to sample from unnormalized distributions and have found applications in various important tasks, attracting great research interest in their training…

Machine Learning · Computer Science 2024-10-04 Rui Hu , Yifan Zhang , Zhuoran Li , Longbo Huang

I describe a trick for training flow models using a prescribed rule as a surrogate for maximum likelihood. The utility of this trick is limited for non-conditional models, but an extension of the approach, applied to maximum likelihood of…

Machine Learning · Computer Science 2022-08-26 John S. Hyatt

Energy-based models (EBMs) are a powerful class of probabilistic generative models due to their flexibility and interpretability. However, relationships between potential flows and explicit EBMs remain underexplored, while contrastive…

We introduce ContinualFlow, a principled framework for targeted unlearning in generative models via Flow Matching. Our method leverages an energy-based reweighting loss to softly subtract undesired regions of the data distribution without…

Machine Learning · Computer Science 2025-06-24 Lorenzo Simone , Davide Bacciu , Shuangge Ma

Normalizing Flows (NFs) are likelihood-based models for continuous inputs. They have demonstrated promising results on both density estimation and generative modeling tasks, but have received relatively little attention in recent years. In…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Shuangfei Zhai , Ruixiang Zhang , Preetum Nakkiran , David Berthelot , Jiatao Gu , Huangjie Zheng , Tianrong Chen , Miguel Angel Bautista , Navdeep Jaitly , Josh Susskind