English
Related papers

Related papers: Generative Model with Dynamic Linear Flow

200 papers

We propose a general framework to learn deep generative models via \textbf{V}ariational \textbf{Gr}adient Fl\textbf{ow} (VGrow) on probability spaces. The evolving distribution that asymptotically converges to the target distribution is…

Machine Learning · Computer Science 2019-05-07 Yuan Gao , Yuling Jiao , Yang Wang , Yao Wang , Can Yang , Shunkang Zhang

Most sequence-to-sequence (seq2seq) models are autoregressive; they generate each token by conditioning on previously generated tokens. In contrast, non-autoregressive seq2seq models generate all tokens in one pass, which leads to increased…

Computation and Language · Computer Science 2019-10-10 Xuezhe Ma , Chunting Zhou , Xian Li , Graham Neubig , Eduard Hovy

Recent years witnessed the development of powerful generative models based on flows, diffusion or autoregressive neural networks, achieving remarkable success in generating data from examples with applications in a broad range of areas. A…

Disordered Systems and Neural Networks · Physics 2024-07-22 Davide Ghio , Yatin Dandi , Florent Krzakala , Lenka Zdeborová

We present a generative model that is defined on finite sets of exchangeable, potentially high dimensional, data. As the architecture is an extension of RealNVPs, it inherits all its favorable properties, such as being invertible and…

Machine Learning · Computer Science 2019-09-09 Kashif Rasul , Ingmar Schuster , Roland Vollgraf , Urs Bergmann

We present OneFlow, the first non-autoregressive multimodal model that enables variable-length and concurrent mixed-modal generation. Unlike autoregressive models that enforce rigid causal ordering between text and image generation, OneFlow…

Artificial Intelligence · Computer Science 2025-12-11 John Nguyen , Marton Havasi , Tariq Berrada , Luke Zettlemoyer , Ricky T. Q. Chen

The recently proposed generative flow networks (GFlowNets) are a method of training a policy to sample compositional discrete objects with probabilities proportional to a given reward via a sequence of actions. GFlowNets exploit the…

Machine Learning · Computer Science 2024-02-27 Daniil Tiapkin , Nikita Morozov , Alexey Naumov , Dmitry Vetrov

Normalising flows are generative models that transform a complex density into a simpler density through the use of bijective transformations enabling both density estimation and data generation from a single model. %However, the requirement…

Machine Learning · Statistics 2024-06-28 Eshant English , Matthias Kirchler , Christoph Lippert

This study presents a novel generative modeling approach to rainfall-runoff modeling, focusing on the synthesis of realistic daily catchment runoff time series in response to catchment-averaged climate forcing. Unlike traditional…

Geophysics · Physics 2024-09-11 Yang Yang , Ting Fong May Chui

While normalizing flows have led to significant advances in modeling high-dimensional continuous distributions, their applicability to discrete distributions remains unknown. In this paper, we show that flows can in fact be extended to…

Machine Learning · Computer Science 2019-05-27 Dustin Tran , Keyon Vafa , Kumar Krishna Agrawal , Laurent Dinh , Ben Poole

Due to the success of generative flows to model data distributions, they have been explored in inverse problems. Given a pre-trained generative flow, previous work proposed to minimize the 2-norm of the latent variables as a regularization…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 José A. Chávez

Density estimation, a central problem in machine learning, can be performed using Normalizing Flows (NFs). NFs comprise a sequence of invertible transformations, that turn a complex target distribution into a simple one, by exploiting the…

Machine Learning · Computer Science 2024-01-04 Massimiliano Patacchiola , Aliaksandra Shysheya , Katja Hofmann , Richard E. Turner

Modern reinforcement learning (RL) algorithms have found success by using powerful probabilistic models, such as transformers, energy-based models, and diffusion/flow-based models. To this end, RL researchers often choose to pay the price…

Machine Learning · Computer Science 2025-06-05 Raj Ghugare , Benjamin Eysenbach

Numerous applications of machine learning involve representing probability distributions over high-dimensional data. We propose autoregressive quantile flows, a flexible class of normalizing flow models trained using a novel objective based…

Machine Learning · Computer Science 2023-02-17 Phillip Si , Allan Bishop , Volodymyr Kuleshov

Large-scale diffusion models have achieved remarkable performance in generative tasks. Beyond their initial training applications, these models have proven their ability to function as versatile plug-and-play priors. For instance, 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Xiaofeng Yang , Cheng Chen , Xulei Yang , Fayao Liu , Guosheng Lin

Flow matching has recently emerged as a promising alternative to diffusion-based generative models, offering faster sampling and simpler training by learning continuous flows governed by ordinary differential equations. Despite growing…

Machine Learning · Computer Science 2025-12-02 Mudit Gaur , Prashant Trivedi , Shuchin Aeron , Amrit Singh Bedi , George K. Atia , Vaneet Aggarwal

Conditional Flow Matching (CFM) models can generate high-quality samples from a non-informative prior, but they can be slow, often needing hundreds of network evaluations (NFE). To address this, we propose Implicit Dynamical Flow Fusion…

Machine Learning · Computer Science 2025-05-28 Mohammad R. Rezaei , Milos R. Popovic , Milad Lankarany , Rahul G. Krishnan

Flow Matching (FM) is a simulation-free method for learning a continuous and invertible flow to interpolate between two distributions, and in particular to generate data from noise. Inspired by the variational nature of the diffusion…

Machine Learning · Statistics 2025-07-14 Chen Xu , Xiuyuan Cheng , Yao Xie

We explore the use of autoregressive flows, a type of generative model with tractable likelihood, as a means of efficient generation of physical particle collider events. The usual maximum likelihood loss function is supplemented by an…

High Energy Physics - Phenomenology · Physics 2021-02-17 Bob Stienen , Rob Verheyen

Likelihood-based deep generative models have been widely investigated for Image Anomaly Detection (IAD), particularly Normalizing Flows, yet their strict architectural invertibility needs often constrain scalability, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Liangwei Li , Lin Liu , Hanzhe Liang , Juanxiu Liu , Jing Zhang , Ruqian Hao , Xiaohui Du , Yong Liu , Pan Li

Combining discrete and continuous data is an important capability for generative models. We present Discrete Flow Models (DFMs), a new flow-based model of discrete data that provides the missing link in enabling flow-based generative models…

Machine Learning · Statistics 2024-06-07 Andrew Campbell , Jason Yim , Regina Barzilay , Tom Rainforth , Tommi Jaakkola