English
Related papers

Related papers: Mean Flows for One-step Generative Modeling

200 papers

Foundational language models show a remarkable ability to learn new concepts during inference via context data. However, similar work for images lag behind. To address this challenge, we introduce FLoWN, a flow matching model that learns to…

Machine Learning · Computer Science 2025-04-22 Daniel Saragih , Deyu Cao , Tejas Balaji , Ashwin Santhosh

Controlling generative models is computationally expensive. This is because optimal alignment with a reward function--whether via inference-time steering or fine-tuning--requires estimating the value function. This task demands access to…

Machine Learning · Statistics 2026-01-22 Peter Potaptchik , Adhi Saravanan , Abbas Mammadov , Alvaro Prat , Michael S. Albergo , Yee Whye Teh

Flow-based data sets are necessary for evaluating network-based intrusion detection systems (NIDS). In this work, we propose a novel methodology for generating realistic flow-based network traffic. Our approach is based on Generative…

Networking and Internet Architecture · Computer Science 2019-03-07 Markus Ring , Daniel Schlör , Dieter Landes , Andreas Hotho

Current density modeling approaches suffer from at least one of the following shortcomings: expensive training, slow inference, approximate likelihood, mode collapse or architectural constraints like bijective mappings. We propose a simple…

Machine Learning · Computer Science 2025-10-01 Marcello Massimo Negri , Jonathan Aellen , Manuel Jahn , AmirEhsan Khorashadizadeh , Volker Roth

We introduce manifold-learning flows (M-flows), a new class of generative models that simultaneously learn the data manifold as well as a tractable probability density on that manifold. Combining aspects of normalizing flows, GANs,…

Machine Learning · Statistics 2020-11-16 Johann Brehmer , Kyle Cranmer

Flow models are effective at progressively generating realistic images, but they generally struggle to capture long-range dependencies during the generation process as they compress all the information from previous time steps into a single…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mude Hui , Rui-Jie Zhu , Songlin Yang , Yu Zhang , Zirui Wang , Yuyin Zhou , Jason Eshraghian , Cihang Xie

In this work, we propose the Generative Latent Flow (GLF), an algorithm for generative modeling of the data distribution. GLF uses an Auto-encoder (AE) to learn latent representations of the data, and a normalizing flow to map the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Zhisheng Xiao , Qing Yan , Yali Amit

Existing dominant methods for audio generation include Generative Adversarial Networks (GANs) and diffusion-based methods like Flow Matching. GANs suffer from slow convergence during training, while diffusion methods require multi-step…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-10 Zengwei Yao , Wei Kang , Han Zhu , Liyong Guo , Lingxuan Ye , Fangjun Kuang , Weiji Zhuang , Zhaoqing Li , Zhifeng Han , Long Lin , Daniel Povey

We tackle the problem of sampling from intractable high-dimensional density functions, a fundamental task that often appears in machine learning and statistics. We extend recent sampling-based approaches that leverage controlled stochastic…

Machine Learning · Computer Science 2024-03-12 Dinghuai Zhang , Ricky T. Q. Chen , Cheng-Hao Liu , Aaron Courville , Yoshua Bengio

Generative models have proven effective at modeling 3D shapes and their statistical variations. In this paper we investigate their application to point clouds, a 3D shape representation widely used in computer vision for which, however,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Roman Klokov , Edmond Boyer , Jakob Verbeek

Diffusion models deliver state-of-the-art generative performance across diverse modalities but remain computationally expensive due to their inherently iterative sampling process. Existing training-free acceleration methods typically…

Machine Learning · Computer Science 2026-02-10 Cheng Jin , Zhenyu Xiao , Yuantao Gu

Flow matching models have emerged as a powerful method for generative modeling on domains like images or videos, and even on irregular or unstructured data like 3D point clouds or even protein structures. These models are commonly trained…

Machine Learning · Computer Science 2025-05-30 Yuyang Wang , Anurag Ranjan , Josh Susskind , Miguel Angel Bautista

Diffusion distillation is a widely used technique to reduce the sampling cost of diffusion models, yet it often requires extensive training, and the student performance tends to be degraded. Recent studies show that incorporating a GAN…

Machine Learning · Computer Science 2025-06-12 Bowen Zheng , Tianming Yang

Flow matching as a paradigm of generative model achieves notable success across various domains. However, existing methods use either multi-round training or knowledge within minibatches, posing challenges in finding a favorable coupling…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Siyu Xing , Jie Cao , Huaibo Huang , Haichao Shi , Xiao-Yu Zhang

Diffusion models have shown great promise for image and video generation, but sampling from state-of-the-art models requires expensive numerical integration of a generative ODE. One approach for tackling this problem is rectified flows,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Sangyun Lee , Zinan Lin , Giulia Fanti

Recent progress in flow-based generative models and reinforcement learning (RL) has improved text-image alignment and visual quality. However, current RL training for flow models still has two main problems: (i) GRPO-style fixed per-prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Kaijie Chen , Zhiyang Xu , Ying Shen , Zihao Lin , Yuguang Yao , Lifu Huang

Flow-based generative models have highly desirable properties like exact log-likelihood evaluation and exact latent-variable inference, however they are still in their infancy and have not received as much attention as alternative…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Albert Pumarola , Stefan Popov , Francesc Moreno-Noguer , Vittorio Ferrari

Generative models have gained popularity for their potential applications in imaging science, such as image reconstruction, posterior sampling and data sharing. Flow-based generative models are particularly attractive due to their ability…

Machine Learning · Computer Science 2023-12-14 Varun A. Kelkar , Rucha Deshpande , Arindam Banerjee , Mark A. Anastasio

Diffusion-based imitation learning improves Behavioral Cloning (BC) on multi-modal decision-making, but comes at the cost of significantly slower inference due to the recursion in the diffusion process. It urges us to design efficient…

Machine Learning · Computer Science 2024-11-25 Xixi Hu , Bo Liu , Xingchao Liu , Qiang Liu

In image restoration, single-step discriminative mappings often lack fine details via expectation learning, whereas generative paradigms suffer from inefficient multi-step sampling and noise-residual coupling. To address this dilemma, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Zihao Fan , Xin Lu , Jie Xiao , Dong Li , Jie Huang , Xueyang Fu