English
Related papers

Related papers: Duality Models: An Embarrassingly Simple One-step …

200 papers

Flow map models such as Consistency Models (CM) and Mean Flow (MF) enable few-step generation by learning the long jump of the ODE solution of diffusion models, yet training remains unstable, sensitive to hyperparameters, and costly.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Zheyuan Hu , Chieh-Hsin Lai , Yuki Mitsufuji , Stefano Ermon

Diffusion models generate high-quality images but require dozens of forward passes. We introduce Distribution Matching Distillation (DMD), a procedure to transform a diffusion model into a one-step image generator with minimal impact on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Tianwei Yin , Michaël Gharbi , Richard Zhang , Eli Shechtman , Fredo Durand , William T. Freeman , Taesung Park

We present a comprehensive comparative study of three generative modeling paradigms: Denoising Diffusion Probabilistic Models (DDPM), Conditional Flow Matching (CFM), and MeanFlow. While DDPM and CFM require iterative sampling, MeanFlow…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Umang Agarwal , Rudraksh Sangore , Sumit Laddha

We introduce $\texttt{PairFlow}$, a lightweight preprocessing step for training Discrete Flow Models (DFMs) to achieve few-step sampling without requiring a pretrained teacher. DFMs have recently emerged as a new class of generative models…

Machine Learning · Computer Science 2026-05-26 Mingue Park , Jisung Hwang , Seungwoo Yoo , Kyeongmin Yeo , Minhyuk Sung

Currently, Flow matching methods aim to compress the iterative generation process of diffusion models into a few or even a single step, with MeanFlow and FreeFlow being representative achievements of one-step generation based on Ordinary…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Haonan Wei , Linyuan Wang , Nuolin Sun , Zhizhong Zheng , Lei Li , Bin Yan

One-step generators distilled from Masked Diffusion Models (MDMs) compress multiple sampling steps into a single forward pass, enabling efficient text and image synthesis. However, they suffer two key limitations: they inherit modeling bias…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yuanzhi Zhu , Xi Wang , Stéphane Lathuilière , Vicky Kalogeiton

Flow-matching models have enabled high-quality text-to-speech synthesis, but their iterative sampling process during inference incurs substantial computational cost. Although distillation is widely used to reduce the number of inference…

Sound · Computer Science 2026-02-11 Bin Lin , Peng Yang , Chao Yan , Xiaochen Liu , Wei Wang , Boyong Wu , Pengfei Tan , Xuerui Yang

Fast flow models accelerate the iterative sampling process by learning to directly predict ODE path integrals, enabling one-step or few-step generation. However, we argue that current fast-flow training paradigms suffer from two fundamental…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Tianyi Zhang , Chengcheng Liu , Jinwei Chen , Chun-Le Guo , Chongyi Li , Ming-Ming Cheng , Bo Li , Peng-Tao Jiang

Diffusion models and flow-based methods have shown impressive generative capability, especially for images, but their sampling is expensive because it requires many iterative updates. We introduce W-Flow, a framework for training a…

Machine Learning · Computer Science 2026-05-28 Jiaqi Han , Puheng Li , Qiushan Guo , Renyuan Xu , Stefano Ermon , Emmanuel J. Candès

Iterative generative models such as Flow Matching and Diffusion models have demonstrated strong test-time scaling behavior, where additional inference computation can improve generation quality. In contrast, Drift Models offer efficient…

Machine Learning · Computer Science 2026-05-19 Chenrui Ma , Xi Xiao , Lin Zhao , Tianyang Wang , Ferdinando Fioretto , Yanning Shen

Limited by inference latency, existing robot manipulation policies lack sufficient real-time interaction capability with the environment. Although faster generation methods such as flow matching are gradually replacing diffusion methods,…

Robotics · Computer Science 2026-02-17 Zhenchen Dong , Jinna Fu , Jiaming Wu , Shengyuan Yu , Fulin Chen , Yide Liu

Generative models like Flow Matching have achieved state-of-the-art performance but are often hindered by a computationally expensive iterative sampling process. To address this, recent work has focused on few-step or one-step generation by…

Machine Learning · Computer Science 2025-07-24 Yi Guo , Wei Wang , Zhihang Yuan , Rong Cao , Kuan Chen , Zhengyang Chen , Yuanyuan Huo , Yang Zhang , Yuping Wang , Shouda Liu , Yuxuan Wang

A fundamental dilemma in generative modeling persists: iterative diffusion models achieve outstanding fidelity, but at a significant computational cost, while efficient few-step alternatives are constrained by a hard quality ceiling. This…

Machine Learning · Computer Science 2025-09-05 Zidong Wang , Yiyuan Zhang , Xiaoyu Yue , Xiangyu Yue , Yangguang Li , Wanli Ouyang , Lei Bai

MeanFlow promises high-quality generative modeling in few steps, by jointly learning instantaneous and average velocity fields. Yet, the underlying training dynamics remain unclear. We analyze the interaction between the two velocities and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jin-Young Kim , Hyojun Go , Lea Bogensperger , Julius Erbach , Nikolai Kalischek , Federico Tombari , Konrad Schindler , Dominik Narnhofer

We introduce Midpoint Generative Models (MGM), a principled framework for training one-step generative models. MGM is based on a simple symmetry of Flow Matching with linear interpolation: when the two endpoint distributions coincide, the…

Machine Learning · Computer Science 2026-05-29 Daniil Shlenskii , Nikita Gushchin , Lev Novitskiy , Dmitry V. Dylov , Alexander Korotin

MeanFlow (MF) has recently been established as a framework for one-step generative modeling. However, its ``fastforward'' nature introduces key challenges in both the training objective and the guidance mechanism. First, the original MF's…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhengyang Geng , Yiyang Lu , Zongze Wu , Eli Shechtman , J. Zico Kolter , Kaiming He

Masked Diffusion Models (MDMs) have emerged as a powerful generative modeling technique. Despite their remarkable results, they typically suffer from slow inference with several steps. In this paper, we propose Di$\mathtt{[M]}$O, a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yuanzhi Zhu , Xi Wang , Stéphane Lathuilière , Vicky Kalogeiton

We propose \emph{Euler Mean Flows (EMF)}, a flow-based generative framework for one-step and few-step generation that enforces long-range trajectory consistency with minimal sampling cost. The key idea of EMF is to replace the trajectory…

Machine Learning · Computer Science 2026-02-04 Zhiqi Li , Yuchen Sun , Duowen Chen , Jinjin He , Bo Zhu

Distribution Matching Distillation (DMD) distills score-based generative models into efficient one-step generators, without requiring a one-to-one correspondence with the sampling trajectories of their teachers. Yet, the limited capacity of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Xiangyu Fan , Zesong Qiu , Zhuguanyu Wu , Fanzhou Wang , Zhiqian Lin , Tianxiang Ren , Dahua Lin , Ruihao Gong , Lei Yang

Flow Matching has limited ability in achieving one-step generation due to its reliance on learned curved trajectories. Previous studies have attempted to address this limitation by either modifying the coupling distribution to prevent…

Machine Learning · Computer Science 2025-11-25 Chenrui Ma , Xi Xiao , Tianyang Wang , Xiao Wang , Yanning Shen