English
Related papers

Related papers: Distilling Two-Timed Flow Models by Separately Mat…

200 papers

Diffusion- and flow-based models have emerged as state-of-the-art generative modeling approaches, but they require many sampling steps. Consistency models can distill these models into efficient one-step generators; however, unlike flow-…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Amirmojtaba Sabour , Sanja Fidler , Karsten Kreis

Discrete flow models offer a powerful framework for learning distributions over discrete state spaces and have demonstrated superior performance compared to the discrete diffusion models. However, their convergence properties and error…

Statistics Theory · Mathematics 2026-05-27 Zhengyan Wan , Yidong Ouyang , Qiang Yao , Liyan Xie , Fang Fang , Hongyuan Zha , Guang Cheng

Current discriminative depth estimation methods often produce blurry artifacts, while generative approaches suffer from slow sampling due to curvatures in the noise-to-depth transport. Our method addresses these challenges by framing depth…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Ming Gui , Johannes Schusterbauer , Ulrich Prestel , Pingchuan Ma , Dmytro Kotovenko , Olga Grebenkova , Stefan Andreas Baumann , Vincent Tao Hu , Björn Ommer

Generative models have achieved remarkable progress with the emergence of flow matching (FM). It has demonstrated strong generative capabilities and attracted significant attention as a simulation-free flow-based framework capable of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Huynh Trinh Ngoc , Hoang Anh Nguyen Kim , Toan Nguyen Hai , Long Tran Quoc

The diffusion models including Denoising Diffusion Probabilistic Models (DDPM) and score-based generative models have demonstrated excellent performance in speech synthesis tasks. However, its effectiveness comes at the cost of numerous…

Sound · Computer Science 2024-02-01 Wenhao Guan , Qi Su , Haodong Zhou , Shiyu Miao , Xingjia Xie , Lin Li , Qingyang Hong

Standard flow matching scales well but typically relies on an unstructured source distribution, limiting its ability to learn interpretable latent structure. Latent-variable models, by contrast, capture structure but often sacrifice…

Machine Learning · Computer Science 2026-05-11 Xavier Sumba , Carles Balsells-Rodas , Yingzhen Li

Flow Matching (FM) (also referred to as stochastic interpolants or rectified flows) stands out as a class of generative models that aims to bridge in finite time the target distribution $\nu^\star$ with an auxiliary distribution $\mu$,…

Machine Learning · Statistics 2024-09-16 Marta Gentiloni Silveri , Giovanni Conforti , Alain Durmus

The efficient construction of accurate channel knowledge maps (CKMs) is crucial for unleashing the full potential of environment-aware wireless networks, yet it remains a difficult ill-posed problem due to the sparsity of available…

Information Theory · Computer Science 2026-01-13 Ziyu Huang , Yong Zeng , Shen Fu , Xiaoli Xu , Hongyang Du

We propose Shallow Flow Matching (SFM), a novel mechanism that enhances flow matching (FM)-based text-to-speech (TTS) models within a coarse-to-fine generation paradigm. Unlike conventional FM modules, which use the coarse representations…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-24 Dong Yang , Yiyi Cai , Yuki Saito , Lixu Wang , Hiroshi Saruwatari

Flow-based generative models achieve state-of-the-art sample quality, but require the expensive solution of a differential equation at inference time. Flow map models, commonly known as consistency models, encompass many recent efforts to…

Machine Learning · Computer Science 2025-10-07 Nicholas M. Boffi , Michael S. Albergo , Eric Vanden-Eijnden

Continuous normalizing flows (CNFs) can model data distributions with expressive infinite-length architectures. But this modeling involves computationally expensive process of solving an ordinary differential equation (ODE) during maximum…

Machine Learning · Computer Science 2024-10-15 Denis Gudovskiy , Tomoyuki Okuno , Yohei Nakata

Large video diffusion and flow models have achieved remarkable success in high-quality video generation, but their use in real-time interactive applications remains limited due to their inefficient multi-step sampling process. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Weili Nie , Julius Berner , Nanye Ma , Chao Liu , Saining Xie , Arash Vahdat

Accurate traffic flow prediction is vital for optimizing urban mobility, yet it remains difficult in many cities due to complex spatio-temporal dependencies and limited high-quality data. While deep graph-based models demonstrate strong…

Machine Learning · Computer Science 2025-04-04 Chenyang Yu , Xinpeng Xie , Yan Huang , Chenxi Qiu

Diffusion models approximate the denoising distribution as a Gaussian and predict its mean, whereas flow matching models reparameterize the Gaussian mean as flow velocity. However, they underperform in few-step sampling due to…

Machine Learning · Computer Science 2025-09-03 Hansheng Chen , Kai Zhang , Hao Tan , Zexiang Xu , Fujun Luan , Leonidas Guibas , Gordon Wetzstein , Sai Bi

Flow matching has demonstrated strong generative capabilities and has become a core component in modern Text-to-Speech (TTS) systems. To ensure high-quality speech synthesis, Classifier-Free Guidance (CFG) is widely used during the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-05 Yuzhe Liang , Wenzhe Liu , Chunyu Qiang , Zhikang Niu , Yushen Chen , Ziyang Ma , Wenxi Chen , Nan Li , Chen Zhang , Xie Chen

Continuous diffusion and flow matching models could represent a powerful alternative to autoregressive approaches for language modelling (LM), as they unlock a host of advantages currently reserved for continuous modalities, including…

Machine Learning · Computer Science 2026-05-12 Oscar Davis , Anastasiia Filippova , Pierre Ablin , Victor Turrisi , Amitis Shidani , Marco Cuturi , Louis Béthune

Flow matching (FM) learns vector fields by regressing stochastic velocity targets along intermediate distributions $p_t$. We identify a geometric optimization bottleneck in this regression problem: when the covariance $\Sigma_t$ of $p_t$ is…

Machine Learning · Computer Science 2026-05-14 Shadab Ahamed , Eshed Gal , Md Shahriar Rahim Siddiqui , Simon Ghyselincks , Moshe Eliasof , Eldad Haber

Consistency models imitate the multi-step sampling of score-based diffusion in a single forward pass of a neural network. They can be learned in two ways: consistency distillation and consistency training. The former relies on the true…

Machine Learning · Computer Science 2025-07-03 Thibaut Issenhuth , Sangchul Lee , Ludovic Dos Santos , Jean-Yves Franceschi , Chansoo Kim , Alain Rakotomamonjy

Denoising Diffusion Probabilistic Models (DDPMs) have established a new state-of-the-art in generative image synthesis, yet their deployment is hindered by significant computational overhead during inference, often requiring up to 1,000…

Machine Learning · Computer Science 2025-11-25 Srishti Gupta , Yashasvee Taiwade

Diffusion and flow matching models have achieved remarkable success in text-to-image generation. However, these models typically rely on the predetermined denoising schedules for all prompts. The multi-step reverse diffusion process can be…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Zilyu Ye , Zhiyang Chen , Tiancheng Li , Zemin Huang , Weijian Luo , Guo-Jun Qi