English
Related papers

Related papers: Path-Guided Flow Matching for Dataset Distillation

200 papers

Existing generative models for time series forecasting often transform simple priors (typically Gaussian) into complex data distributions. However, their sampling initialization, independent of historical data, hinders the capture of…

Machine Learning · Computer Science 2025-08-12 Huibo Xu , Runlong Yu , Likang Wu , Xianquan Wang , Qi Liu

Diffusion models produce high-quality text-to-image results, but their iterative denoising is computationally expensive.Distribution Matching Distillation (DMD) emerges as a promising path to few-step distillation, but suffers from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Haoyu Li , Tingyan Wen , Lin Qi , Zhe Wu , Yihuang Chen , Xing Zhou , Lifei Zhu , Xueqian Wang , Kai Zhang

Diffusion model (DM)-based channel estimation, which generates channel samples via a posteriori sampling stepwise with denoising process, has shown potential in high-precision channel state information (CSI) acquisition. However, slow…

Machine Learning · Computer Science 2025-11-17 Wenkai Liu , Nan Ma , Jianqiao Chen , Xiaoxuan Qi , Yuhang Ma

While diffusion distillation has enabled one-step generation through methods like Variational Score Distillation, adapting distilled models to emerging new controls -- such as novel structural constraints or latest user preferences --…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Yihong Luo , Tianyang Hu , Yifan Song , Jiacheng Sun , Zhenguo Li , Jing Tang

Virtual instrument generation requires maintaining consistent timbre across different pitches and velocities, a challenge that existing note-level models struggle to address. We present FlowSynth, which combines distributional flow matching…

Sound · Computer Science 2025-10-27 Qihui Yang , Randal Leistikow , Yongyi Zang

Diffusion distillation provides an effective approach for learning lightweight and few-steps diffusion models with efficient generation. However, evaluating their generalization remains challenging: theoretical metrics are often impractical…

Machine Learning · Computer Science 2026-02-13 Huijie Zhang , Zijian Huang , Siyi Chen , Jinfan Zhou , Zekai Zhang , Peng Wang , Qing Qu

We provide the first polynomial-time convergence guarantees for the probability flow ODE implementation (together with a corrector step) of score-based generative modeling. Our analysis is carried out in the wake of recent results obtaining…

Machine Learning · Computer Science 2023-05-22 Sitan Chen , Sinho Chewi , Holden Lee , Yuanzhi Li , Jianfeng Lu , Adil Salim

Flow matching casts sample generation as learning a continuous-time velocity field that transports noise to data. Existing flow matching networks typically predict each point's velocity independently, considering only its location and time…

Machine Learning · Computer Science 2025-11-11 Md Shahriar Rahim Siddiqui , Moshe Eliasof , Eldad Haber

Ordinary differential equation (ODE) based generative models have emerged as a powerful approach for producing high-quality samples in many applications. However, the ODE-based methods either suffer the discretization error of numerical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Jingjing Wang , Dan Zhang , Joshua Luo , Yin Yang , Feng Luo

Discrete flow matching generates text by iteratively transforming noise tokens into coherent language, but may require hundreds of forward passes. Distillation uses the multi-step trajectory to train a student to reproduce the process in a…

Machine Learning · Computer Science 2026-05-11 Amin Karimi Monsefi , Dominic Culver , Nikhil Bhendawade , Manuel R. Ciosici , Yizhe Zhang , Irina Belousova

Accelerating diffusion model sampling is crucial for efficient AIGC deployment. While diffusion distillation methods -- based on distribution matching and trajectory matching -- reduce sampling to as few as one step, they fall short on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Yihong Luo , Tianyang Hu , Jiacheng Sun , Yujun Cai , Jing Tang

This paper proposes a novel method, Explicit Flow Matching (ExFM), for training and analyzing flow-based generative models. ExFM leverages a theoretically grounded loss function, ExFM loss (a tractable form of Flow Matching (FM) loss), to…

Machine Learning · Computer Science 2024-07-03 Gleb Ryzhakov , Svetlana Pavlova , Egor Sevriugov , Ivan Oseledets

Dataset distillation has emerged as an effective strategy, significantly reducing training costs and facilitating more efficient model deployment. Recent advances have leveraged generative models to distill datasets by capturing the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jeffrey A. Chan-Santiago , Praveen Tirupattur , Gaurav Kumar Nayak , Gaowen Liu , Mubarak Shah

Flow matching (FM) trains a time-dependent vector field that transports samples from a simple prior to a complex data distribution. However, for high-dimensional images, each training sample supervises only a single trajectory and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 George Stoica , Sayak Paul , Matthew Wallingford , Vivek Ramanujan , Abhay Nori , Winson Han , Ali Farhadi , Ranjay Krishna , Judy Hoffman

Diffusion Models~(DMs) have emerged as the dominant approach in Generative Artificial Intelligence (GenAI), owing to their remarkable performance in tasks such as text-to-image synthesis. However, practical DMs, such as stable diffusion,…

Machine Learning · Computer Science 2025-08-18 Xuhui Fan , Zhangkai Wu , Hongyu Wu

The diffusion models including Denoising Diffusion Probabilistic Models (DDPM) and score-based generative models have demonstrated excellent performance in speech synthesis tasks. However, its effectiveness comes at the cost of numerous…

Sound · Computer Science 2024-02-01 Wenhao Guan , Qi Su , Haodong Zhou , Shiyu Miao , Xingjia Xie , Lin Li , Qingyang Hong

Step distillation has become a leading technique for accelerating diffusion models, among which Distribution Matching Distillation (DMD) and Consistency Distillation are two representative paradigms. While consistency methods enforce…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Tao Liu , Hao Yan , Mengting Chen , Taihang Hu , Zhengrong Yue , Zihao Pan , Jinsong Lan , Xiaoyong Zhu , Ming-Ming Cheng , Bo Zheng , Yaxing Wang

Diversified distribution matching (DDM) finds a unified translation function mapping a diverse collection of conditional source distributions to their target counterparts. DDM was proposed to resolve content misalignment issues in unpaired…

Machine Learning · Computer Science 2025-11-11 Sagar Shrestha , Xiao Fu

Although diffusion models can generate remarkably high-quality samples, they are intrinsically bottlenecked by their expensive iterative sampling procedure. Consistency models (CMs) have recently emerged as a promising diffusion model…

Recent advances in text-to-3D generation have made significant progress. In particular, with the pretrained diffusion models, existing methods predominantly use Score Distillation Sampling (SDS) to train 3D models such as Neural RaRecent…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Hangyu Li , Xiangxiang Chu , Dingyuan Shi , Wang Lin