English
Related papers

Related papers: Self-Corrected Flow Distillation for Consistent On…

200 papers

Consistent distillation methods have evolved into effective techniques that significantly accelerate the sampling process of diffusion models. Although existing methods have achieved remarkable results, the selection of target timesteps…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Qi Wang , Shuliang Zhu , Jinjia Zhou

Distilling latent diffusion models (LDMs) into ones that are fast to sample from is attracting growing research interest. However, the majority of existing methods face two critical challenges: (1) They hinge on long training using a huge…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Qingsong Xie , Zhenyi Liao , Zhijie Deng , Chen chen , Haonan Lu

Super-resolution (SR) aims to reconstruct high-resolution (HR) images from their low-resolution (LR) counterparts, often relying on effective downsampling to generate diverse and realistic training pairs. In this work, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Sohwi Kim , Tae-Kyun Kim

Diffusion- and flow-based models have advanced Real-world Image Super-Resolution (Real-ISR), but their multi-step sampling makes inference slow and hard to deploy. One-step distillation alleviates the cost, yet often degrades restoration…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Ruiqing Wang , Kai Zhang , Yuanzhi Zhu , Hanshu Yan , Shilin Lu , Jian Yang

Flow matching (FM) is a general framework for defining probability paths via Ordinary Differential Equations (ODEs) to transform between noise and data samples. Recent approaches attempt to straighten these flow trajectories to generate…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Ling Yang , Zixiang Zhang , Zhilong Zhang , Xingchao Liu , Minkai Xu , Wentao Zhang , Chenlin Meng , Stefano Ermon , Bin Cui

Discrete diffusion or flow models could enable faster and more controllable sequence generation than autoregressive models. We show that na\"ive linear flow matching on the simplex is insufficient toward this goal since it suffers from…

Biomolecules · Quantitative Biology 2024-06-03 Hannes Stark , Bowen Jing , Chenyu Wang , Gabriele Corso , Bonnie Berger , Regina Barzilay , Tommi Jaakkola

Diffusion models and flow-matching models have enabled generating diverse and realistic images by learning to transfer noise to data. However, sampling from these models involves iterative denoising over many neural network passes, making…

Machine Learning · Computer Science 2025-06-24 Kevin Frans , Danijar Hafner , Sergey Levine , Pieter Abbeel

Audio super-resolution is challenging owing to its ill-posed nature. Recently, the application of diffusion models in audio super-resolution has shown promising results in alleviating this challenge. However, diffusion-based models have…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-12 Jun-Hak Yun , Seung-Bin Kim , Seong-Whan Lee

Score distillation sampling~(SDS) has been widely adopted to overcome the absence of unseen views in reconstructing 3D objects from a \textbf{single} image. It leverages pre-trained 2D diffusion models as teacher to guide the reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Xuanyu Yi , Zike Wu , Qingshan Xu , Pan Zhou , Joo-Hwee Lim , Hanwang Zhang

Generative policies based on diffusion and flow matching achieve strong performance in robotic manipulation by modeling multi-modal human demonstrations. However, their reliance on iterative Ordinary Differential Equation (ODE) integration…

Generative models have emerged as a powerful paradigm for solving physics systems and modeling complex spatiotemporal dynamics. However, achieving high physical accuracy without incurring high computational cost remains a fundamental…

Machine Learning · Computer Science 2026-05-27 Jiahe Huang , Sihan Xu , Sharvaree Vadgama , Rose Yu

This paper introduces DLM-One, a score-distillation-based framework for one-step sequence generation with continuous diffusion language models (DLMs). DLM-One eliminates the need for iterative refinement by aligning the scores of a student…

Computation and Language · Computer Science 2025-06-03 Tianqi Chen , Shujian Zhang , Mingyuan Zhou

Continuous diffusion and flow matching models could represent a powerful alternative to autoregressive approaches for language modelling (LM), as they unlock a host of advantages currently reserved for continuous modalities, including…

Machine Learning · Computer Science 2026-05-12 Oscar Davis , Anastasiia Filippova , Pierre Ablin , Victor Turrisi , Amitis Shidani , Marco Cuturi , Louis Béthune

Generative models are increasingly able to produce remarkably high quality images and text. The community has developed numerous evaluation metrics for comparing generative models. However, these metrics do not effectively quantify data…

Machine Learning · Computer Science 2020-10-15 Liam Fowl , Micah Goldblum , Arjun Gupta , Amr Sharaf , Tom Goldstein

Iterative generative models such as Flow Matching and Diffusion models have demonstrated strong test-time scaling behavior, where additional inference computation can improve generation quality. In contrast, Drift Models offer efficient…

Machine Learning · Computer Science 2026-05-19 Chenrui Ma , Xi Xiao , Lin Zhao , Tianyang Wang , Ferdinando Fioretto , Yanning Shen

Fine-tuning flow matching models is a central challenge in settings with limited data, evolving distributions, or strict efficiency demands, where unconstrained fine-tuning can erode the accuracy and efficiency gains learned during…

Machine Learning · Computer Science 2026-02-02 Gudrun Thorkelsdottir , Arindam Banerjee

Diffusion models and their variations, such as rectified flows, generate diverse and high-quality images, but they are still hindered by slow iterative sampling caused by the highly curved generative paths they learn. An important cause of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Nazir Nayal , Christopher Wewer , Jan Eric Lenssen

Video diffusion models have shown great potential in generating high-quality videos, making them an increasingly popular focus. However, their inherent iterative nature leads to substantial computational and time costs. While efforts have…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Xiaofeng Mao , Zhengkai Jiang , Fu-Yun Wang , Jiangning Zhang , Hao Chen , Mingmin Chi , Yabiao Wang , Wenhan Luo

Although diffusion model has shown great potential for generating higher quality images than GANs, slow sampling speed hinders its wide application in practice. Progressive distillation is thus proposed for fast sampling by progressively…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Wujie Sun , Defang Chen , Can Wang , Deshi Ye , Yan Feng , Chun Chen

Diffusion-based generative models have achieved state-of-the-art performance for perceptual quality in speech enhancement (SE). However, their iterative nature requires numerous Neural Function Evaluations (NFEs), posing a challenge for…