English
Related papers

Related papers: DSFlow: Dual Supervision and Step-Aware Architectu…

200 papers

Conventional physically based rendering (PBR) pipelines generate photorealistic images through computationally intensive light transport simulations. Although recent deep learning approaches leverage diffusion model priors with geometry…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Shenghao Zhang , Runtao Liu , Christopher Schroers , Yang Zhang

Consistent distillation methods have evolved into effective techniques that significantly accelerate the sampling process of diffusion models. Although existing methods have achieved remarkable results, the selection of target timesteps…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Qi Wang , Shuliang Zhu , Jinjia Zhou

Existing Flow Matching (FM) text-to-image models suffer from two critical bottlenecks under multi-task alignment: the reward sparsity induced by scalar-valued rewards, and the gradient interference arising from jointly optimizing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zhen Fang , Wenxuan Huang , Yu Zeng , Yiming Zhao , Shuang Chen , Kaituo Feng , Yunlong Lin , Lin Chen , Zehui Chen , Shaosheng Cao , Feng Zhao

We introduce MelodyFlow, an efficient text-controllable high-fidelity music generation and editing model. It operates on continuous latent representations from a low frame rate 48 kHz stereo variational auto encoder codec. Based on a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-17 Gael Le Lan , Bowen Shi , Zhaoheng Ni , Sidd Srinivasan , Anurag Kumar , Brian Ellis , David Kant , Varun Nagaraja , Ernie Chang , Wei-Ning Hsu , Yangyang Shi , Vikas Chandra

Normalizing flows are a powerful class of generative models demonstrating strong performance in several speech and vision problems. In contrast to other generative models, normalizing flows are latent variable models with tractable…

Machine Learning · Computer Science 2021-08-06 Dmitry Baranchuk , Vladimir Aliev , Artem Babenko

Recent advances in text-to-3D generation have made significant progress. In particular, with the pretrained diffusion models, existing methods predominantly use Score Distillation Sampling (SDS) to train 3D models such as Neural RaRecent…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Hangyu Li , Xiangxiang Chu , Dingyuan Shi , Wang Lin

Recently, a series of diffusion-aware distillation algorithms have emerged to alleviate the computational overhead associated with the multi-step inference process of Diffusion Models (DMs). Current distillation techniques often dichotomize…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Yuxi Ren , Xin Xia , Yanzuo Lu , Jiacheng Zhang , Jie Wu , Pan Xie , Xing Wang , Xuefeng Xiao

The slow inference process of image diffusion models significantly degrades interactive user experiences. To address this, we introduce Diffusion Preview, a novel paradigm employing rapid, low-step sampling to generate preliminary outputs…

Machine Learning · Computer Science 2026-04-08 Fu-Yun Wang , Hao Zhou , Liangzhe Yuan , Sanghyun Woo , Boqing Gong , Bohyung Han , Ming-Hsuan Yang , Han Zhang , Yukun Zhu , Ting Liu , Long Zhao

We propose Shallow Flow Matching (SFM), a novel mechanism that enhances flow matching (FM)-based text-to-speech (TTS) models within a coarse-to-fine generation paradigm. Unlike conventional FM modules, which use the coarse representations…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-24 Dong Yang , Yiyi Cai , Yuki Saito , Lixu Wang , Hiroshi Saruwatari

Diffusion models generate high-quality images but require dozens of forward passes. We introduce Distribution Matching Distillation (DMD), a procedure to transform a diffusion model into a one-step image generator with minimal impact on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Tianwei Yin , Michaël Gharbi , Richard Zhang , Eli Shechtman , Fredo Durand , William T. Freeman , Taesung Park

Diffusion-based generative models have demonstrated their powerful performance across various tasks, but this comes at a cost of the slow sampling speed. To achieve both efficient and high-quality synthesis, various distillation-based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Zhenyu Zhou , Defang Chen , Can Wang , Chun Chen , Siwei Lyu

Recent hybrid video generation models combine autoregressive temporal dynamics with diffusion-based spatial denoising, but their sequential, iterative nature leads to error accumulation and long inference times. In this work, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Yongqi Yang , Huayang Huang , Xu Peng , Xiaobin Hu , Donghao Luo , Jiangning Zhang , Chengjie Wang , Yu Wu

With the rapid advancement of speech generative models, unauthorized voice cloning poses significant privacy and security risks. Speech watermarking offers a viable solution for tracing sources and preventing misuse. Current watermarking…

Sound · Computer Science 2025-09-30 Yang Cui , Peter Pan , Lei He , Sheng Zhao

Large video diffusion and flow models have achieved remarkable success in high-quality video generation, but their use in real-time interactive applications remains limited due to their inefficient multi-step sampling process. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Weili Nie , Julius Berner , Nanye Ma , Chao Liu , Saining Xie , Arash Vahdat

Diffusion-based text-to-image generation models trained on extensive text-image pairs have demonstrated the ability to produce photorealistic images aligned with textual descriptions. However, a significant limitation of these models is…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Mingyuan Zhou , Zhendong Wang , Huangjie Zheng , Hai Huang

Current federated learning algorithms take tens of communication rounds transmitting unwieldy model weights under ideal circumstances and hundreds when data is poorly distributed. Inspired by recent work on dataset distillation and…

Machine Learning · Computer Science 2021-06-08 Yanlin Zhou , George Pu , Xiyao Ma , Xiaolin Li , Dapeng Wu

Computational fluid dynamics (CFD) provides high-fidelity simulations of fluid flows but remains computationally expensive for many-query applications. In recent years deep learning (DL) has been used to construct data-driven fluid-dynamic…

Machine Learning · Computer Science 2026-04-13 David Ramos , Lucas Lacasa , Fermín Gutiérrez , Eusebio Valero , Gonzalo Rubio

Finding a suitable layout represents a crucial task for diverse applications in graphic design. Motivated by simpler and smoother sampling trajectories, we explore the use of Flow Matching as an alternative to current diffusion-based layout…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Julian Jorge Andrade Guerreiro , Naoto Inoue , Kento Masui , Mayu Otani , Hideki Nakayama

Dataset distillation provides an effective approach to reduce memory and computational costs by optimizing a compact dataset that achieves performance comparable to the full original. However, for large-scale datasets and complex deep…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Xinhao Zhong , Shuoyang Sun , Xulin Gu , Zhaoyang Xu , Yaowei Wang , Min Zhang , Bin Chen

Distribution Matching Distillation (DMD) facilitates efficient inference by distilling multi-step diffusion models into few-step variants. Concurrently, Reinforcement Learning (RL) has emerged as a vital tool for aligning generative models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Dengyang Jiang , Dongyang Liu , Zanyi Wang , Qilong Wu , Liuzhuozheng Li , Hengzhuang Li , Xin Jin , David Liu , Changsheng Lu , Zhen Li , Bo Zhang , Mengmeng Wang , Steven Hoi , Peng Gao , Harry Yang