English
Related papers

Related papers: IntMeanFlow: Few-step Speech Generation with Integ…

200 papers

One-step generative modeling seeks to generate high-quality data samples in a single function evaluation, significantly improving efficiency over traditional diffusion or flow-based models. In this work, we introduce Modular MeanFlow (MMF),…

Machine Learning · Computer Science 2025-08-26 Haochen You , Baojing Liu , Hongyang He

Recent progress in text-to-3D generation has been achieved through the utilization of score distillation methods: they make use of the pre-trained text-to-image (T2I) diffusion models by distilling via the diffusion model training…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Kyungmin Lee , Kihyuk Sohn , Jinwoo Shin

MeanFlow (MF) is a diffusion-motivated generative model that enables efficient few-step generation by learning long jumps directly from noise to data. In practice, it is often used as a latent MF by leveraging the pre-trained Stable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zheyuan Hu , Chieh-Hsin Lai , Ge Wu , Yuki Mitsufuji , Stefano Ermon

Flow matching has emerged as a powerful generative framework, with recent few-step methods achieving remarkable inference acceleration. However, we identify a critical yet overlooked limitation: these models suffer from severe diversity…

Machine Learning · Computer Science 2026-04-15 Yexiong Lin , Jia Shi , Shanshan Ye , Wanyu Wang , Yu Yao , Tongliang Liu

In the realm of Artificial Intelligence Generated Content (AIGC), flow-matching models have emerged as a powerhouse, achieving success due to their robust theoretical underpinnings and solid ability for large-scale generative modeling.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Zemin Huang , Zhengyang Geng , Weijian Luo , Guo-jun Qi

This paper introduces F5-TTS, a fully non-autoregressive text-to-speech system based on flow matching with Diffusion Transformer (DiT). Without requiring complex designs such as duration model, text encoder, and phoneme alignment, the text…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Yushen Chen , Zhikang Niu , Ziyang Ma , Keqi Deng , Chunhui Wang , Jian Zhao , Kai Yu , Xie Chen

Recent advances in text-to-3D generation have made significant progress. In particular, with the pretrained diffusion models, existing methods predominantly use Score Distillation Sampling (SDS) to train 3D models such as Neural RaRecent…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Hangyu Li , Xiangxiang Chu , Dingyuan Shi , Wang Lin

Existing large-scale zero-shot text-to-speech (TTS) models deliver high speech quality but suffer from slow inference speeds due to massive parameters. To address this issue, this paper introduces ZipVoice, a high-quality…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-08 Han Zhu , Wei Kang , Zengwei Yao , Liyong Guo , Fangjun Kuang , Zhaoqing Li , Weiji Zhuang , Long Lin , Daniel Povey

Diffusion models have demonstrated significant potential in speech synthesis tasks, including text-to-speech (TTS) and voice cloning. However, their iterative denoising processes are computationally intensive, and previous distillation…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-21 Yingahao Aaron Li , Rithesh Kumar , Zeyu Jin

Flow-matching models deliver state-of-the-art fidelity in image and video generation, but the inherent sequential denoising process renders them slower. Existing acceleration methods like distillation, trajectory truncation, and consistency…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Divya Jyoti Bajpai , Dhruv Bhardwaj , Soumya Roy , Tejas Duseja , Harsh Agarwal , Aashay Sandansing , Manjesh Kumar Hanawal

Existing dominant methods for audio generation include Generative Adversarial Networks (GANs) and diffusion-based methods like Flow Matching. GANs suffer from slow convergence during training, while diffusion methods require multi-step…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-10 Zengwei Yao , Wei Kang , Han Zhu , Liyong Guo , Lingxuan Ye , Fangjun Kuang , Weiji Zhuang , Zhaoqing Li , Zhifeng Han , Long Lin , Daniel Povey

Unconstrained lip-to-speech synthesis aims to generate corresponding speeches from silent videos of talking faces with no restriction on head poses or vocabulary. Current works mainly use sequence-to-sequence models to solve this problem,…

Sound · Computer Science 2022-07-14 Yongqi Wang , Zhou Zhao

Flow matching has demonstrated strong generative capabilities and has become a core component in modern Text-to-Speech (TTS) systems. To ensure high-quality speech synthesis, Classifier-Free Guidance (CFG) is widely used during the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-05 Yuzhe Liang , Wenzhe Liu , Chunyu Qiang , Zhikang Niu , Yushen Chen , Ziyang Ma , Wenxi Chen , Nan Li , Chen Zhang , Xie Chen

Few-step generation has been a long-standing goal, with recent one-step generation methods exemplified by MeanFlow achieving remarkable results. Existing research on MeanFlow primarily focuses on class-to-image generation. However, an…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chenxi Zhao , Chen Zhu , Xiaokun Feng , Aiming Hao , Jiashu Zhu , Jiachen Lei , Jiahong Wu , Xiangxiang Chu , Jufeng Yang

Neural Text-to-Speech (TTS) systems find broad applications in voice assistants, e-learning, and audiobook creation. The pursuit of modern models, like Diffusion Models (DMs), holds promise for achieving high-fidelity, real-time speech…

Sound · Computer Science 2024-04-02 Xiang Li , Fan Bu , Ambuj Mehrish , Yingting Li , Jiale Han , Bo Cheng , Soujanya Poria

Flow Matching enables simulation-free training of generative models on Riemannian manifolds, yet sampling typically still relies on numerically integrating a probability-flow ODE. We propose Riemannian MeanFlow (RMF), extending MeanFlow to…

Machine Learning · Computer Science 2026-05-21 Zichen Zhong , Haoliang Sun , Yukun Zhao , Yongshun Gong , Yilong Yin

We present MeanCache, a training-free caching framework for efficient Flow Matching inference. Existing caching methods reduce redundant computation but typically rely on instantaneous velocity information (e.g., feature caching), which…

Machine Learning · Computer Science 2026-03-10 Huanlin Gao , Ping Chen , Fuyuan Shi , Ruijia Wu , Li YanTao , Qiang Hui , Yuren You , Ting Lu , Chao Tan , Shaoan Zhao , Zhaoxiang Liu , Fang Zhao , Kai Wang , Shiguo Lian

Flow-matching models have recently emerged as a powerful framework for continuous generative modeling, including 3D point cloud synthesis. However, their deployment is limited by the need for multiple sequential sampling steps at inference…

Machine Learning · Computer Science 2026-03-20 Elaheh Akbari , Shansita Sharma , Ping He , Ahmadreza Moradipari , Kyungtae Han , Hamed Pirsiavash , Yikun Bai , Soheil Kolouri

The multi-step denoising process in diffusion and Flow Matching models causes major efficiency issues, which motivates research on few-step generation. We present Solution Flow Models (SoFlow), a framework for one-step generation from…

Machine Learning · Computer Science 2026-03-03 Tianze Luo , Haotian Yuan , Zhuang Liu

We present SD3.5-Flash, an efficient few-step distillation framework that brings high-quality image generation to accessible consumer devices. Our approach distills computationally prohibitive rectified flow models through a reformulated…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Hmrishav Bandyopadhyay , Rahim Entezari , Jim Scott , Reshinth Adithyan , Yi-Zhe Song , Varun Jampani