English
Related papers

Related papers: Compose Yourself: Average-Velocity Flow Matching f…

200 papers

We introduce RapFlow-TTS, a rapid and high-fidelity TTS acoustic model that leverages velocity consistency constraints in flow matching (FM) training. Although ordinary differential equation (ODE)-based TTS generation achieves…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-23 Hyun Joon Park , Jeongmin Liu , Jin Sob Kim , Jeong Yeol Yang , Sung Won Han , Eunwoo Song

Diffusion models have shown strong performance in speech enhancement, but their real-time applicability has been limited by multi-step iterative sampling. Consistency distillation has recently emerged as a promising alternative by…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-19 Liang Xu , Longfei Felix Yan , W. Bastiaan Kleijn

Recent advances in generative models, such as diffusion and flow matching, have shown strong performance in audio tasks. However, speech enhancement (SE) models are typically trained on limited datasets and evaluated under narrow…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-24 Tianyu Cao , Helin Wang , Ari Frummer , Yuval Sieradzki , Adi Arbel , Laureano Moro Velazquez , Jesus Villalba , Oren Gal , Thomas Thebaud , Najim Dehak

We propose Speech Enhancement based on Drifting Models (DriftSE), a novel generative framework that formulates denoising as an equilibrium problem. Rather than relying on iterative sampling, DriftSE natively achieves one-step inference by…

Current discriminative depth estimation methods often produce blurry artifacts, while generative approaches suffer from slow sampling due to curvatures in the noise-to-depth transport. Our method addresses these challenges by framing depth…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Ming Gui , Johannes Schusterbauer , Ulrich Prestel , Pingchuan Ma , Dmytro Kotovenko , Olga Grebenkova , Stefan Andreas Baumann , Vincent Tao Hu , Björn Ommer

Generative models are capable to address difficult problems with non-unique solutions like bandwidth extension and gap filling, removing highly non-linear artifacts from codecs, clipping and distortion, as opposed to removing linear…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-18 Sebastian Braun

MeanFlow (MF) has recently been established as a framework for one-step generative modeling. However, its ``fastforward'' nature introduces key challenges in both the training objective and the guidance mechanism. First, the original MF's…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhengyang Geng , Yiyang Lu , Zongze Wu , Eli Shechtman , J. Zico Kolter , Kaiming He

Flow Matching has emerged as a powerful framework for learning continuous transformations between distributions, enabling high-fidelity generative modeling. This work introduces Symmetrical Flow Matching (SymmFlow), a new formulation that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Francisco Caetano , Christiaan Viviers , Peter H. N. De With , Fons van der Sommen

Diffusion models have shown promising results in speech enhancement, using a task-adapted diffusion process for the conditional generation of clean speech given a noisy mixture. However, at test time, the neural network used for score…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-17 Bunlong Lay , Jean-Marie Lemercier , Julius Richter , Timo Gerkmann

Flow-based image generative models exhibit stable training and produce high quality samples when using multi-step sampling procedures. One-step generative models can produce high quality image samples but can be difficult to optimize as…

Machine Learning · Computer Science 2026-04-13 Chia-Hong Hsu , Frank Wood

Flow Matching enables simulation-free training of generative models on Riemannian manifolds, yet sampling typically still relies on numerically integrating a probability-flow ODE. We propose Riemannian MeanFlow (RMF), extending MeanFlow to…

Machine Learning · Computer Science 2026-05-21 Zichen Zhong , Haoliang Sun , Yukun Zhao , Yongshun Gong , Yilong Yin

Creating high-quality sound effects from videos and text prompts requires precise alignment between visual and audio domains, both semantically and temporally, along with step-by-step guidance for professional audio generation. However,…

Sound · Computer Science 2025-03-31 Haomin Zhang , Sizhe Shan , Haoyu Wang , Zihao Chen , Xiulong Liu , Chaofan Ding , Xinhan Di

Flow matching offers a robust and stable approach to training diffusion models. However, directly applying flow matching to neural vocoders can result in subpar audio quality. In this work, we present WaveFM, a reparameterized flow matching…

Sound · Computer Science 2025-03-24 Tianze Luo , Xingchen Miao , Wenbo Duan

We propose \emph{Euler Mean Flows (EMF)}, a flow-based generative framework for one-step and few-step generation that enforces long-range trajectory consistency with minimal sampling cost. The key idea of EMF is to replace the trajectory…

Machine Learning · Computer Science 2026-02-04 Zhiqi Li , Yuchen Sun , Duowen Chen , Jinjin He , Bo Zhu

Diffusion-based generative processes, formulated as differential equation solving, frequently balance computational speed with sample quality. Our theoretical investigation of ODE- and SDE-based solvers reveals complementary weaknesses: ODE…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Ruoyu Wang , Beier Zhu , Junzhi Li , Liangyu Yuan , Chi Zhang

We introduce the Self-Evaluating Model (Self-E), a novel, from-scratch training approach for text-to-image generation that supports any-step inference. Self-E learns from data similarly to a Flow Matching model, while simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Xin Yu , Xiaojuan Qi , Zhengqi Li , Kai Zhang , Richard Zhang , Zhe Lin , Eli Shechtman , Tianyu Wang , Yotam Nitzan

We introduce COT-FM, a general framework that reshapes the probability path in Flow Matching (FM) to achieve faster and more reliable generation. FM models often produce curved trajectories due to random or batchwise couplings, which…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Chiensheng Chiang , Kuan-Hsun Tu , Jia-Wei Liao , Cheng-Fu Chou , Tsung-Wei Ke

Self-conditioning has been central to the success of continuous diffusion language models, as it allows models to correct previous errors. Yet its ability degrades precisely in the regime where diffusion is most attractive for deployment:…

Computation and Language · Computer Science 2026-04-08 Dat Nguyen-Cong , Tung Kieu , Hoang Thanh-Tung

Fast and accurate generation of molecular conformers is desired for downstream computational chemistry and drug discovery tasks. Currently, training and sampling state-of-the-art diffusion or flow-based models for conformer generation…

Reducing communication overhead in federated learning (FL) is challenging but crucial for large-scale distributed privacy-preserving machine learning. While methods utilizing sparsification or others can largely lower the communication…

Machine Learning · Computer Science 2023-03-21 Yuhao Zhou , Mingjia Shi , Yuanxi Li , Qing Ye , Yanan Sun , Jiancheng Lv