English
Related papers

Related papers: Compose Yourself: Average-Velocity Flow Matching f…

200 papers

Diffusion models (DMs) are a powerful generative framework that have attracted significant attention in recent years. However, the high computational cost of training DMs limits their practical applications. In this paper, we start with a…

Machine Learning · Computer Science 2024-04-12 Tianshuo Xu , Peng Mi , Ruilin Wang , Yingcong Chen

Flow-based generative models synthesize data by integrating a learned velocity field from a reference distribution to the target data distribution. Prior work has focused on endpoint metrics (e.g., fidelity, likelihood, perceptual quality)…

Machine Learning · Computer Science 2025-11-25 Ziyun Li , Ben Dai , Huancheng Hu , Henrik Boström , Soon Hoe Lim

Deep learning-based speech enhancement (SE) methods often face significant computational challenges when needing to meet low-latency requirements because of the increased number of frames to be processed. This paper introduces the SlowFast…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-07 Longbiao Cheng , Ashutosh Pandey , Buye Xu , Tobi Delbruck , Vamsi Krishna Ithapu , Shih-Chii Liu

We introduce $\texttt{PairFlow}$, a lightweight preprocessing step for training Discrete Flow Models (DFMs) to achieve few-step sampling without requiring a pretrained teacher. DFMs have recently emerged as a new class of generative models…

Machine Learning · Computer Science 2026-05-26 Mingue Park , Jisung Hwang , Seungwoo Yoo , Kyeongmin Yeo , Minhyuk Sung

Current state-of-the-art generative approaches frequently rely on a two-stage training procedure, where an autoencoder (often a VAE) first performs dimensionality reduction, followed by training a generative model on the learned latent…

Machine Learning · Statistics 2025-07-15 Gianluigi Silvestri , Luca Ambrogioni

Recently normalizing flows have been gaining traction in text-to-speech (TTS) and voice conversion (VC) due to their state-of-the-art (SOTA) performance. Normalizing flows are unsupervised generative models. In this paper, we introduce…

Sound · Computer Science 2023-12-29 Jakub Mosiński , Piotr Biliński , Thomas Merritt , Abdelhamid Ezzerg , Daniel Korzekwa

This work presents DCFlow, a novel unsupervised cross-modal flow estimation framework that integrates a decoupled optimization strategy and a cross-modal consistency constraint. Unlike previous approaches that implicitly learn flow…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Runmin Zhang , Jialiang Wang , Si-Yuan Cao , Zhu Yu , Junchen Yu , Guangyi Zhang , Hui-Liang Shen

Speech enhancement (SE) aims to improve the quality and intelligibility of speech in noisy environments. Recent studies have shown that incorporating visual cues in audio signal processing can enhance SE performance. Given that human speech…

Sound · Computer Science 2025-05-27 Meng-Ping Lin , Jen-Cheng Hou , Chia-Wei Chen , Shao-Yi Chien , Jun-Cheng Chen , Xugang Lu , Yu Tsao

Human motion synthesis is a fundamental task in computer animation. Recent methods based on diffusion models or GPT structure demonstrate commendable performance but exhibit drawbacks in terms of slow sampling speeds and error accumulation.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Vincent Tao Hu , Wenzhe Yin , Pingchuan Ma , Yunlu Chen , Basura Fernando , Yuki M Asano , Efstratios Gavves , Pascal Mettes , Bjorn Ommer , Cees G. M. Snoek

Reinforcement Learning (RL) has recently emerged as a powerful technique for improving image and video generation in Diffusion and Flow Matching models, specifically for enhancing output quality and alignment with prompts. A critical step…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Feng Wang , Zihao Yu

Discrete flow matching generates text by iteratively transforming noise tokens into coherent language, but may require hundreds of forward passes. Distillation uses the multi-step trajectory to train a student to reproduce the process in a…

Machine Learning · Computer Science 2026-05-11 Amin Karimi Monsefi , Dominic Culver , Nikhil Bhendawade , Manuel R. Ciosici , Yizhe Zhang , Irina Belousova

Generative motion prediction must satisfy three simultaneous requirements for real-world autonomy: high accuracy, diverse multimodal futures, and strictly bounded latency. Diffusion models meet the first two but violate the third, requiring…

Robotics · Computer Science 2026-04-30 Leandro Di Bella , Adrian Munteanu , Bruno Cornelis

Dynamical generative models that produce samples through an iterative process, such as Flow Matching and denoising diffusion models, have seen widespread use, but there have not been many theoretically-sound methods for improving these…

Machine Learning · Computer Science 2025-01-08 Carles Domingo-Enrich , Michal Drozdzal , Brian Karrer , Ricky T. Q. Chen

While the field of co-speech gesture generation has seen significant advances, producing holistic, semantically grounded gestures remains a challenge. Existing approaches rely on external semantic retrieval methods, which limit their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Lanmiao Liu , Esam Ghaleb , Aslı Özyürek , Zerrin Yumak

In this paper, we present a vocoder-free framework for audio super-resolution that employs a flow matching generative model to capture the conditional distribution of complex-valued spectral coefficients. Unlike conventional two-stage…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Woongjib Choi , Sangmin Lee , Hyungseob Lim , Hong-Goo Kang

Constitutive evaluations often dominate the computational cost of finite element (FE) simulations whenever material models are complex. Neural constitutive models (NCMs) offer a highly expressive and flexible framework for modeling complex…

Computational Engineering, Finance, and Science · Computer Science 2026-01-21 Benjamin Alheit , Mathias Peirlinck , Siddhant Kumar

Flow models parameterized as time-dependent velocity fields can generate data from noise by integrating an ODE. These models are often trained using flow matching, i.e. by sampling random pairs of noise and target points…

Machine Learning · Computer Science 2026-01-26 Alireza Mousavi-Hosseini , Stephen Y. Zhang , Michal Klein , Marco Cuturi

Consistency Models (CM) (Song et al., 2023) accelerate score-based diffusion model sampling at the cost of sample quality but lack a natural way to trade-off quality for speed. To address this limitation, we propose Consistency Trajectory…

While flow matching is elegant, its reliance on single-sample conditional velocities leads to high-variance training targets that destabilize optimization and slow convergence. By explicitly characterizing this variance, we identify 1) a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Donglin Yang , Yongxing Zhang , Xin Yu , Liang Hou , Xin Tao , Pengfei Wan , Xiaojuan Qi , Renjie Liao

Ensemble calculations are essential for systems with uncertain data but require substantial increase in computational resources. This increase severely limits ensemble size. To reach beyond current limits, we present a first-order…

Numerical Analysis · Mathematics 2017-12-19 Joseph A. Fiordilino , Michael McLaughlin