English
Related papers

Related papers: Consistency Flow Matching: Defining Straight Flows…

200 papers

Generative models excel at synthesizing high-fidelity samples from complex data distributions, but they often violate hard constraints arising from physical laws or task specifications. A common remedy is to project intermediate samples…

Machine Learning · Computer Science 2025-09-30 Jinhao Liang , Yixuan Sun , Anirban Samaddar , Sandeep Madireddy , Ferdinando Fioretto

Flow matching (FM) learns vector fields by regressing stochastic velocity targets along intermediate distributions $p_t$. We identify a geometric optimization bottleneck in this regression problem: when the covariance $\Sigma_t$ of $p_t$ is…

Machine Learning · Computer Science 2026-05-14 Shadab Ahamed , Eshed Gal , Md Shahriar Rahim Siddiqui , Simon Ghyselincks , Moshe Eliasof , Eldad Haber

Despite Flow Matching and diffusion models having emerged as powerful generative paradigms for continuous variables such as images and videos, their application to high-dimensional discrete data, such as language, is still limited. In this…

Machine Learning · Computer Science 2024-11-06 Itai Gat , Tal Remez , Neta Shaul , Felix Kreuk , Ricky T. Q. Chen , Gabriel Synnaeve , Yossi Adi , Yaron Lipman

We introduce RapFlow-TTS, a rapid and high-fidelity TTS acoustic model that leverages velocity consistency constraints in flow matching (FM) training. Although ordinary differential equation (ODE)-based TTS generation achieves…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-23 Hyun Joon Park , Jeongmin Liu , Jin Sob Kim , Jeong Yeol Yang , Sung Won Han , Eunwoo Song

Existing rectified flow models are based on linear trajectories between data and noise distributions. This linearity enforces zero curvature, which can inadvertently force the image generation process through low-probability regions of the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yan Luo , Drake Du , Hao Huang , Yi Fang , Mengyu Wang

Diffusion models can learn rich representations during data generation, showing potential for Self-Supervised Learning (SSL), but they face a trade-off between generative quality and discriminative performance. Their iterative sampling also…

Machine Learning · Computer Science 2025-12-24 Kosuke Ukita , Tsuyoshi Okita

We consider the problem of designing constraint-aware flow matching (FM) models that address the issue of constraint violations commonly observed in vanilla generative models. We consider two scenarios, viz.: (a) when a differentiable…

Machine Learning · Computer Science 2026-05-01 Zhengyan Huan , Jacob Boerma , Li-Ping Liu , Shuchin Aeron

We provide a theoretical analysis for end-to-end training Discrete Flow Matching (DFM) generative models. DFM is a promising discrete generative modeling framework that learns the underlying generative dynamics by training a neural network…

Machine Learning · Computer Science 2025-09-29 Maojiang Su , Mingcheng Lu , Jerry Yao-Chieh Hu , Shang Wu , Zhao Song , Alex Reneau , Han Liu

Flow models parameterized as time-dependent velocity fields can generate data from noise by integrating an ODE. These models are often trained using flow matching, i.e. by sampling random pairs of noise and target points…

Machine Learning · Computer Science 2026-01-26 Alireza Mousavi-Hosseini , Stephen Y. Zhang , Michal Klein , Marco Cuturi

We propose Functional Flow Matching (FFM), a function-space generative model that generalizes the recently-introduced Flow Matching model to operate in infinite-dimensional spaces. Our approach works by first defining a path of probability…

Machine Learning · Computer Science 2023-12-07 Gavin Kerrigan , Giosue Migliorini , Padhraic Smyth

Flow Matching (FM) has recently emerged as a leading approach for high-fidelity visual generation, offering a robust continuous-time alternative to ordinary differential equation (ODE) based models. However, despite their success, FM models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Dayu Wang , Jiaye Yang , Weikang Li , Jiahui Liang , Yang Li

Flow matching casts sample generation as learning a continuous-time velocity field that transports noise to data. Existing flow matching networks typically predict each point's velocity independently, considering only its location and time…

Machine Learning · Computer Science 2025-11-11 Md Shahriar Rahim Siddiqui , Moshe Eliasof , Eldad Haber

Simulation-free methods for training continuous-time generative models construct probability paths that go between noise distributions and individual data samples. Recent works, such as Flow Matching, derived paths that are optimal for each…

Training deep neural networks remains computationally intensive due to the itera2 tive nature of gradient-based optimization. We propose Gradient Flow Matching (GFM), a continuous-time modeling framework that treats neural network training…

Machine Learning · Computer Science 2025-05-27 Xiao Shou , Yanna Ding , Jianxi Gao

Flow matching (FM) trains a time-dependent vector field that transports samples from a simple prior to a complex data distribution. However, for high-dimensional images, each training sample supervises only a single trajectory and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 George Stoica , Sayak Paul , Matthew Wallingford , Vivek Ramanujan , Abhay Nori , Winson Han , Ali Farhadi , Ranjay Krishna , Judy Hoffman

Generative models, particularly Diffusion Models (DM), have shown strong potential for Computed Tomography (CT) reconstruction serving as expressive priors for solving ill-posed inverse problems. However, diffusion-based reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Jiayang Shi , Lincen Yang , Zhong Li , Tristan Van Leeuwen , Daniel M. Pelt , K. Joost Batenburg

Flow-matching models deliver state-of-the-art fidelity in image and video generation, but the inherent sequential denoising process renders them slower. Existing acceleration methods like distillation, trajectory truncation, and consistency…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Divya Jyoti Bajpai , Dhruv Bhardwaj , Soumya Roy , Tejas Duseja , Harsh Agarwal , Aashay Sandansing , Manjesh Kumar Hanawal

Trajectory prediction and generation are crucial for autonomous robots in dynamic environments. While prior research has typically focused on either prediction or generation, our approach unifies these tasks to provide a versatile framework…

Robotics · Computer Science 2024-11-08 Sean Ye , Matthew Gombolay

We propose Shallow Flow Matching (SFM), a novel mechanism that enhances flow matching (FM)-based text-to-speech (TTS) models within a coarse-to-fine generation paradigm. Unlike conventional FM modules, which use the coarse representations…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-24 Dong Yang , Yiyi Cai , Yuki Saito , Lixu Wang , Hiroshi Saruwatari

Modern vision generators transport a base distribution to data through time-indexed measures, implemented as deterministic flows (ODEs) or stochastic diffusions (SDEs). Despite strong empirical performance, standard flow-matching objectives…

Machine Learning · Computer Science 2026-02-27 Chika Maduabuchi