English
Related papers

Related papers: On the Relation between Rectified Flows and Optima…

200 papers

This paper proposes a novel method, Explicit Flow Matching (ExFM), for training and analyzing flow-based generative models. ExFM leverages a theoretically grounded loss function, ExFM loss (a tractable form of Flow Matching (FM) loss), to…

Machine Learning · Computer Science 2024-07-03 Gleb Ryzhakov , Svetlana Pavlova , Egor Sevriugov , Ivan Oseledets

Diffusion and flow-matching have emerged as powerful methodologies for generative modeling, with remarkable success in capturing complex data distributions and enabling flexible guidance at inference time. Many downstream applications,…

Machine Learning · Computer Science 2026-04-28 Zeyang Li , Kaveh Alim , Navid Azizan

Flow matching policies learn continuous velocity fields that transport noise to actions, enabling fast deterministic inference for robot manipulation. However, standard training optimizes a pointwise velocity objective while inference…

Robotics · Computer Science 2026-05-12 Riad Ahmed , Sujosh Nag , Moniruzzaman Akash , Mostafa Hussein , Momotaz Begum

Diffusion models have greatly improved visual generation but are hindered by slow generation speed due to the computationally intensive nature of solving generative ODEs. Rectified flow, a widely recognized solution, improves generation…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Fu-Yun Wang , Ling Yang , Zhaoyang Huang , Mengdi Wang , Hongsheng Li

Flow matching has recently emerged as a promising alternative to diffusion-based generative models, particularly for text-to-image generation. Despite its flexibility in allowing arbitrary source distributions, most existing approaches rely…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Junwan Kim , Jiho Park , Seonghu Jeon , Seungryong Kim

Replacing positivity constraints by an entropy barrier is popular to approximate solutions of linear programs. In the special case of the optimal transport problem, this technique dates back to the early work of Schr\"odinger. This approach…

Analysis of PDEs · Mathematics 2017-01-10 Guillaume Carlier , Vincent Duval , Gabriel Peyré , Bernhard Schmitzer

Normalizing flows are generative models that provide tractable density estimation via an invertible transformation from a simple base distribution to a complex target distribution. However, this technique cannot directly model data…

Machine Learning · Statistics 2021-11-15 Brendan Leigh Ross , Jesse C. Cresswell

Fine-tuning flow matching models is a central challenge in settings with limited data, evolving distributions, or strict efficiency demands, where unconstrained fine-tuning can erode the accuracy and efficiency gains learned during…

Machine Learning · Computer Science 2026-02-02 Gudrun Thorkelsdottir , Arindam Banerjee

Among generative neural models, flow matching techniques stand out for their simple applicability and good scaling properties. Here, velocity fields of curves connecting a simple latent and a target distribution are learned. Then the…

Machine Learning · Computer Science 2026-04-27 Christian Wald , Gabriele Steidl

Flow-based models are powerful tools for designing probabilistic models with tractable density. This paper introduces Convex Potential Flows (CP-Flow), a natural and efficient parameterization of invertible models inspired by the optimal…

Machine Learning · Computer Science 2021-02-25 Chin-Wei Huang , Ricky T. Q. Chen , Christos Tsirigotis , Aaron Courville

Flow Matching is a powerful framework for learning transport maps between probability distributions. Yet its standard single-parameter formulation is not designed to capture multi-parameter variations where the resulting transport should be…

Rectified Flow offers a simple and effective approach to high-quality generative modeling by learning a velocity field. However, we identify a limitation in directly modeling the velocity with an unconstrained neural network: the learned…

Machine Learning · Computer Science 2025-10-21 Xixi Hu , Runlong Liao , Keyang Xu , Bo Liu , Yeqing Li , Eugene Ie , Hongliang Fei , Qiang Liu

Bifurcation phenomena in nonlinear dynamical systems often lead to multiple coexisting stable solutions, particularly in the presence of symmetry breaking. Deterministic machine learning models are unable to capture this multiplicity,…

Machine Learning · Computer Science 2026-01-26 Fleur Hendriks , Ondřej Rokoš , Martin Doškář , Marc G. D. Geers , Vlado Menkovski

We develop a \emph{flow-matching framework} for transporting probability measures under control-affine dynamics and for steering systems to points or target sets. Starting from the continuity equation associated with the control affine…

Optimization and Control · Mathematics 2026-05-06 Karthik Elamvazhuthi

Flow matching models typically use linear interpolants to define the forward/noise addition process. This, together with the independent coupling between noise and target distributions, yields a vector field which is often non-straight.…

Machine Learning · Computer Science 2025-03-27 Shiv Shankar , Tomas Geffner

Pre-trained diffusion models are commonly used to generate clean data (e.g., images) from random noises, effectively forming pairs of noises and corresponding clean images. Distillation on these pre-trained models can be viewed as the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Zhangkai Wu , Xuhui Fan , Hongyu Wu , Longbing Cao

Prior flow matching methods in robotics have primarily learned velocity fields to morph one distribution of trajectories into another. In this work, we extend flow matching to capture second-order trajectory dynamics, incorporating…

Robotics · Computer Science 2025-03-11 Khang Nguyen , An T. Le , Tien Pham , Manfred Huber , Jan Peters , Minh Nhat Vu

Diffusion models create data from noise by inverting the forward paths of data towards noise and have emerged as a powerful generative modeling technique for high-dimensional, perceptual data such as images and videos. Rectified flow is a…

Optimal transport (OT) and Schr{\"o}dinger bridge (SB) problems have emerged as powerful frameworks for transferring probability distributions with minimal cost. However, existing approaches typically focus on endpoint matching while…

Optimization and Control · Mathematics 2025-10-09 Xu Duan , Dongmei Chen

We propose and study a method called FLOT that estimates scene flow on point clouds. We start the design of FLOT by noticing that scene flow estimation on point clouds reduces to estimating a permutation matrix in a perfect world. Inspired…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Gilles Puy , Alexandre Boulch , Renaud Marlet