English
Related papers

Related papers: OT-Flow: Fast and Accurate Continuous Normalizing …

200 papers

Conditional Normalizing Flows (CNFs) are flexible generative models capable of representing complicated distributions with high dimensionality and large interdimensional correlations, making them appealing for structured output learning.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Mohsen Zand , Ali Etemad , Michael Greenspan

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on…

Machine Learning · Computer Science 2020-03-19 Stefano Massaroli , Michael Poli , Michelangelo Bin , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

Through examples of coordinate and probability transformation between different distributions, the basic principle of normalizing flow is introduced in a simple and concise manner. From the perspective of the distribution of random variable…

Machine Learning · Computer Science 2024-01-22 Hongjun Zhang

This paper investigates the semi-discrete optimal transport (OT) problem with entropic regularization. We characterize the solution using a governing, well-posed ordinary differential equation (ODE). This naturally yields an algorithm to…

Numerical Analysis · Mathematics 2025-04-07 Luca Nenna , Daniyar Omarov , Brendan Pass

Despite notable successes of Reinforcement Learning (RL), the prevalent use of an online learning paradigm prevents its widespread adoption, especially in hazardous or costly scenarios. Offline RL has emerged as an alternative solution,…

Machine Learning · Computer Science 2024-05-08 Minjae Cho , Jonathan P. How , Chuangchuang Sun

Neural ordinary differential equations (ODEs) provide expressive representations of invertible transport maps that can be used to approximate complex probability distributions, e.g., for generative modeling, density estimation, and Bayesian…

Machine Learning · Computer Science 2025-02-07 Youssef Marzouk , Zhi Ren , Jakob Zech

Optimal Transport (OT) has established itself as a robust framework for quantifying differences between distributions, with applications that span fields such as machine learning, data science, and computer vision. This paper offers a…

Data Structures and Algorithms · Computer Science 2025-01-14 Sina Moradi

Flow matching (FM) is a general framework for defining probability paths via Ordinary Differential Equations (ODEs) to transform between noise and data samples. Recent approaches attempt to straighten these flow trajectories to generate…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Ling Yang , Zixiang Zhang , Zhilong Zhang , Xingchao Liu , Minkai Xu , Wentao Zhang , Chenlin Meng , Stefano Ermon , Bin Cui

Flow models have rapidly become the go-to method for training and deploying large-scale generators, owing their success to inference-time flexibility via adjustable integration steps. A crucial ingredient in flow training is the choice of…

We study the estimation of optimal transport (OT) maps between an arbitrary source probability measure and a log-concave target probability measure. Our contributions are twofold. First, we propose a new evolution equation in the set of…

Optimization and Control · Mathematics 2026-04-13 Théo Dumont , Théo Lacombe , François-Xavier Vialard

Normalizing Flows (NFs) are widely used in deep generative models for their exact likelihood estimation and efficient sampling. However, they require substantial memory since the latent space matches the input dimension. Multi-scale…

Machine Learning · Computer Science 2025-12-11 Wei Chen , Shian Du , Shigui Li , Delu Zeng , John Paisley

Normalizing Flows are generative models that directly maximize the likelihood. Previously, the design of normalizing flows was largely constrained by the need for analytical invertibility. We overcome this constraint by a training procedure…

Machine Learning · Computer Science 2024-04-25 Felix Draxler , Peter Sorrenson , Lea Zimmermann , Armand Rousselot , Ullrich Köthe

We reformulate Optimal Transport Conditional Flow Matching (OT-CFM), a class of dynamical generative models, showing that it admits an exact proximal formulation via an extended Brenier potential, without assuming that the target…

Machine Learning · Computer Science 2026-03-24 Kenji Fukumizu , Wei Huang , Han Bao , Shuntuo Xu , Nisha Chandramoorthy

Optimal Transport (OT) theory has seen an increasing amount of attention from the computer science community due to its potency and relevance in modeling and machine learning. It introduces means that serve as powerful ways to compare…

Machine Learning · Computer Science 2021-06-04 Luis Caicedo Torres , Luiz Manella Pereira , M. Hadi Amini

Flow models parameterized as time-dependent velocity fields can generate data from noise by integrating an ODE. These models are often trained using flow matching, i.e. by sampling random pairs of noise and target points…

Machine Learning · Computer Science 2026-01-26 Alireza Mousavi-Hosseini , Stephen Y. Zhang , Michal Klein , Marco Cuturi

Predicting potential and counterfactual outcomes from observational data is central to individualized decision-making, particularly in clinical settings where treatment choices must be tailored to each patient rather than guided solely by…

Machine Learning · Statistics 2026-04-16 Dongze Wu , David I. Inouye , Yao Xie

Rectified flow is a generative model that learns smooth transport mappings between two distributions through an ordinary differential equation (ODE). Unlike diffusion-based generative models, which require costly numerical integration of a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Shin Seong Kim , Mingi Kwon , Jaeseok Jeong , Youngjung Uh

Two fundamental problems in unsupervised learning are efficient inference for latent-variable models and robust density estimation based on large amounts of unlabeled data. Algorithms for the two tasks, such as normalizing flows and…

Machine Learning · Statistics 2018-08-02 Changyou Chen , Chunyuan Li , Liqun Chen , Wenlin Wang , Yunchen Pu , Lawrence Carin

Normalizing Flows (NFs) have been established as a principled framework for generative modeling. Standard NFs consist of a forward process and a reverse process: the forward process maps data to noise, while the reverse process generates…

Machine Learning · Computer Science 2025-12-12 Yiyang Lu , Qiao Sun , Xianbang Wang , Zhicheng Jiang , Hanhong Zhao , Kaiming He

Normalizing flows define a probability distribution by an explicit invertible transformation $\boldsymbol{\mathbf{z}}=f(\boldsymbol{\mathbf{x}})$. In this work, we present implicit normalizing flows (ImpFlows), which generalize normalizing…

Machine Learning · Statistics 2021-03-18 Cheng Lu , Jianfei Chen , Chongxuan Li , Qiuhao Wang , Jun Zhu