English
Related papers

Related papers: Low-Bit, High-Fidelity: Optimal Transport Quantiza…

200 papers

We consider statistical learning problems in which data are observed as a set of probability measures. Optimal transport (OT) is a popular tool to compare and manipulate such objects, but its computational cost becomes prohibitive when the…

Machine Learning · Statistics 2026-03-24 Erell Gachon , Elsa Cazelles , Jérémie Bigot

We reformulate Optimal Transport Conditional Flow Matching (OT-CFM), a class of dynamical generative models, showing that it admits an exact proximal formulation via an extended Brenier potential, without assuming that the target…

Machine Learning · Computer Science 2026-03-24 Kenji Fukumizu , Wei Huang , Han Bao , Shuntuo Xu , Nisha Chandramoorthy

Flow matching has emerged as a powerful framework for generative modeling, offering computational advantages over diffusion models by leveraging deterministic Ordinary Differential Equations (ODEs) instead of stochastic dynamics. While…

Machine Learning · Computer Science 2025-03-13 Chengyue Gong , Xiaoyu Li , Yingyu Liang , Jiangxuan Long , Zhenmei Shi , Zhao Song , Yu Tian

Transformers are the backbone of powerful foundation models for many Vision and Natural Language Processing tasks. But their compute and memory/storage footprint is large, and so, serving such models is expensive often requiring high-end…

Machine Learning · Computer Science 2024-08-01 Harshavardhan Adepu , Zhanpeng Zeng , Li Zhang , Vikas Singh

Recently, transformer has achieved remarkable performance on a variety of computer vision applications. Compared with mainstream convolutional neural networks, vision transformers are often of sophisticated architectures for extracting…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Zhenhua Liu , Yunhe Wang , Kai Han , Siwei Ma , Wen Gao

Flow Matching (FM) method in generative modeling maps arbitrary probability distributions by constructing an interpolation between them and then learning the vector field that defines ODE for this interpolation. Recently, it was shown that…

Machine Learning · Statistics 2025-11-03 Nikita Kornilov , Alexander Korotin

Flow matching is a recent framework to train generative models that exhibits impressive empirical performance while being relatively easier to train compared with diffusion-based models. Despite its advantageous properties, prior methods…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Quan Dao , Hao Phung , Binh Nguyen , Anh Tran

Optimal transport (OT) provides powerful tools for comparing probability measures in various types. The Wasserstein distance which arises naturally from the idea of OT is widely used in many machine learning applications. Unfortunately,…

Optimization and Control · Mathematics 2021-06-03 Shu Liu , Haodong Sun , Hongyuan Zha

Conditional Flow Matching (CFM), a simulation-free method for training continuous normalizing flows, provides an efficient alternative to diffusion models for key tasks like image and video generation. The performance of CFM in solving…

Machine Learning · Computer Science 2026-03-17 Aram Davtyan , Leello Tadesse Dadi , Volkan Cevher , Paolo Favaro

Optimal Transport (OT) problem aims to find a transport plan that bridges two distributions while minimizing a given cost function. OT theory has been widely utilized in generative modeling. In the beginning, OT distance has been used as a…

Machine Learning · Computer Science 2024-03-08 Jaemoo Choi , Jaewoong Choi , Myungjoo Kang

Optimal transport (OT) compares probability distributions by computing a meaningful alignment between their samples. CO-optimal transport (COOT) takes this comparison further by inferring an alignment between features as well. While this…

We introduce a new paradigm for generative modeling built on Continuous Normalizing Flows (CNFs), allowing us to train CNFs at unprecedented scale. Specifically, we present the notion of Flow Matching (FM), a simulation-free approach for…

Machine Learning · Computer Science 2023-02-09 Yaron Lipman , Ricky T. Q. Chen , Heli Ben-Hamu , Maximilian Nickel , Matt Le

The Wasserstein-Fisher-Rao (WFR) metric extends dynamic optimal transport (OT) by coupling displacement with change of mass, providing a principled geometry for modeling unbalanced snapshot dynamics. Existing WFR solvers, however, are often…

Machine Learning · Computer Science 2026-04-03 Qiangwei Peng , Zihan Wang , Junda Ying , Yuhao Sun , Qing Nie , Lei Zhang , Tiejun Li , Peijie Zhou

Few-Shot Remote Sensing Scene Classification (FS-RSSC) presents the challenge of classifying remote sensing images with limited labeled samples. Existing methods typically emphasize single-modal feature learning, neglecting the potential…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Zhong Ji , Ci Liu , Jingren Liu , Chen Tang , Yanwei Pang , Xuelong Li

Diffusion and flow matching models generate samples by learning time-dependent vector fields whose integration transports noise to data, requiring tens to hundreds of network evaluations at inference. We instead learn the transport map…

Machine Learning · Computer Science 2026-04-09 Xiao Shou

We introduce the Approximated Optimal Transport (AOT) technique, a novel training scheme for diffusion-based generative models. Our approach aims to approximate and integrate optimal transport into the training process, significantly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Daegyu Kim , Jooyoung Choi , Chaehun Shin , Uiwon Hwang , Sungroh Yoon

The matching principles behind optimal transport (OT) play an increasingly important role in machine learning, a trend which can be observed when OT is used to disambiguate datasets in applications (e.g. single-cell genomics) or used to…

Machine Learning · Statistics 2022-09-16 Meyer Scetbon , Marco Cuturi

Optimal transport (OT) is a widely used technique in machine learning, graphics, and vision that aligns two distributions or datasets using their relative geometry. In symmetry-rich settings, however, OT alignments based solely on pairwise…

Machine Learning · Computer Science 2025-09-26 Annabel Ma , Kaiying Hou , David Alvarez-Melis , Melanie Weber

This article introduces a new notion of optimal transport (OT) between tensor fields, which are measures whose values are positive semidefinite (PSD) matrices. This "quantum" formulation of OT (Q-OT) corresponds to a relaxed version of the…

Graphics · Computer Science 2017-07-25 Gabriel Peyré , Lenaïc Chizat , François-Xavier Vialard , Justin Solomon

Pansharpening, a pivotal task in remote sensing for fusing high-resolution panchromatic and multispectral imagery, has garnered significant research interest. Recent advancements employing diffusion models based on stochastic differential…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Zihan Cao , Yu Zhong , Liang-Jian Deng