English
Related papers

Related papers: Minibatch Optimal Transport and Perplexity Bound E…

200 papers

Mass transport problems arise in many areas of machine learning whereby one wants to compute a map transporting one distribution to another. Generative modeling techniques like Generative Adversarial Networks (GANs) and Denoising Diffusion…

Machine Learning · Computer Science 2024-09-17 Valentin De Bortoli , Iryna Korshunova , Andriy Mnih , Arnaud Doucet

We formulate and solve a class of finite-time transport and mixing problems in the set-oriented framework. The aim is to obtain optimal discrete-time perturbations in nonlinear dynamical systems to transport a specified initial measure on…

Dynamical Systems · Mathematics 2017-11-22 Piyush Grover , Karthik Elamvazhuthi

In this paper, we present a novel and principled approach to learn the optimal transport between two distributions, from samples. Guided by the optimal transport theory, we learn the optimal Kantorovich potential which induces the optimal…

Machine Learning · Computer Science 2020-06-19 Ashok Vardhan Makkuva , Amirhossein Taghvaei , Sewoong Oh , Jason D. Lee

We propose a large displacement optical flow method that introduces a new strategy to compute a good local minimum of any optical flow energy functional. The method requires a given set of discrete matches, which can be extremely sparse,…

Computer Vision and Pattern Recognition · Computer Science 2016-09-30 Roberto P. Palomares , Enric Meinhardt-Llopis , Coloma Ballester , Gloria Haro

Over the several recent years, there has been a boom in development of Flow Matching (FM) methods for generative modeling. One intriguing property pursued by the community is the ability to learn flows with straight trajectories which…

Machine Learning · Statistics 2024-11-11 Nikita Kornilov , Petr Mokrov , Alexander Gasnikov , Alexander Korotin

Smart devices, storage and other distributed technologies have the potential to greatly improve the utilisation of network infrastructure and renewable generation. Decentralised control of these technologies overcomes many scalability and…

Optimization and Control · Mathematics 2024-10-30 Paul Scott , Sylvie Thiébaux

We propose a technique for interpolating between probability distributions on discrete surfaces, based on the theory of optimal transport. Unlike previous attempts that use linear programming, our method is based on a dynamical formulation…

Analysis of PDEs · Mathematics 2018-09-20 Hugo Lavenant , Sebastian Claici , Edward Chien , Justin Solomon

The discretization of optimal transport problems often leads to large linear programs with sparse solutions. We derive error estimates for the approximation of the problem using convex combinations of Dirac measures and devise an active-set…

Numerical Analysis · Mathematics 2017-10-16 Sören Bartels , Stephan Hertzog

This article presents a new class of distances between arbitrary nonnegative Radon measures inspired by optimal transport. These distances are defined by two equivalent alternative formulations: (i) a dynamic formulation defining the…

Optimization and Control · Mathematics 2019-02-12 Lenaic Chizat , Gabriel Peyré , Bernhard Schmitzer , François-Xavier Vialard

Finding a transformation between two unknown probability distributions from finite samples is crucial for modeling complex data distributions and performing tasks such as sample generation, domain adaptation and statistical inference. One…

Machine Learning · Computer Science 2024-07-11 Zhe Xiong , Qiaoqiao Ding , Xiaoqun Zhang

Learning conditional distributions is challenging because the desired outcome is not a single distribution but multiple distributions that correspond to multiple instances of the covariates. We introduce a novel neural entropic optimal…

Machine Learning · Computer Science 2024-06-05 Bao Nguyen , Binh Nguyen , Hieu Trung Nguyen , Viet Anh Nguyen

Continuous diffusion models are commonly acknowledged to display a deterministic probability flow, whereas discrete diffusion models do not. In this paper, we aim to establish the fundamental theory for the probability flow of discrete…

Machine Learning · Computer Science 2023-11-08 Pengze Zhang , Hubery Yin , Chen Li , Xiaohua Xie

Flow matching has emerged as a simulation-free alternative to diffusion-based generative modeling, producing samples by solving an ODE whose time-dependent velocity field is learned along an interpolation between a simple source…

Machine Learning · Statistics 2026-04-10 Shivam Kumar , Yixin Wang , Lizhen Lin

Recently, the dense correlation volume method achieves state-of-the-art performance in optical flow. However, the correlation volume computation requires a lot of memory, which makes prediction difficult on high-resolution images. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Zihua Zheng , Ni Nie , Zhi Ling , Pengfei Xiong , Jiangyu Liu , Hao Wang , Jiankun Li

In this research, we examine the minsum flow problem in dynamic path networks where flows are represented as discrete and weighted sets. The minsum flow problem has been widely studied for its relevance in finding evacuation routes during…

Data Structures and Algorithms · Computer Science 2024-07-03 Bubai Manna , Bodhayan Roy , Vorapong Suppakitpaisarn

This paper introduces a dynamic formulation of divergence-regularized optimal transport with weak targets on the path space. In our formulation, the classical relative entropy penalty is replaced by a general convex divergence, and terminal…

Probability · Mathematics 2026-03-31 Camilo Hernández , Ludovic Tangpi

Planning is a critical component of end-to-end autonomous driving. However, prevailing imitation learning methods often suffer from mode collapse, failing to produce diverse trajectory hypotheses. Meanwhile, existing generative approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Lin Liu , Guanyi Yu , Ziying Song , Junqiao Li , Caiyan Jia , Feiyang Jia , Peiliang Wu , Yandan Luo

Guidance provides a simple and effective framework for posterior sampling by steering the generation process towards the desired distribution. When modeling discrete data, existing approaches mostly focus on guidance with the first-order…

Machine Learning · Computer Science 2026-04-16 Zhengyan Wan , Yidong Ouyang , Liyan Xie , Fang Fang , Hongyuan Zha , Guang Cheng

The sequential nature of autoregressive next-token prediction imposes a fundamental speed limit on large language models. While continuous flow models offer a path to parallel generation, they traditionally demand expensive iterative…

We study infinite-horizon Discounted Markov Decision Processes (DMDPs) under a generative model. Motivated by the Algorithm with Advice framework Mitzenmacher and Vassilvitskii 2022, we propose a novel framework to investigate how a…

Machine Learning · Computer Science 2025-02-24 Lixing Lyu , Jiashuo Jiang , Wang Chi Cheung