English
Related papers

Related papers: Score-based Generative Neural Networks for Large-S…

200 papers

This article presents a general approximation-theoretic framework to analyze measure transport algorithms for probabilistic modeling. A primary motivating application for such algorithms is sampling -- a central task in statistical…

Numerical Analysis · Mathematics 2024-09-19 Ricardo Baptista , Bamdad Hosseini , Nikola B. Kovachki , Youssef M. Marzouk , Amir Sagiv

The incorporation of generative models as regularisers within variational formulations for inverse problems has proven effective across numerous image reconstruction tasks. However, the resulting optimisation problem is often non-convex and…

Machine Learning · Computer Science 2024-08-14 Pascal Fernsel , Željko Kereta , Alexander Denker

Imitation learning algorithms have been interpreted as variants of divergence minimization problems. The ability to compare occupancy measures between experts and learners is crucial in their effectiveness in learning from demonstrations.…

Machine Learning · Computer Science 2022-07-05 Georgios Papagiannis , Yunpeng Li

Many data-driven decision problems are formulated using a nominal distribution estimated from historical data, while performance is ultimately determined by a deployment distribution that may be shifted, context-dependent, partially…

Machine Learning · Computer Science 2026-04-07 Xiuyuan Cheng , Yunqin Zhu , Yao Xie

Sampling from high-dimensional distributions is a fundamental problem in statistical research and practice. However, great challenges emerge when the target density function is unnormalized and contains isolated modes. We tackle this…

Methodology · Statistics 2023-04-11 Yixuan Qiu , Xiao Wang

Motion planning under differential constraints is a classic problem in robotics. To date, the state of the art is represented by sampling-based techniques, with the Rapidly-exploring Random Tree algorithm as a leading example. Yet, the…

Robotics · Computer Science 2015-03-03 Edward Schmerling , Lucas Janson , Marco Pavone

While the optimal transport (OT) problem was originally formulated as a linear program, the addition of entropic regularization has proven beneficial both computationally and statistically, for many applications. The Sinkhorn fixed-point…

Machine Learning · Statistics 2023-04-06 James Thornton , Marco Cuturi

Beckmann's problem in optimal transport minimizes the total squared flux in a continuous transport problem from a source to a target distribution. In this article, the regularity theory for solutions to Beckmann's problem in optimal…

Analysis of PDEs · Mathematics 2026-03-23 Hanno Gottschalk , Tobias J. Riedlinger

We propose an entropic approximation approach for optimal transportation problems with a supremal cost. We establish $\Gamma$-convergence for suitably chosen parameters for the entropic penalization and that this procedure selects…

Analysis of PDEs · Mathematics 2023-02-24 Guillaume Carlier , Camilla Brizzi , Luigi De Pascale

In this paper, we propose a new feature selection method for unsupervised domain adaptation based on the emerging optimal transportation theory. We build upon a recent theoretical analysis of optimal transport in domain adaptation and show…

Machine Learning · Computer Science 2018-06-29 Léo Gautheron , Ievgen Redko , Carole Lartizien

Self-supervised learning has revolutionized representation learning by eliminating the need for labeled data. Contrastive learning methods, such as SimCLR, maximize the agreement between augmented views of an image but lack explicit…

Machine Learning · Computer Science 2025-02-18 M. Hadi Sepanj , Paul Fiegth

A novel algorithm is proposed to solve the sample-based optimal transport problem. An adversarial formulation of the push-forward condition uses a test function built as a convolution between an adaptive kernel and an evolving probability…

Machine Learning · Statistics 2020-06-11 Daeyoung Kim , Esteban G. Tabak

We provide a computational complexity analysis for the Sinkhorn algorithm that solves the entropic regularized Unbalanced Optimal Transport (UOT) problem between two measures of possibly different masses with at most $n$ components. We show…

Computational Complexity · Computer Science 2020-11-20 Khiem Pham , Khang Le , Nhat Ho , Tung Pham , Hung Bui

The recent emergence of new algorithms for permuting models into functionally equivalent regions of the solution space has shed some light on the complexity of error surfaces, and some promising properties like mode connectivity. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Fidel A. Guerrero Peña , Heitor Rapela Medeiros , Thomas Dubail , Masih Aminbeidokhti , Eric Granger , Marco Pedersoli

Heterogeneous Graph Neural Networks (HGNNs), have demonstrated excellent capabilities in processing heterogeneous information networks. Self-supervised learning on heterogeneous graphs, especially contrastive self-supervised strategy, shows…

Machine Learning · Computer Science 2025-06-09 Yanbei Liu , Chongxu Wang , Zhitao Xiao , Lei Geng , Yanwei Pang , Xiao Wang

In this note, we generalize the classical optimal partial transport (OPT) problem by modifying the mass destruction/creation term to function-based terms, introducing what we term ``generalized optimal partial transport'' problems. We then…

Optimization and Control · Mathematics 2024-07-10 Yikun Bai

In this work, we propose a novel approach for subgraph matching, the problem of finding a given query graph in a large source graph, based on the fused Gromov-Wasserstein distance. We formulate the subgraph matching problem as a partial…

Information Theory · Computer Science 2024-07-01 Wen-Xin Pan , Isabel Haasler , Pascal Frossard

Leveraging connections between diffusion-based sampling, optimal transport, and stochastic optimal control through their shared links to the Schr\"odinger bridge problem, we propose novel objective functions that can be used to transport…

Machine Learning · Statistics 2024-10-11 Qijia Jiang , David Nabergoj

Guidance of generative models is typically achieved by modifying the probability flow vector field through the addition of a guidance field. In this paper, we instead propose the Source-Guided Flow Matching (SGFM) framework, which modifies…

Machine Learning · Computer Science 2025-08-25 Zifan Wang , Alice Harting , Matthieu Barreau , Michael M. Zavlanos , Karl H. Johansson

Predicting how distributions over discrete variables vary over time is a common task in time series forecasting. But whereas most approaches focus on merely predicting the distribution at subsequent time steps, a crucial piece of…

Machine Learning · Computer Science 2023-03-15 Mukul Bhutani , J. Zico Kolter