English
Related papers

Related papers: Learning Generative Models with Sinkhorn Divergenc…

200 papers

The use of optimal transport (OT) distances, and in particular entropic-regularised OT distances, is an increasingly popular evaluation metric in many areas of machine learning and data science. Their use has largely been driven by the…

Machine Learning · Computer Science 2023-10-10 Fengpei Wang , Clarice Poon , Tony Shardlow

Imbalanced data pose challenges for deep learning based classification models. One of the most widely-used approaches for tackling imbalanced data is re-weighting, where training samples are associated with different weights in the loss…

Machine Learning · Computer Science 2022-08-08 Dandan Guo , Zhuo Li , Meixi Zheng , He Zhao , Mingyuan Zhou , Hongyuan Zha

This paper explores the problem of generative modeling, aiming to simulate diverse examples from an unknown distribution based on observed examples. While recent studies have focused on quantifying the statistical precision of popular…

Statistics Theory · Mathematics 2024-06-07 Elen Vardanyan , Sona Hunanyan , Tigran Galstyan , Arshak Minasyan , Arnak Dalalyan

There has been a growing interest in statistical inference from data satisfying the so-called manifold hypothesis, assuming data points in the high-dimensional ambient space to lie in close vicinity of a submanifold of much lower dimension.…

Methodology · Statistics 2023-01-04 Rong Tang , Yun Yang

We propose and study the problem of distribution-preserving lossy compression. Motivated by recent advances in extreme image compression which allow to maintain artifact-free reconstructions even at very low bitrates, we propose to optimize…

Machine Learning · Computer Science 2018-10-30 Michael Tschannen , Eirikur Agustsson , Mario Lucic

We present a non-convex optimization algorithm metaheuristic, based on the training of a deep generative network, which enables effective searching within continuous, ultra-high dimensional landscapes. During network training, populations…

Machine Learning · Computer Science 2023-07-11 Jiaqi Jiang , Jonathan A. Fan

Optimising probabilistic models is a well-studied field in statistics. However, its connection with the training of generative models remains largely under-explored. In this paper, we show that the evolution of time-varying generative…

Machine Learning · Statistics 2025-06-16 Song Liu , Leyang Wang , Yakun Wang

We propose a novel neural algorithm for the fundamental problem of computing the entropic optimal transport (EOT) plan between continuous probability distributions which are accessible by samples. Our algorithm is based on the saddle point…

Machine Learning · Computer Science 2023-11-02 Nikita Gushchin , Alexander Kolesov , Alexander Korotin , Dmitry Vetrov , Evgeny Burnaev

Training a Deep Neural Network (DNN) from scratch requires a large amount of labeled data. For a classification task where only small amount of training data is available, a common solution is to perform fine-tuning on a DNN which is…

Computer Vision and Pattern Recognition · Computer Science 2017-09-12 Ying Lu , Liming Chen , Alexandre Saidi

Recent advances in one-step generative frameworks, such as flow map models, have significantly improved the efficiency of image generation by learning direct noise-to-data mappings in a single forward pass. However, machine unlearning for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Hyundo Choi , Junhyeong An , Jinseong Park , Jaewoong Choi

Optimal transport (OT) is a powerful framework to compare probability measures, a fundamental task in many statistical and machine learning problems. Substantial advances have been made in designing OT variants which are either…

Machine Learning · Computer Science 2025-02-04 Clément Bonet , Kimia Nadjahi , Thibault Séjourné , Kilian Fatras , Nicolas Courty

In this paper, we study the Entropic Martingale Optimal Transport (EMOT) problem on \mathbb{R}. The investigation of the EMOT problem arises in the calibration problem of the Stochastic Volatility Models, where martingale constraints…

Probability · Mathematics 2026-02-16 Fan Chen , Giovanni Conforti , Zhenjie Ren , Xiaozhen Wang

Obtaining solutions to Optimal Transportation (OT) problems is typically intractable when the marginal spaces are continuous. Recent research has focused on approximating continuous solutions with discretization methods based on i.i.d.…

Optimization and Control · Mathematics 2021-02-17 Junqi Wang , Pei Wang , Patrick Shafto

Defining meaningful distances between samples in a dataset is a fundamental problem in machine learning. Optimal Transport (OT) lifts a distance between features (the "ground metric") to a geometrically meaningful distance between samples.…

Machine Learning · Statistics 2022-07-20 Geert-Jan Huizing , Laura Cantini , Gabriel Peyré

We propose a generative model that achieves minimax-optimal convergence rates for estimating probability distributions supported on unknown low-dimensional manifolds. Building on Fefferman's solution to the geometric Whitney problem, our…

Statistics Theory · Mathematics 2025-06-25 Arthur Stéphanovitch

Diffusion models are promising for joint trajectory prediction and controllable generation in autonomous driving, but they face challenges of inefficient inference steps and high computational demands. To tackle these challenges, we…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Yixiao Wang , Chen Tang , Lingfeng Sun , Simone Rossi , Yichen Xie , Chensheng Peng , Thomas Hannagan , Stefano Sabatini , Nicola Poerio , Masayoshi Tomizuka , Wei Zhan

In recent years, the machine learning community has increasingly embraced the optimal transport (OT) framework for modeling distributional relationships. In this work, we introduce a sample-based neural solver for computing the Wasserstein…

Machine Learning · Computer Science 2026-02-26 Hailiang Liu , Yan-Han Chen

In this work, we develop a collection of novel methods for the entropic-regularised optimal transport problem, which are inspired by existing mirror descent interpretations of the Sinkhorn algorithm used for solving this problem. These are…

Optimization and Control · Mathematics 2025-07-17 Vishwak Srinivasan , Qijia Jiang

Wasserstein Generative Adversarial Networks (WGANs) are the popular generative models built on the theory of Optimal Transport (OT) and the Kantorovich duality. Despite the success of WGANs, it is still unclear how well the underlying OT…

Machine Learning · Computer Science 2023-01-10 Alexander Korotin , Alexander Kolesov , Evgeny Burnaev

We consider the problem of learning deep generative models from data. We formulate a method that generates an independent sample via a single feedforward pass through a multilayer perceptron, as in the recently proposed generative…

Machine Learning · Computer Science 2015-02-11 Yujia Li , Kevin Swersky , Richard Zemel