English
Related papers

Related papers: Cycle Consistent Probability Divergences Across Di…

200 papers

This work builds the connection between the regularity theory of optimal transportation map, Monge-Amp\`{e}re equation and GANs, which gives a theoretic understanding of the major drawbacks of GANs: convergence difficulty and mode collapse.…

Machine Learning · Computer Science 2019-08-12 Na Lei , Yang Guo , Dongsheng An , Xin Qi , Zhongxuan Luo , Shing-Tung Yau , Xianfeng Gu

The Gaussian-smoothed optimal transport (GOT) framework, recently proposed by Goldfeld et al., scales to high dimensions in estimation and provides an alternative to entropy regularization. This paper provides convergence guarantees for…

Machine Learning · Computer Science 2021-03-02 Yixing Zhang , Xiuyuan Cheng , Galen Reeves

We construct a Wasserstein gradient flow of the maximum mean discrepancy (MMD) and study its convergence properties. The MMD is an integral probability metric defined for a reproducing kernel Hilbert space (RKHS), and serves as a metric on…

Machine Learning · Statistics 2019-12-04 Michael Arbel , Anna Korba , Adil Salim , Arthur Gretton

Sampling-based motion planning methods, while effective in high-dimensional spaces, often suffer from inefficiencies due to irregular sampling distributions, leading to suboptimal exploration of the configuration space. In this paper, we…

Robotics · Computer Science 2025-08-28 Makram Chahine , T. Konstantin Rusch , Zach J. Patterson , Daniela Rus

Generative Adversarial Networks have shown remarkable success in learning a distribution that faithfully recovers a reference distribution in its entirety. However, in some cases, we may want to only learn some aspects (e.g., cluster or…

Machine Learning · Computer Science 2019-05-16 Charlotte Bunne , David Alvarez-Melis , Andreas Krause , Stefanie Jegelka

This paper presents a novel two-step approach for the fundamental problem of learning an optimal map from one distribution to another. First, we learn an optimal transport (OT) plan, which can be thought as a one-to-many map between the two…

A fundamental and still largely unsolved question in the context of Generative Adversarial Networks is whether they are truly able to capture the real data distribution and, consequently, to sample from it. In particular, the…

Machine Learning · Computer Science 2021-12-30 Ricard Durall , Janis Keuper

Generative adversarial networks (GANs) are popular for generative tasks; however, they often require careful architecture selection, extensive empirical tuning, and are prone to mode collapse. To overcome these challenges, we propose a…

Machine Learning · Computer Science 2024-07-08 Wonjun Lee , Yifei Yang , Dongmian Zou , Gilad Lerman

In this paper, we formulate a novel trajectory optimization scheme that takes into consideration the state uncertainty of the robot and obstacle into its collision avoidance routine. The collision avoidance under uncertainty is modeled here…

Optimization and Control · Mathematics 2018-06-27 Dhaivat Bhatt , Akash Garg , Bharath Gopalakrishnan , K. Madhava Krishna

We revisit extending the Kolmogorov-Smirnov distance between probability distributions to the multidimensional setting and make new arguments about the proper way to approach this generalization. Our proposed formulation maximizes the…

Computation · Statistics 2025-04-16 Peter Matthew Jacobs , Foad Namjoo , Jeff M. Phillips

We study the problem of aligning the supports of distributions. Compared to the existing work on distribution alignment, support alignment does not require the densities to be matched. We propose symmetric support difference as a divergence…

Machine Learning · Computer Science 2022-03-18 Shangyuan Tong , Timur Garipov , Yang Zhang , Shiyu Chang , Tommi S. Jaakkola

The notion of entropy-regularized optimal transport, also known as Sinkhorn divergence, has recently gained popularity in machine learning and statistics, as it makes feasible the use of smoothed optimal transportation distances for data…

Statistics Theory · Mathematics 2019-11-05 Jérémie Bigot , Elsa Cazelles , Nicolas Papadakis

Continuous diffusion models are commonly acknowledged to display a deterministic probability flow, whereas discrete diffusion models do not. In this paper, we aim to establish the fundamental theory for the probability flow of discrete…

Machine Learning · Computer Science 2023-11-08 Pengze Zhang , Hubery Yin , Chen Li , Xiaohua Xie

We propose a novel approach for domain generalisation (DG) leveraging risk distributions to characterise domains, thereby achieving domain invariance. In our findings, risk distributions effectively highlight differences between training…

Machine Learning · Computer Science 2023-10-31 Toan Nguyen , Kien Do , Bao Duong , Thin Nguyen

We introduce a new paradigm, $\textit{measure synchronization}$, for synchronizing graphs with measure-valued edges. We formulate this problem as maximization of the cycle-consistency in the space of probability measures over relative…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Tolga Birdal , Michael Arbel , Umut Şimşekli , Leonidas Guibas

Generative Adversarial Networks (GANs) are modern methods to learn the underlying distribution of a data set. GANs have been widely used in sample synthesis, de-noising, domain transfer, etc. GANs, however, are designed in a model-free…

Machine Learning · Computer Science 2021-03-01 Mucong Ding , Constantinos Daskalakis , Soheil Feizi

The Gromov-Wasserstein (GW) variant of optimal transport, designed to compare probability densities defined over distinct metric spaces, has emerged as an important tool for the analysis of data with complex structure, such as ensembles of…

Machine Learning · Statistics 2025-08-15 Mary Chriselda Antony Oliver , Emmanuel Hartman , Tom Needham

The ability to represent and compare machine learning models is crucial in order to quantify subtle model changes, evaluate generative models, and gather insights on neural network architectures. Existing techniques for comparing data…

Gromov-Wasserstein (GW) is a powerful tool to compare probability measures whose supports are in different metric spaces. GW suffers however from a computational drawback since it requires to solve a complex non-convex quadratic program. We…

Machine Learning · Statistics 2020-06-18 Tam Le , Nhat Ho , Makoto Yamada

The Gromov--Wasserstein problem is a non-convex optimization problem over the polytope of transportation plans between two probability measures supported on two spaces, each equipped with a cost function evaluating similarities between…

Optimization and Control · Mathematics 2024-07-30 Théo Dumont , Théo Lacombe , François-Xavier Vialard