English
Related papers

Related papers: On Robust Cross Domain Alignment

200 papers

We present a novel framework based on optimal transport for the challenging problem of comparing graphs. Specifically, we exploit the probabilistic distribution of smooth graph signals defined with respect to the graph topology. This allows…

Machine Learning · Computer Science 2019-12-09 Hermina Petric Maretic , Mireille EL Gheche , Giovanni Chierchia , Pascal Frossard

Establishing correspondences between image pairs is a long studied problem in computer vision. With recent large-scale foundation models showing strong zero-shot performance on downstream tasks including classification and segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Francis Snelgar , Stephen Gould , Ming Xu , Liang Zheng , Akshay Asthana

We introduce the Gaussian transform (GT), an optimal transport inspired iterative method for denoising and enhancing latent structures in datasets. Under the hood, GT generates a new distance function (GT distance) on a given dataset by…

Machine Learning · Computer Science 2020-06-23 Kun Jin , Facundo Mémoli , Zhengchao Wan

Optimal transport has recently proved to be a useful tool in various machine learning applications needing comparisons of probability measures. Among these, applications of distributionally robust optimization naturally involve Wasserstein…

Optimization and Control · Mathematics 2023-03-24 Waïss Azizian , Franck Iutzeler , Jérôme Malick

We study rates of convergence for estimation of the Gromov-Wasserstein (GW) distance. For two marginals supported on compact subsets of $\R^{d_x}$ and $\R^{d_y}$, respectively, with $\min \{ d_x,d_y \} > 4$, prior work established the rate…

Statistics Theory · Mathematics 2025-09-03 Kengo Kato , Boyu Wang

Robust statistics traditionally focuses on outliers, or perturbations in total variation distance. However, a dataset could be corrupted in many other ways, such as systematic measurement errors and missing covariates. We generalize the…

Statistics Theory · Mathematics 2020-12-15 Banghua Zhu , Jiantao Jiao , Jacob Steinhardt

Discrepancy measures between probability distributions, often termed statistical distances, are ubiquitous in probability theory, statistics and machine learning. To combat the curse of dimensionality when estimating these distances from…

Statistics Theory · Mathematics 2021-12-21 Sloan Nietert , Ziv Goldfeld , Kengo Kato

We study the behavior of the Wasserstein-$2$ distance between discrete measures $\mu$ and $\nu$ in $\mathbb{R}^d$ when both measures are smoothed by small amounts of Gaussian noise. This procedure, known as Gaussian-smoothed optimal…

Statistics Theory · Mathematics 2022-06-15 Yunzi Ding , Jonathan Niles-Weed

The Wasserstein space of probability measures is known for its intricate Riemannian structure, which underpins the Wasserstein geometry and enables gradient flow algorithms. However, the Wasserstein geometry may not be suitable for certain…

Analysis of PDEs · Mathematics 2025-05-23 Zhengxin Zhang , Ziv Goldfeld , Kristjan Greenewald , Youssef Mroueh , Bharath K. Sriperumbudur

We consider learning in an adversarial environment, where an $\varepsilon$-fraction of samples from a distribution $P$ are arbitrarily modified (global corruptions) and the remaining perturbations have average magnitude bounded by $\rho$…

Machine Learning · Computer Science 2024-06-26 Sloan Nietert , Ziv Goldfeld , Soroosh Shafiee

Wasserstein distributionally robust estimators have emerged as powerful models for prediction and decision-making under uncertainty. These estimators provide attractive generalization guarantees: the robust objective obtained from the…

Machine Learning · Computer Science 2023-11-07 Waïss Azizian , Franck Iutzeler , Jérôme Malick

This paper proposes a distributionally robust approach to logistic regression. We use the Wasserstein distance to construct a ball in the space of probability distributions centered at the uniform distribution on the training samples. If…

Optimization and Control · Mathematics 2015-12-02 Soroosh Shafieezadeh-Abadeh , Peyman Mohajerin Esfahani , Daniel Kuhn

Finding node correspondence across networks, namely multi-network alignment, is an essential prerequisite for joint learning on multiple networks. Despite great success in aligning networks in pairs, the literature on multi-network…

Machine Learning · Computer Science 2024-02-13 Zhichen Zeng , Boxin Du , Si Zhang , Yinglong Xia , Zhining Liu , Hanghang Tong

Wasserstein distances form a family of metrics on spaces of probability measures that have recently seen many applications. However, statistical analysis in these spaces is complex due to the nonlinearity of Wasserstein spaces. One…

Methodology · Statistics 2024-11-18 Michael Wilson , Tom Needham , Anuj Srivastava

Generative Adversarial Networks (GANs) have been used to model the underlying probability distribution of sample based datasets. GANs are notoriuos for training difficulties and their dependence on arbitrary hyperparameters. One recent…

Machine Learning · Computer Science 2019-10-03 Thomas Pinetz , Daniel Soukup , Thomas Pock

Comparing two probability measures supported on heterogeneous spaces is an increasingly important problem in machine learning. Such problems arise when comparing for instance two populations of biological cells, each described with its own…

Machine Learning · Statistics 2021-02-11 Ryoma Sato , Marco Cuturi , Makoto Yamada , Hisashi Kashima

We present a framework for embedding graph structured data into a vector space, taking into account node features and topology of a graph into the optimal transport (OT) problem. Then we propose a novel distance between two graphs, named…

Machine Learning · Computer Science 2023-07-04 Dai Hai Nguyen , Koji Tsuda

The Radon cumulative distribution transform (R-CDT), is an easy-to-compute feature extractor that facilitates image classification tasks especially in the small data regime. It is closely related to the sliced Wasserstein distance and…

Numerical Analysis · Mathematics 2025-06-11 Matthias Beckmann , Robert Beinert , Jonas Bresch

Distribution data refers to a data set where each sample is represented as a probability distribution, a subject area receiving burgeoning interest in the field of statistics. Although several studies have developed…

Methodology · Statistics 2024-02-09 Ryo Okano , Masaaki Imaizumi

The performance of unsupervised methods such as clustering depends on the choice of distance metric between features, or ground metric. Commonly, ground metrics are decided with heuristics or learned via supervised algorithms. However,…

Machine Learning · Computer Science 2025-01-13 Kira M. Düsterwald , Samo Hromadka , Makoto Yamada