English
Related papers

Related papers: Self-Attention Amortized Distributional Projection…

200 papers

Many variants of Optimal Transport (OT) have been developed to address its heavy computation. Among them, notably, Sliced Wasserstein (SW) is widely used for application domains by projecting the OT problem onto one-dimensional lines, and…

Machine Learning · Computer Science 2025-06-10 Viet-Hoang Tran , Trang Pham , Tho Tran , Minh Khoi Nguyen Nhat , Thanh Chu , Tam Le , Tan M. Nguyen

We present the Fourier Sliced-Wasserstein (FSW) embedding - a novel method to embed multisets and measures over R^d into Euclidean space. Our proposed embedding approximately preserves the sliced Wasserstein distance on distributions,…

Machine Learning · Computer Science 2025-04-15 Tal Amir , Nadav Dym

Sliced Wasserstein distances preserve properties of classic Wasserstein distances while being more scalable for computation and estimation in high dimensions. The goal of this work is to quantify this scalability from three key aspects: (i)…

Machine Learning · Statistics 2022-10-18 Sloan Nietert , Ritwik Sadhu , Ziv Goldfeld , Kengo Kato

The Wasserstein distance and its variations, e.g., the sliced-Wasserstein (SW) distance, have recently drawn attention from the machine learning community. The SW distance, specifically, was shown to have similar properties to the…

Machine Learning · Computer Science 2019-02-04 Soheil Kolouri , Kimia Nadjahi , Umut Simsekli , Roland Badeau , Gustavo K. Rohde

Distribution matching is central to many vision and graphics tasks, where the widely used Wasserstein distance is too costly to compute for high dimensional distributions. The Sliced Wasserstein Distance (SWD) offers a scalable alternative,…

Graphics · Computer Science 2025-10-02 Mark Boss , Andreas Engelhardt , Simon Donné , Varun Jampani

We introduce sliced optimal transport dataset distance (s-OTDD), a model-agnostic, embedding-agnostic approach for dataset comparison that requires no training, is robust to variations in the number of classes, and can handle disjoint label…

Machine Learning · Computer Science 2025-05-16 Khai Nguyen , Hai Nguyen , Tuan Pham , Nhat Ho

We present the Fourier Sliced-Wasserstein (FSW) embedding - a novel method to embed multisets and measures over $\mathbb{R}^d$ into Euclidean space. Our proposed embedding approximately preserves the sliced Wasserstein distance on…

Machine Learning · Computer Science 2025-04-15 Tal Amir , Nadav Dym

The Wasserstein distance is a distance between two probability distributions and has recently gained increasing popularity in statistics and machine learning, owing to its attractive properties. One important approach to extending this…

Methodology · Statistics 2022-02-14 Ryo Okano , Masaaki Imaizumi

Gaussian mixture models (GMM) are powerful parametric tools with many applications in machine learning and computer vision. Expectation maximization (EM) is the most popular algorithm for estimating the GMM parameters. However, EM…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Soheil Kolouri , Gustavo K. Rohde , Heiko Hoffmann

Learning an effective representation of 3D point clouds requires a good metric to measure the discrepancy between two 3D point sets, which is non-trivial due to their irregularity. Most of the previous works resort to using the Chamfer…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Trung Nguyen , Quang-Hieu Pham , Tam Le , Tung Pham , Nhat Ho , Binh-Son Hua

Self-supervised learning is one of the most promising approaches to acquiring knowledge from limited labeled data. Despite the substantial advancements made in recent years, self-supervised models have posed a challenge to practitioners, as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Franciskus Xaverius Erick , Mina Rezaei , Johanna Paula Müller , Bernhard Kainz

Comparing probability measures modulo unknown rigid transformations is a central challenge in geometric data analysis. Classical optimal transport (OT) distances, including Wasserstein and sliced Wasserstein, are sensitive to rotations and…

Computational Geometry · Computer Science 2026-04-13 Zakk Heile , Peilin He , Jayson Tran , Alice Wang , Shrikant Chand

Since the introduction of the Sliced Wasserstein distance in the literature, its simplicity and efficiency have made it one of the most interesting surrogate for the Wasserstein distance in image processing and machine learning. However,…

Optimization and Control · Mathematics 2025-08-05 Eloi Tanguy , Laetitia Chapel , Julie Delon

Variational Inference approximates an unnormalized distribution via the minimization of Kullback-Leibler (KL) divergence. Although this divergence is efficient for computation and has been widely used in applications, it suffers from some…

Machine Learning · Statistics 2022-07-28 Mingxuan Yi , Song Liu

The Sliced-Wasserstein distance (SW) is a computationally efficient and theoretically grounded alternative to the Wasserstein distance. Yet, the literature on its statistical properties -- or, more accurately, its generalization properties…

Machine Learning · Statistics 2023-06-01 Ruben Ohana , Kimia Nadjahi , Alain Rakotomamonjy , Liva Ralaivola

The Gromov--Wasserstein (GW) distance and its fused extension (FGW) are powerful tools for comparing heterogeneous data. Their computation is, however, challenging since both distances are based on non-convex, quadratic optimal transport…

Machine Learning · Computer Science 2025-11-14 Moritz Piening , Robert Beinert

Distributionally-robust optimization is often studied for a fixed set of distributions rather than time-varying distributions that can drift significantly over time (which is, for instance, the case in finance and sociology due to…

Optimization and Control · Mathematics 2020-10-01 Iman Shames , Farhad Farokhi

Optimal Transport (OT) metrics allow for defining discrepancies between two probability measures. Wasserstein distance is for longer the celebrated OT-distance frequently-used in the literature, which seeks probability distributions to be…

Machine Learning · Computer Science 2021-10-14 Mokhtar Z. Alaya , Gilles Gasso , Maxime Berar , Alain Rakotomamonjy

Existing methods to summarize posterior inference for mixture models focus on identifying a point estimate of the implied random partition for clustering, with density estimation as a secondary goal (Wade and Ghahramani, 2018; Dahl et al.,…

Methodology · Statistics 2025-05-09 Khai Nguyen , Peter Mueller

The conventional sliced Wasserstein is defined between two probability measures that have realizations as vectors. When comparing two probability measures over images, practitioners first need to vectorize images and then project them to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Khai Nguyen , Nhat Ho