English
Related papers

Related papers: Sliced Wasserstein Estimation with Control Variate…

200 papers

Comparing probability distributions is at the crux of many machine learning algorithms. Maximum Mean Discrepancies (MMD) and Wasserstein distances are two classes of distances between probability distributions that have attracted abundant…

Machine Learning · Statistics 2023-06-01 Titouan Vayer , Rémi Gribonval

Tree-Sliced methods have recently emerged as an alternative to the traditional Sliced Wasserstein (SW) distance, replacing one-dimensional lines with tree-based metric spaces and incorporating a splitting mechanism for projecting measures.…

Machine Learning · Computer Science 2025-06-10 Thanh Tran , Viet-Hoang Tran , Thanh Chu , Trang Pham , Laurent El Ghaoui , Tam Le , Tan M. Nguyen

We develop a projected Wasserstein distance for the two-sample test, a fundamental problem in statistics and machine learning: given two sets of samples, to determine whether they are from the same distribution. In particular, we aim to…

Machine Learning · Statistics 2024-04-01 Jie Wang , Rui Gao , Yao Xie

Squared Wasserstein distance is a frequently used tool to measure discrepancy between probability distributions. This distance is typically computed between empirical measures of size $n$ from two underlying random samples. Unfortunately,…

Machine Learning · Statistics 2026-05-20 Peter Matthew Jacobs , Jeff M. Phillips

Many variants of Optimal Transport (OT) have been developed to address its heavy computation. Among them, notably, Sliced Wasserstein (SW) is widely used for application domains by projecting the OT problem onto one-dimensional lines, and…

Machine Learning · Computer Science 2025-06-10 Viet-Hoang Tran , Trang Pham , Tho Tran , Minh Khoi Nguyen Nhat , Thanh Chu , Tam Le , Tan M. Nguyen

Sliced optimal transport (SOT), or sliced Wasserstein (SW) distance, is widely recognized for its statistical and computational scalability. In this work, we further enhance computational scalability by proposing the first method for…

Machine Learning · Computer Science 2026-05-12 Khai Nguyen

Multi-marginal optimal transport enables one to compare multiple probability measures, which increasingly finds application in multi-task learning problems. One practical limitation of multi-marginal transport is computational scalability…

Sliced Wasserstein (SW) distance suffers from redundant projections due to independent uniform random projecting directions. To partially overcome the issue, max K sliced Wasserstein (Max-K-SW) distance ($K\geq 1$), seeks the best…

Machine Learning · Statistics 2024-01-02 Khai Nguyen , Tongzheng Ren , Nhat Ho

Variational Inference approximates an unnormalized distribution via the minimization of Kullback-Leibler (KL) divergence. Although this divergence is efficient for computation and has been widely used in applications, it suffers from some…

Machine Learning · Statistics 2022-07-28 Mingxuan Yi , Song Liu

The practical applications of Wasserstein distances (WDs) are constrained by their sample and computational complexities. Sliced-Wasserstein distances (SWDs) provide a workaround by projecting distributions onto one-dimensional subspaces,…

Machine Learning · Computer Science 2024-11-19 Huy Tran , Yikun Bai , Ashkan Shahbazi , John R. Hershey , Soheil Kolouri

We study the problem of nonparametric two-sample testing using the sliced Wasserstein (SW) distance. While prior theoretical and empirical work indicates that the SW distance offers a promising balance between strong statistical guarantees…

Machine Learning · Statistics 2025-11-03 Binh Thuan Tran , Nicolas Schreuder

Optimization in the Bures-Wasserstein space has been gaining popularity in the machine learning community since it draws connections between variational inference and Wasserstein gradient flows. The variational inference objective function…

Machine Learning · Computer Science 2025-03-03 Hoang Phuc Hau Luu , Hanlin Yu , Bernardo Williams , Marcelo Hartmann , Arto Klami

Optimal transport (\OT) theory defines a powerful set of tools to compare probability distributions. \OT~suffers however from a few drawbacks, computational and statistical, which have encouraged the proposal of several regularized variants…

Machine Learning · Statistics 2019-10-29 Tam Le , Makoto Yamada , Kenji Fukumizu , Marco Cuturi

While theoretically appealing, the application of the Wasserstein distance to large-scale machine learning problems has been hampered by its prohibitive computational cost. The sliced Wasserstein distance and its variants improve the…

Machine Learning · Computer Science 2022-03-18 Xiongjie Chen , Yongxin Yang , Yunpeng Li

Spherical Sliced-Wasserstein (SSW) has recently been proposed to measure the discrepancy between spherical data distributions in various fields, such as geology, medical domains, computer vision, and deep representation learning. However,…

Machine Learning · Computer Science 2024-12-30 Hongliang Zhang , Shuo Chen , Lei Luo , Jian Yang

The adapted Wasserstein distance is a metric for quantifying distributional uncertainty and assessing the sensitivity of stochastic optimization problems on time series data. A computationally efficient alternative to it, is provided by the…

Optimization and Control · Mathematics 2025-10-10 Beatrice Acciaio , Songyan Hou , Gudmund Pammer

The squared Wasserstein distance is a natural quantity to compare probability distributions in a non-parametric setting. This quantity is usually estimated with the plug-in estimator, defined via a discrete optimal transport problem which…

Optimization and Control · Mathematics 2020-10-30 Lenaic Chizat , Pierre Roussillon , Flavien Léger , François-Xavier Vialard , Gabriel Peyré

While statistical modeling of distributional data has gained increased attention, the case of multivariate distributions has been somewhat neglected despite its relevance in various applications. This is because the Wasserstein distance,…

Methodology · Statistics 2025-10-21 Han Chen , Yidong Zhou , Hans-Georg Müller

We study the weighted total variation distance between probability measures. Using Fourier-analytic tools, we present estimates in terms of Wasserstein distances between the respective probabilities, under appropriate smoothness and moment…

Probability · Mathematics 2025-06-23 Iván Ivkovic , Miklós Rásonyi

Gaussian mixture models (GMMs) are widely used in machine learning for tasks such as clustering, classification, image reconstruction, and generative modeling. A key challenge in working with GMMs is defining a computationally efficient and…

Machine Learning · Computer Science 2025-08-05 Moritz Piening , Robert Beinert