English
Related papers

Related papers: Self-Attention Amortized Distributional Projection…

200 papers

Distributionally robust supervised learning (DRSL) is emerging as a key paradigm for building reliable machine learning systems for real-world applications -- reflecting the need for classifiers and predictive models that are robust to the…

Machine Learning · Computer Science 2022-01-26 Yaodong Yu , Tianyi Lin , Eric Mazumdar , Michael I. Jordan

We propose a new unsupervised anomaly detection method based on the sliced-Wasserstein distance for training data selection in machine learning approaches. Our filtering technique is interesting for decision-making pipelines deploying…

Machine Learning · Computer Science 2025-04-18 Julien Pallage , Antoine Lesage-Landry

Optimal transport (OT) distances are increasingly used as loss functions for statistical inference, notably in the learning of generative models or supervised learning. Yet, the behavior of minimum Wasserstein estimators is poorly…

Statistics Theory · Mathematics 2021-07-20 Tianyi Lin , Zeyu Zheng , Elynn Y. Chen , Marco Cuturi , Michael I. Jordan

Motivated by the statistical and computational challenges of computing Wasserstein distances in high-dimensional contexts, machine learning researchers have defined modified Wasserstein distances based on computing distances between…

Probability · Mathematics 2022-06-02 Jiaqi Xi , Jonathan Niles-Weed

The Wasserstein barycenter has been widely studied in various fields, including natural language processing, and computer vision. However, it requires a high computational cost to solve the Wasserstein barycenter problem because the…

Artificial Intelligence · Computer Science 2022-02-14 Yuki Takezawa , Ryoma Sato , Zornitsa Kozareva , Sujith Ravi , Makoto Yamada

The practical applications of Wasserstein distances (WDs) are constrained by their sample and computational complexities. Sliced-Wasserstein distances (SWDs) provide a workaround by projecting distributions onto one-dimensional subspaces,…

Machine Learning · Computer Science 2024-11-19 Huy Tran , Yikun Bai , Ashkan Shahbazi , John R. Hershey , Soheil Kolouri

Deep learning has recently demonstrated its excellent performance on the task of multi-view stereo (MVS). However, loss functions applied for deep MVS are rarely studied. In this paper, we first analyze existing loss functions' properties…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Qinglu Min , Jie Zhao , Zhihao Zhang , Chen Min

Optimal transport with quadratic cost provides a geometric framework for steering an ensemble, modeled by a probability law, with minimal effort. Yet ambient-space formulations become unwieldy in high dimensions, and sensing or actuation in…

Optimization and Control · Mathematics 2026-04-28 Kaito Ito , Anqi Dong

Motivated by the growing popularity of variants of the Wasserstein distance in statistics and machine learning, we study statistical inference for the Sliced Wasserstein distance--an easily computable variant of the Wasserstein distance.…

Statistics Theory · Mathematics 2022-04-05 Tudor Manole , Sivaraman Balakrishnan , Larry Wasserman

Sliced Optimal Transport (OT) simplifies the OT problem in high-dimensional spaces by projecting supports of input measures onto one-dimensional lines and then exploiting the closed-form expression of the univariate OT to reduce the…

Machine Learning · Computer Science 2025-03-21 Viet-Hoang Tran , Thanh T. Chu , Khoi N. M. Nguyen , Trang Pham , Tam Le , Tan M. Nguyen

The optimal transport (OT) problem has gained significant traction in modern machine learning for its ability to: (1) provide versatile metrics, such as Wasserstein distances and their variants, and (2) determine optimal couplings between…

Machine Learning · Computer Science 2024-10-18 Xinran Liu , Rocío Díaz Martín , Yikun Bai , Ashkan Shahbazi , Matthew Thorpe , Akram Aldroubi , Soheil Kolouri

We introduce a distributionally robust maximum likelihood estimation model with a Wasserstein ambiguity set to infer the inverse covariance matrix of a $p$-dimensional Gaussian random vector from $n$ independent samples. The proposed model…

Optimization and Control · Mathematics 2018-05-21 Viet Anh Nguyen , Daniel Kuhn , Peyman Mohajerin Esfahani

Wasserstein distances are increasingly used in a wide variety of applications in machine learning. Sliced Wasserstein distances form an important subclass which may be estimated efficiently through one-dimensional sorting operations. In…

Machine Learning · Statistics 2019-04-08 Mark Rowland , Jiri Hron , Yunhao Tang , Krzysztof Choromanski , Tamas Sarlos , Adrian Weller

For statistical models on circles, we investigate performance of estimators defined as the projections of the empirical distribution with respect to the Wasserstein distance. We develop algorithms for computing the Wasserstein projection…

Statistics Theory · Mathematics 2025-10-22 Naoki Otani , Takeru Matsuda

Statistical inference based on optimal transport offers a different perspective from that of maximum likelihood, and has increasingly gained attention in recent years. In this paper, we study univariate nonparametric shape-constrained…

Statistics Theory · Mathematics 2026-04-13 Takeru Matsuda , Ting-Kam Leonard Wong

In the field of modern high-energy physics research, there is a growing emphasis on utilizing deep learning techniques to optimize event simulation, thereby expanding the statistical sample size for more accurate physical analysis.…

Computational Physics · Physics 2025-06-16 Chu-Cheng Pan , Xiang Dong , Yu-Chang Sun , Ao-Yan Cheng , Ao-Bo Wang , Yu-Xuan Hu , Hao Cai

Minimum expected distance estimation (MEDE) algorithms have been widely used for probabilistic models with intractable likelihood functions and they have become increasingly popular due to their use in implicit generative modeling (e.g.…

Machine Learning · Statistics 2020-03-25 Kimia Nadjahi , Alain Durmus , Umut Şimşekli , Roland Badeau

Gaussian smoothed sliced Wasserstein distance has been recently introduced for comparing probability distributions, while preserving privacy on the data. It has been shown that it provides performances similar to its non-smoothed…

Machine Learning · Computer Science 2024-04-26 Mokhtar Z. Alaya , Alain Rakotomamonjy , Maxime Berar , Gilles Gasso

Due to its invariance to rigid transformations such as rotations and reflections, Procrustes-Wasserstein (PW) was introduced in the literature as an optimal transport (OT) distance, alternative to Wasserstein and more suited to tasks such…

Machine Learning · Statistics 2025-07-02 Davide Adamo , Marco Corneli , Manon Vuillien , Emmanuelle Vila

The sliced Wasserstein metric compares probability measures on $\mathbb{R}^d$ by taking averages of the Wasserstein distances between projections of the measures to lines. The distance has found a range of applications in statistics and…

Analysis of PDEs · Mathematics 2024-11-25 Sangmin Park , Dejan Slepčev