English
Related papers

Related papers: Efficient Sliced Wasserstein Distance Computation …

200 papers

Pruning is an effective technique for convolutional neural networks (CNNs) model compression, but it is difficult to find the optimal pruning policy due to the large design space. To improve the usability of pruning, many auto pruning…

Machine Learning · Computer Science 2022-07-26 Hanwei Fan , Jiandong Mu , Wei Zhang

The adapted Wasserstein distance is a metric for quantifying distributional uncertainty and assessing the sensitivity of stochastic optimization problems on time series data. A computationally efficient alternative to it, is provided by the…

Optimization and Control · Mathematics 2025-10-10 Beatrice Acciaio , Songyan Hou , Gudmund Pammer

This paper introduces the BOW Planner, a scalable motion planning algorithm designed to navigate robots through complex environments using constrained Bayesian optimization (CBO). Unlike traditional methods, which often struggle with…

Robotics · Computer Science 2026-05-01 Sourav Raxit , Abdullah Al Redwan Newaz , Paulo Padrao , Jose Fuentes , Leonardo Bobadilla

High-dimensional Bayesian optimization (BO) tasks such as molecular design often require 10,000 function evaluations before obtaining meaningful results. While methods like sparse variational Gaussian processes (SVGPs) reduce computational…

Machine Learning · Computer Science 2025-06-11 Natalie Maus , Kyurae Kim , Geoff Pleiss , David Eriksson , John P. Cunningham , Jacob R. Gardner

Bayesian Optimization (BO) is a method for globally optimizing black-box functions. While BO has been successfully applied to many scenarios, developing effective BO algorithms that scale to functions with high-dimensional domains is still…

Machine Learning · Computer Science 2024-02-13 Yihang Shen , Carl Kingsford

Bayesian Optimisation (BO) is a state-of-the-art global optimisation technique for black-box problems where derivative information is unavailable, and sample efficiency is crucial. However, improving the general scalability of BO has proved…

Optimization and Control · Mathematics 2024-12-13 Luo Long , Coralia Cartis , Paz Fink Shustin

Multi-marginal optimal transport enables one to compare multiple probability measures, which increasingly finds application in multi-task learning problems. One practical limitation of multi-marginal transport is computational scalability…

While many Machine Learning methods were developed or transposed on Riemannian manifolds to tackle data with known non Euclidean geometry, Optimal Transport (OT) methods on such spaces have not received much attention. The main OT tool on…

Machine Learning · Computer Science 2024-03-12 Clément Bonet , Lucas Drumetz , Nicolas Courty

To measure the similarity of documents, the Wasserstein distance is a powerful tool, but it requires a high computational cost. Recently, for fast computation of the Wasserstein distance, methods for approximating the Wasserstein distance…

Machine Learning · Computer Science 2021-07-26 Yuki Takezawa , Ryoma Sato , Makoto Yamada

Gromov--Wasserstein (GW) distances compare graphs, shapes, and point clouds through internal distances, without requiring a common coordinate system. This invariance is powerful, but discrete GW is a nonconvex quadratic optimal transport…

Machine Learning · Computer Science 2026-05-15 Ao Xu , Tieru Wu

The adapted Wasserstein ($AW$) distance refines the classical Wasserstein ($W$) distance by incorporating the temporal structure of stochastic processes. This makes the $AW$-distance well-suited as a robust distance for many dynamic…

Probability · Mathematics 2025-10-24 Beatrice Acciaio , Songyan Hou , Gudmund Pammer

We develop a novel method for carrying out model selection for Bayesian autoencoders (BAEs) by means of prior hyper-parameter optimization. Inspired by the common practice of type-II maximum likelihood optimization and its equivalence to…

Optimal transport (OT) distances are increasingly used as loss functions for statistical inference, notably in the learning of generative models or supervised learning. Yet, the behavior of minimum Wasserstein estimators is poorly…

Statistics Theory · Mathematics 2021-07-20 Tianyi Lin , Zeyu Zheng , Elynn Y. Chen , Marco Cuturi , Michael I. Jordan

Optimal transport is a foundational problem in optimization, that allows to compare probability distributions while taking into account geometric aspects. Its optimal objective value, the Wasserstein distance, provides an important loss…

Machine Learning · Computer Science 2020-02-21 Marin Ballu , Quentin Berthet , Francis Bach

The Gromov-Wasserstein (GW) distance is frequently used in machine learning to compare distributions across distinct metric spaces. Despite its utility, it remains computationally intensive, especially for large-scale problems. Recently, a…

Machine Learning · Statistics 2024-10-01 Antoine Salmona , Julie Delon , Agnès Desolneux

Optimal Transport (OT) metrics allow for defining discrepancies between two probability measures. Wasserstein distance is for longer the celebrated OT-distance frequently-used in the literature, which seeks probability distributions to be…

Machine Learning · Computer Science 2021-10-14 Mokhtar Z. Alaya , Gilles Gasso , Maxime Berar , Alain Rakotomamonjy

Comparing spherical probability distributions is of great interest in various fields, including geology, medical domains, computer vision, and deep representation learning. The utility of optimal transport-based distances, such as the…

Machine Learning · Computer Science 2024-06-11 Huy Tran , Yikun Bai , Abihith Kothapalli , Ashkan Shahbazi , Xinran Liu , Rocio Diaz Martin , Soheil Kolouri

Bayesian optimisation (BO) is a standard approach for sample-efficient global optimisation of expensive black-box functions, yet its scalability to high dimensions remains challenging. Here, we investigate nonlinear dimensionality reduction…

Optimization and Control · Mathematics 2025-10-20 Luo Long , Coralia Cartis , Paz Fink Shustin

Generative adversarial nets (GANs) and variational auto-encoders have significantly improved our distribution modeling capabilities, showing promise for dataset augmentation, image-to-image translation and feature learning. However, to…

Bayesian Optimization (BO) is a powerful tool for optimizing complex non-linear systems. However, its performance degrades in high-dimensional problems with tightly coupled parameters and highly asymmetric objective landscapes, where…

Machine Learning · Computer Science 2026-02-12 Aashwin Mishra , Matt Seaberg , Ryan Roussel , Daniel Ratner , Apurva Mehta