English
Related papers

Related papers: Generalizing Point Embeddings using the Wasserstei…

200 papers

Wasserstein geometry and information geometry are two important structures introduced in a manifold of probability distributions. The former is defined by using the transportation cost between two distributions, so it reflects the metric…

Statistics Theory · Mathematics 2020-03-13 Shun-ichi Amari

Many interesting machine learning problems are best posed by considering instances that are distributions, or sample sets drawn from distributions. Previous work devoted to machine learning tasks with distributional inputs has done so…

Machine Learning · Statistics 2021-01-15 Danica J. Sutherland , Junier B. Oliva , Barnabás Póczos , Jeff Schneider

The Riemannian geometry of covariance matrices has been essential to several successful applications, in computer vision, biomedical signal and image processing, and radar data processing. For these applications, an important ongoing…

Statistics Theory · Mathematics 2017-05-15 Salem Said , Hatem Hajri , Lionel Bombrun , Baba C. Vemuri

Probabilistic embeddings have proven useful for capturing polysemous word meanings, as well as ambiguity in image matching. In this paper, we study the advantages of probabilistic embeddings in a cross-modal setting (i.e., text and images),…

Machine Learning · Computer Science 2022-04-21 Leila Pishdad , Ran Zhang , Konstantinos G. Derpanis , Allan Jepson , Afsaneh Fazly

We introduce a modified Benamou-Brenier type approach leading to a Wasserstein type distance that allows global invariance, specifically, isometries, and we show that the problem can be summarized to orthogonal transformations. This…

Machine Learning · Statistics 2025-03-24 Kevine Meugang Toukam

Hyperbolic space is increasingly used for hierarchical, tree-like, and network-structured data, but likelihood-based density modeling on hyperbolic space remains relatively limited. This paper develops finite mixture modeling with isotropic…

Methodology · Statistics 2026-04-29 Kisung You

Supervised deep-embedding methods project inputs of a domain to a representational space in which same-class instances lie near one another and different-class instances lie far apart. We propose a probabilistic method that treats…

Machine Learning · Statistics 2019-09-27 Tyler R. Scott , Karl Ridgeway , Michael C. Mozer

We show that compact Riemannian manifolds, regarded as metric spaces with their global geodesic distance, cannot contain a number of rigid structures such as (a) arbitrarily large regular simplices or (b) arbitrarily long sequences of…

Metric Geometry · Mathematics 2021-01-06 Alexandru Chirvasitu

Graph embedding provides a feasible methodology to conduct pattern classification for graph-structured data by mapping each data into the vectorial space. Various pioneering works are essentially coding method that concentrates on a…

Machine Learning · Computer Science 2022-10-04 Xue Liu , Dan Sun , Xiaobo Cao , Hao Ye , Wei Wei

The kernel mean embedding of probability distributions is commonly used in machine learning as an injective mapping from distributions to functions in an infinite dimensional Hilbert space. It allows us, for example, to define a distance…

Quantum Physics · Physics 2019-12-24 Jonas M. Kübler , Krikamol Muandet , Bernhard Schölkopf

Increasingly complex data analysis tasks motivate the study of the dependency of distributions of multivariate continuous random variables on scalar or vector predictors. Statistical regression models for distributional responses so far…

Methodology · Statistics 2021-07-21 Jianing Fan , Hans-Georg Müller

We prove that the isometric embedding of any metric of differentiability class C1 in E3 exists. We use simplified notation for the given metric, namely geodesic parameters, and level parameters for the embedded surface in E3. Central to our…

Differential Geometry · Mathematics 2022-10-07 Edgar Kann

We investigate contraction of the Wasserstein distances on $\mathbb{R}^d$ under Gaussian smoothing. It is well known that the heat semigroup is exponentially contractive with respect to the Wasserstein distances on manifolds of positive…

Probability · Mathematics 2020-12-15 Hong-Bin Chen , Jonathan Niles-Weed

The Gromov-Wasserstein (GW) distance is frequently used in machine learning to compare distributions across distinct metric spaces. Despite its utility, it remains computationally intensive, especially for large-scale problems. Recently, a…

Machine Learning · Statistics 2024-10-01 Antoine Salmona , Julie Delon , Agnès Desolneux

Words are not created equal. In fact, they form an aristocratic graph with a latent hierarchical structure that the next generation of unsupervised learned word embeddings should reveal. In this paper, justified by the notion of…

Computation and Language · Computer Science 2018-11-26 Alexandru Tifrea , Gary Bécigneul , Octavian-Eugen Ganea

Two geometrical structures have been extensively studied for a manifold of probability distributions. One is based on the Fisher information metric, which is invariant under reversible transformations of random variables, while the other is…

Optimization and Control · Mathematics 2017-10-02 Shun-ichi Amari , Ryo Karakida , Masafumi Oizumi

In this paper, we explore a volume-based stable embedding of multi-dimensional signals based on Grassmann manifold, via Gaussian random measurement matrices. The Grassmann manifold is a topological space in which each point is a linear…

Information Theory · Computer Science 2014-02-21 Hailong Shi , Hao Zhang , Gang Li , Xiqin Wang

Computer vision tasks such as image classification, image retrieval and few-shot learning are currently dominated by Euclidean and spherical embeddings, so that the final decisions about class belongings or the degree of similarity are made…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Valentin Khrulkov , Leyla Mirvakhabova , Evgeniya Ustinova , Ivan Oseledets , Victor Lempitsky

In this paper we study supervised learning tasks on the space of probability measures. We approach this problem by embedding the space of probability measures into $L^2$ spaces using the optimal transport framework. In the embedding spaces,…

Statistics Theory · Mathematics 2022-01-27 Varun Khurana , Harish Kannan , Alexander Cloninger , Caroline Moosmüller

Covariance matrices have proven highly effective across many scientific fields. Since these matrices lie within the Symmetric Positive Definite (SPD) manifold - a Riemannian space with intrinsic non-Euclidean geometry, the primary challenge…

Machine Learning · Computer Science 2025-04-02 Rui Wang , Shaocheng Jin , Ziheng Chen , Xiaoqing Luo , Xiao-Jun Wu