English
Related papers

Related papers: Exploring Predictive States via Cantor Embeddings …

200 papers

Predictive equivalence in discrete stochastic processes have been applied with great success to identify randomness and structure in statistical physics and chaotic dynamical systems and to inferring hidden Markov models. We examine the…

Statistical Mechanics · Physics 2021-09-21 Samuel P. Loomis , James P. Crutchfield

Statistical models often include thousands of parameters. However, large models decrease the investigator's ability to interpret and communicate the estimated parameters. Reducing the dimensionality of the parameter space in the estimation…

Methodology · Statistics 2022-05-16 Eric Dunipace , Lorenzo Trippa

The Wasserstein distance is a distance between two probability distributions and has recently gained increasing popularity in statistics and machine learning, owing to its attractive properties. One important approach to extending this…

Methodology · Statistics 2022-02-14 Ryo Okano , Masaaki Imaizumi

Euclidean embeddings of data are fundamentally limited in their ability to capture latent semantic structures, which need not conform to Euclidean spatial assumptions. Here we consider an alternative, which embeds data as discrete…

Machine Learning · Computer Science 2019-05-10 Charlie Frogner , Farzaneh Mirzazadeh , Justin Solomon

The Wasserstein distance received a lot of attention recently in the community of machine learning, especially for its principled way of comparing distributions. It has found numerous applications in several hard problems, such as domain…

Machine Learning · Statistics 2017-10-23 Nicolas Courty , Rémi Flamary , Mélanie Ducoffe

Word embeddings are high dimensional vector representations of words that capture their semantic similarity in the vector space. There exist several algorithms for learning such embeddings both for a single language as well as for several…

Computation and Language · Computer Science 2019-11-12 Georgios Balikas , Ioannis Partalas

We provide upper bounds of the expected Wasserstein distance between a probability measure and its empirical version, generalizing recent results for finite dimensional Euclidean spaces and bounded functional spaces. Such a generalization…

Statistics Theory · Mathematics 2020-01-29 Jing Lei

Recent works on word representations mostly rely on predictive models. Distributed word representations (aka word embeddings) are trained to optimally predict the contexts in which the corresponding words tend to appear. Such models have…

Computation and Language · Computer Science 2015-04-10 Rémi Lebret , Ronan Collobert

Motivated by the statistical and computational challenges of computing Wasserstein distances in high-dimensional contexts, machine learning researchers have defined modified Wasserstein distances based on computing distances between…

Probability · Mathematics 2022-06-02 Jiaqi Xi , Jonathan Niles-Weed

It has long been thought that high-dimensional data encountered in many practical machine learning tasks have low-dimensional structure, i.e., the manifold hypothesis holds. A natural question, thus, is to estimate the intrinsic dimension…

Machine Learning · Statistics 2022-06-01 Adam Block , Zeyu Jia , Yury Polyanskiy , Alexander Rakhlin

Nowadays stochastic computer simulations with both numeral and distribution inputs are widely used to mimic complex systems which contain a great deal of uncertainty. This paper studies the design and analysis issues of such computer…

Methodology · Statistics 2022-04-26 Chunya Li , Xiaojun Cui , Shifeng Xiong

Monge-Kantorovich distances, otherwise known as Wasserstein distances, have received a growing attention in statistics and machine learning as a powerful discrepancy measure for probability distributions. In this paper, we focus on…

Machine Learning · Statistics 2018-01-30 François Bachoc , Fabrice Gamboa , Jean-Michel Loubes , Nil Venet

The Wasserstein distance is an attractive tool for data analysis but statistical inference is hindered by the lack of distributional limits. To overcome this obstacle, for probability measures supported on finitely many points, we derive…

Methodology · Statistics 2017-04-27 Max Sommerfeld , Axel Munk

We introduce the observable Wasserstein distance, a framework for deriving lower bounds on the Wasserstein distance between probability measures on Polish metric spaces, designed to bypass the computational intractability of exact optimal…

Metric Geometry · Mathematics 2026-05-12 Edivaldo Lopes dos Santos , Leandro Vicente Mauri , Washington Mio , Tom Needham

Collections of probability distributions arise in a variety of applications ranging from user activity pattern analysis to brain connectomics. In practice these distributions can be defined over diverse domain types including finite…

Methodology · Statistics 2023-06-16 Raif Rustamov , Subhabrata Majumdar

Change point detection for time series analysis is a difficult and important problem in applied statistics, for which a variety of approaches have been developed in the past several decades. Here, the Wasserstein metric is employed as a…

Statistics Theory · Mathematics 2026-03-03 David Gentile , Joshua Huang , James M. Murphy

This paper presents a distance-based discriminative framework for learning with probability distributions. Instead of using kernel mean embeddings or generalized radial basis kernels, we introduce embeddings based on dissimilarity of…

Machine Learning · Computer Science 2018-11-16 Alain Rakotomamonjy , Abraham Traoré , Maxime Berar , Rémi Flamary , Nicolas Courty

Distances between probability distributions that take into account the geometry of their sample space,like the Wasserstein or the Maximum Mean Discrepancy (MMD) distances have received a lot of attention in machine learning as they can, for…

Machine Learning · Computer Science 2020-04-29 Gaëtan Hadjeres , Frank Nielsen

Measuring the distance between ontological elements is fundamental for ontology matching. String-based distance metrics are notorious for shallow syntactic matching. In this exploratory study, we investigate Wasserstein distance targeting…

Artificial Intelligence · Computer Science 2022-09-22 Yuan An , Alex Kalinowski , Jane Greenberg

Scientific datasets often have hierarchical structure: for example, in surveys, individual participants (samples) might be grouped at a higher level (units) such as their geographical region. In these settings, the interest is often in…

Machine Learning · Computer Science 2024-06-06 Fynn Bachmann , Philipp Hennig , Dmitry Kobak
‹ Prev 1 2 3 10 Next ›