English
Related papers

Related papers: Intrinsic Dimension Estimation Using Wasserstein D…

200 papers

In this work, we train conditional Wasserstein generative adversarial networks to effectively sample from the posterior of physics-based Bayesian inference problems. The generator is constructed using a U-Net architecture, with the latent…

Machine Learning · Statistics 2022-11-21 Deep Ray , Harisankar Ramaswamy , Dhruv V. Patel , Assad A. Oberai

We propose a new method for estimating the intrinsic dimension of a dataset by applying the principle of regularized maximum likelihood to the distances between close neighbors. We propose a regularization scheme which is motivated by…

Machine Learning · Computer Science 2012-03-19 Mithun Das Gupta , Thomas S. Huang

The Wasserstein metric is an important measure of distance between probability distributions, with applications in machine learning, statistics, probability theory, and data analysis. This paper provides upper and lower bounds on…

Statistics Theory · Mathematics 2019-11-11 Shashank Singh , Barnabás Póczos

We propose an axiomatic approach to the concept of an intrinsic dimension of a dataset, based on a viewpoint of geometry of high-dimensional structures. Our first axiom postulates that high values of dimension be indicative of the presence…

Machine Learning · Computer Science 2016-11-17 Vladimir Pestov

Supervised manifold learning methods learn data representations by preserving the geometric structure of data while enhancing the separation between data samples from different classes. In this work, we propose a theoretical study of…

Machine Learning · Computer Science 2018-01-08 Elif Vural , Christine Guillemot

Generative adversarial networks (GANs) have enjoyed much success in learning high-dimensional distributions. Learning objectives approximately minimize an $f$-divergence ($f$-GANs) or an integral probability metric (Wasserstein GANs)…

Machine Learning · Computer Science 2020-06-19 Jiaming Song , Stefano Ermon

Wasserstein distances are increasingly used in a wide variety of applications in machine learning. Sliced Wasserstein distances form an important subclass which may be estimated efficiently through one-dimensional sorting operations. In…

Machine Learning · Statistics 2019-04-08 Mark Rowland , Jiri Hron , Yunhao Tang , Krzysztof Choromanski , Tamas Sarlos , Adrian Weller

While the manifold hypothesis is widely adopted in modern machine learning, complex data is often better modeled as stratified spaces -- unions of manifolds (strata) of varying dimensions. Stratified learning is challenging due to varying…

Machine Learning · Statistics 2026-04-14 Randy Martinez , Rong Tang , Lizhen Lin

Bayesian inference is used extensively to infer and to quantify the uncertainty in a field of interest from a measurement of a related field when the two are linked by a physical model. Despite its many applications, Bayesian inference…

Machine Learning · Statistics 2019-07-24 Dhruv Patel , Assad A Oberai

We consider a data-driven robust hypothesis test where the optimal test will minimize the worst-case performance regarding distributions that are close to the empirical distributions with respect to the Wasserstein distance. This leads to a…

Statistics Theory · Mathematics 2021-06-01 Liyan Xie , Rui Gao , Yao Xie

Probability density estimation is a classical and well studied problem, but standard density estimation methods have historically lacked the power to model complex and high-dimensional image distributions. More recent generative models…

Machine Learning · Computer Science 2019-02-27 Ryen Krusinga , Sohil Shah , Matthias Zwicker , Tom Goldstein , David Jacobs

The manifold hypothesis, which assumes that data lies on or close to an unknown manifold of low intrinsic dimension, is a staple of modern machine learning research. However, recent work has shown that real-world data exhibits distinct…

Machine Learning · Computer Science 2023-06-16 Julius von Rohrscheidt , Bastian Rieck

Many recently trained neural networks employ large numbers of parameters to achieve good performance. One may intuitively use the number of parameters required as a rough gauge of the difficulty of a problem. But how accurate are such…

Machine Learning · Computer Science 2018-04-25 Chunyuan Li , Heerad Farkhoor , Rosanne Liu , Jason Yosinski

A generative modeling framework is proposed that combines diffusion models and manifold learning to efficiently sample data densities on manifolds. The approach utilizes Diffusion Maps to uncover possible low-dimensional underlying (latent)…

Machine Learning · Computer Science 2025-04-22 Dimitris G. Giovanis , Ellis Crabtree , Roger G. Ghanem , Ioannis G. Kevrekidis

We expound on some known lower bounds of the quadratic Wasserstein distance between random vectors in $\mathbb{R}^n$ with an emphasis on affine transformations that have been used in manifold learning of data in Wasserstein space. In…

Machine Learning · Statistics 2024-02-09 Keaton Hamm , Andrzej Korzeniowski

We study nonparametric density estimation problems where error is measured in the Wasserstein distance, a metric on probability distributions popular in many areas of statistics and machine learning. We give the first minimax-optimal rates…

Statistics Theory · Mathematics 2020-04-30 Jonathan Niles-Weed , Quentin Berthet

We train a generator by maximum likelihood and we also train the same generator architecture by Wasserstein GAN. We then compare the generated samples, exact log-probability densities and approximate Wasserstein distances. We show that an…

Machine Learning · Computer Science 2017-05-16 Ivo Danihelka , Balaji Lakshminarayanan , Benigno Uria , Daan Wierstra , Peter Dayan

Dimension reduction (DR) methods provide systematic approaches for analyzing high-dimensional data. A key requirement for DR is to incorporate global dependencies among original and embedded samples while preserving clusters in the…

Machine Learning · Statistics 2023-03-10 Antoine Collas , Titouan Vayer , Rémi Flamary , Arnaud Breloy

Dimension reduction algorithms are a crucial part of many data science pipelines, including data exploration, feature creation and selection, and denoising. Despite their wide utilization, many non-linear dimension reduction algorithms are…

Machine Learning · Statistics 2024-08-06 Ryan Murray , Adam Pickarski

In the last decades the estimation of the intrinsic dimensionality of a dataset has gained considerable importance. Despite the great deal of research work devoted to this task, most of the proposed solutions prove to be unreliable when the…

Machine Learning · Computer Science 2012-06-19 Claudio Ceruti , Simone Bassis , Alessandro Rozza , Gabriele Lombardi , Elena Casiraghi , Paola Campadelli
‹ Prev 1 8 9 10 Next ›