English
Related papers

Related papers: Minimum intrinsic dimension scaling for entropic o…

200 papers

Data living on manifolds commonly appear in many applications. Often this results from an inherently latent low-dimensional system being observed through higher dimensional measurements. We show that under certain conditions, it is possible…

Machine Learning · Statistics 2018-07-05 Ariel Schwartz , Ronen Talmon

Multidimensional scaling (MDS) is a popular technique for mapping a finite metric space into a low-dimensional Euclidean space in a way that best preserves pairwise distances. We overview the theory of classical MDS, along with its…

Statistics Theory · Mathematics 2020-07-14 Henry Adams , Mark Blumstein , Lara Kassab

Optimal transport (OT) is a versatile framework for comparing probability measures, with many applications to statistics, machine learning, and applied mathematics. However, OT distances suffer from computational and statistical scalability…

Statistics Theory · Mathematics 2022-06-08 Ziv Goldfeld , Kengo Kato , Gabriel Rioux , Ritwik Sadhu

It is well-known that plug-in statistical estimation of optimal transport suffers from the curse of dimensionality. Despite recent efforts to improve the rate of estimation with the smoothness of the problem, the computational complexity of…

Statistics Theory · Mathematics 2021-10-04 Adrien Vacher , Boris Muzellec , Alessandro Rudi , Francis Bach , Francois-Xavier Vialard

We propose an axiomatic approach to the concept of an intrinsic dimension of a dataset, based on a viewpoint of geometry of high-dimensional structures. Our first axiom postulates that high values of dimension be indicative of the presence…

Machine Learning · Computer Science 2016-11-17 Vladimir Pestov

When constructing models of the world, we aim for optimal compressions: models that include as few details as possible while remaining as accurate as possible. But which details -- or features measured in data -- should we choose to include…

Quantitative Methods · Quantitative Biology 2025-05-06 David P. Carcamo , Nicholas J. Weaver , Purushottam D. Dixit , Christopher W. Lynn

Leveraging the intrinsic symmetries in data for clear and efficient analysis is an important theme in signal processing and other data-driven sciences. A basic example of this is the ubiquity of the discrete Fourier transform which arises…

Machine Learning · Computer Science 2020-01-15 Mark Blumstein , Henry Kvinge

The problem of estimating, from a random sample of points, the dimension of a compact subset $S$ of the Euclidean space is considered. The emphasis is put on consistency results in the statistical sense. That is, statements of convergence…

Statistics Theory · Mathematics 2025-07-08 Alejandro Cholaquidis , Antonio Cuevas , Beatriz Pateiro-López

We study stability of optimizers and convergence of Sinkhorn's algorithm for the entropic optimal transport problem. In the special case of the quadratic cost, our stability bounds imply that if one of the two entropic potentials is…

Probability · Mathematics 2025-10-06 Alberto Chiarini , Giovanni Conforti , Giacomo Greco , Luca Tamanini

In addition to the well known common properties such as small world and community structures, recent empirical investigations suggest a universal scaling law for the spatial structure of social networks. It is found that the probability…

Physics and Society · Physics 2010-02-10 Yanqing Hu , Yougui Wang , Daqing Li , Shlomo Havlin , Zengru Di

Given a smooth Riemannian manifold $(M,g)$, compact and without boundary, we analyze the dynamical optimal mass transport problem where the cost is given by the sum of the kinetic energy and the relative entropy with respect to a reference…

Analysis of PDEs · Mathematics 2024-01-05 Gabriele Bocchi , Alessio Porretta

We study the convergence of entropically regularized optimal transport to optimal transport. The main result is concerned with the convergence of the associated optimizers and takes the form of a large deviations principle quantifying the…

Optimization and Control · Mathematics 2022-01-25 Espen Bernton , Promit Ghosal , Marcel Nutz

The concept of dimension is essential to grasp the complexity of data. A naive approach to determine the dimension of a dataset is based on the number of attributes. More sophisticated methods derive a notion of intrinsic dimension (ID)…

Machine Learning · Computer Science 2023-04-18 Maximilian Stubbemann , Tom Hanika , Friedrich Martin Schneider

The optimal transport problem has recently developed into a powerful framework for various applications in estimation and control. Many of the recent advances in the theory and application of optimal transport are based on regularizing the…

Optimization and Control · Mathematics 2021-03-12 Isabel Haasler , Axel Ringh , Yongxin Chen , Johan Karlsson

We commonly encounter the problem of identifying an optimally weight adjusted version of the empirical distribution of observed data, adhering to predefined constraints on the weights. Such constraints often manifest as restrictions on the…

Machine Learning · Statistics 2024-01-17 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati

Dimensionality reduction is a fundamental task that aims to simplify complex data by reducing its feature dimensionality while preserving essential patterns, with core applications in data analysis and visualisation. To preserve the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Thomas Dagès , Simon Weber , Ya-Wei Eileen Lin , Ronen Talmon , Daniel Cremers , Michael Lindenbaum , Alfred M. Bruckstein , Ron Kimmel

Dimensionality is an important aspect for analyzing and understanding (high-dimensional) data. In their 2006 ICDM paper Tatti et al. answered the question for a (interpretable) dimension of binary data tables by introducing a normalized…

Machine Learning · Computer Science 2025-04-30 Tom Hanika , Tobias Hille

Efficient computation of the optimal transport distance between two distributions serves as an algorithm subroutine that empowers various applications. This paper develops a scalable first-order optimization-based method that computes…

Machine Learning · Computer Science 2024-06-21 Gen Li , Yanxi Chen , Yu Huang , Yuejie Chi , H. Vincent Poor , Yuxin Chen

In many practical applications it is important to build symmetries into neural network architectures. Consider the important case of permutation symmetry on point clouds consisting of $n$ points in $d$ dimensions. In this case the network…

Machine Learning · Computer Science 2026-05-12 Ali Syed , Aditya Nambiar , Jonathan W. Siegel

Replacing positivity constraints by an entropy barrier is popular to approximate solutions of linear programs. In the special case of the optimal transport problem, this technique dates back to the early work of Schr\"odinger. This approach…

Analysis of PDEs · Mathematics 2017-01-10 Guillaume Carlier , Vincent Duval , Gabriel Peyré , Bernhard Schmitzer