English
Related papers

Related papers: Minimum intrinsic dimension scaling for entropic o…

200 papers

In recent decades, much attention has been focused on the topic of optimal paths in weighted networks due to its broad scientific interest and technological applications. In this work we revisit the problem of the optimal path between two…

Statistical Mechanics · Physics 2024-01-19 Daniel Villarrubia-Moreno , Pedro Córdoba-Torres

The classical (overdamped) Langevin dynamics provide a natural algorithm for sampling from its invariant measure, which uniquely minimizes an energy functional over the space of probability measures, and which concentrates around the…

Probability · Mathematics 2023-09-26 Giovanni Conforti , Daniel Lacker , Soumik Pal

The manifold hypothesis says that natural high-dimensional data lie on or around a low-dimensional manifold. The recent success of statistical and learning-based methods in very high dimensions empirically supports this hypothesis,…

Machine Learning · Computer Science 2025-05-06 Hong Ye Tan , Subhadip Mukherjee , Junqi Tang , Carola-Bibiane Schönlieb

Metric embeddings are a widely used method in algorithm design, where generally a ``complex'' metric is embedded into a simpler, lower-dimensional one. Historically, the theoretical computer science community has focused on bi-Lipschitz…

Data Structures and Algorithms · Computer Science 2025-05-19 Ainesh Bakshi , Vincent Cohen-Addad , Samuel B. Hopkins , Rajesh Jayaram , Silvio Lattanzi

In this paper we determine quantitative stability bounds for the Hessian of entropic potentials, \ie, the dual solution to the entropic optimal transport problem. To the authors' knowledge this is the first work addressing this second-order…

Probability · Mathematics 2025-11-14 Giacomo Greco , Luca Tamanini

In the last decades the estimation of the intrinsic dimensionality of a dataset has gained considerable importance. Despite the great deal of research work devoted to this task, most of the proposed solutions prove to be unreliable when the…

Machine Learning · Computer Science 2012-06-19 Claudio Ceruti , Simone Bassis , Alessandro Rozza , Gabriele Lombardi , Elena Casiraghi , Paola Campadelli

High-dimensional limit theorems have been shown useful to derive tuning rules for finding the optimal scaling in random-walk Metropolis algorithms. The assumptions under which weak convergence results are proved are however restrictive: the…

Methodology · Statistics 2022-02-16 Sebastian M Schmon , Philippe Gagnon

Entropic optimal transport -- the optimal transport problem regularized by KL diver\-gence -- is highly successful in statistical applications. Thanks to the smoothness of the entropic coupling, its sample complexity avoids the curse of…

Statistics Theory · Mathematics 2025-05-09 Alberto González-Sanz , Stephan Eckstein , Marcel Nutz

Many real networks are embedded in space, where in some of them the links length decay as a power law distribution with distance. Indications that such systems can be characterized by the concept of dimension were found recently. Here, we…

Physics and Society · Physics 2015-06-05 Thorsten Emmerich , Armin Bunde , Shlomo Havlin , Li Guanlian , Li Daqing

Strong, scale-free disorder disrupts typical transport properties like the Stokes-Einstein relation and linear response, leading to anomalous, non-diffusive motion observed in amorphous materials, glasses, living cells, and other systems.…

Statistical Mechanics · Physics 2024-03-05 Dan Shafir , Stanislav Burov

The distance and divergence of the probability measures play a central role in statistics, machine learning, and many other related fields. The Wasserstein distance has received much attention in recent years because of its distinctions…

Statistics Theory · Mathematics 2021-03-11 Qijun Tong , Kei Kobayashi

We introduce the Sinkhorn treatment effect, an entropic optimal transport measure of divergence between counterfactual distributions. Unlike classical quantities such as the average treatment effect, this measure captures differences across…

Machine Learning · Statistics 2026-05-12 Medha Agarwal , Alex Luedtke

We study the vanishing-regularization limit of entropically regularized optimal transport (EOT) for the Euclidean distance cost $c(x,y)=\|x-y\|$ in dimension $d>1$. We develop a comprehensive variational convergence framework that entails…

Optimization and Control · Mathematics 2026-04-29 Marcel Nutz , Chenyang Zhong

Existing theories on deep nonparametric regression have shown that when the input data lie on a low-dimensional manifold, deep neural networks can adapt to the intrinsic data structures. In real world applications, such an assumption of…

Machine Learning · Computer Science 2023-06-27 Zixuan Zhang , Minshuo Chen , Mengdi Wang , Wenjing Liao , Tuo Zhao

Multidimensional scaling is an important dimension reduction tool in statistics and machine learning. Yet few theoretical results characterizing its statistical performance exist, not to mention any in high dimensions. By considering a…

Methodology · Statistics 2022-03-30 Xiucai Ding , Qiang Sun

We study the small-regularisation limit of the entropic optimal transport problem on the line with distance cost. While convergence of entropic minimizers is well understood in the discrete setting and in the case where the cost is…

Optimization and Control · Mathematics 2025-12-08 Armand Ley

Manifold hypothesis states that data points in high-dimensional space actually lie in close vicinity of a manifold of much lower dimension. In many cases this hypothesis was empirically verified and used to enhance unsupervised and…

Why does the low dimensionality of representations, typically $d\approx 1000$, not prevent modern embedding-based retrieval models from scaling to billions, or even trillions, of data points? To answer this question, we study maximal-margin…

Machine Learning · Computer Science 2026-05-25 Kiril Bangachev , Guy Bresler , Jonathan Kogan , Yury Polyanskiy

Statistical inference from high-dimensional data with low-dimensional structures has recently attracted lots of attention. In machine learning, deep generative modeling approaches implicitly estimate distributions of complex objects by…

Statistics Theory · Mathematics 2022-02-21 Rong Tang , Yun Yang

Randomized dimensionality reduction is a widely-used algorithmic technique for speeding up large-scale Euclidean optimization problems. In this paper, we study dimension reduction for a variety of maximization problems, including…

Data Structures and Algorithms · Computer Science 2025-06-03 Jie Gao , Rajesh Jayaram , Benedikt Kolbe , Shay Sapir , Chris Schwiegelshohn , Sandeep Silwal , Erik Waingarten