English
Related papers

Related papers: The Curse Revisited: When are Distances Informativ…

200 papers

This paper has two messages. First, we demonstrate that neural networks that process noisy data can learn to exploit, when available, access to auxiliary noise that is correlated with the noise on the data. In effect, the network learns to…

Quantum Physics · Physics 2020-09-17 Aida Ahmadzadegan , Petar Simidzija , Ming Li , Achim Kempf

The goal of ordinal embedding is to represent items as points in a low-dimensional Euclidean space given a set of constraints in the form of distance comparisons like "item $i$ is closer to item $j$ than item $k$". Ordinal constraints like…

Machine Learning · Statistics 2016-06-24 Lalit Jain , Kevin Jamieson , Robert Nowak

The failure of the Euclidean norm to reliably distinguish between nearby and distant points in high dimensional space is well-known. This phenomenon of distance concentration manifests in a variety of data distributions, with iid or…

Machine Learning · Computer Science 2022-01-17 Brian A. Powell

Measuring the distance between data points is fundamental to many statistical techniques, such as dimension reduction or clustering algorithms. However, improvements in data collection technologies has led to a growing versatility of…

Methodology · Statistics 2022-06-20 George Bolt , Simón Lunagómez , Christopher Nemeth

Datasets such as images, text, or movies are embedded in high-dimensional spaces. However, in important cases such as images of objects, the statistical structure in the data constrains samples to a manifold of dramatically lower…

Machine Learning · Computer Science 2019-10-29 Stefano Recanatesi , Matthew Farrell , Madhu Advani , Timothy Moore , Guillaume Lajoie , Eric Shea-Brown

We study the problem of recovering the latent ground truth labeling of a structured instance with categorical random variables in the presence of noisy observations. We present a new approximate algorithm for graphs with categorical…

Machine Learning · Computer Science 2019-07-09 Alireza Heidari , Ihab F. Ilyas , Theodoros Rekatsinas

We consider the problem of reconstructing the intrinsic geometry of a manifold from noisy pairwise distance observations. Specifically, let $M$ denote a diameter 1 d-dimensional manifold and $\mu$ a probability measure on $M$ that is…

Machine Learning · Statistics 2025-11-18 Charles Fefferman , Jonathan Marty , Kevin Ren

Text data is often seen as "take-away" materials with little noise and easy to process information. Main questions are how to get data and transform them into a good document format. But data can be sensitive to noise oftenly called…

Computation and Language · Computer Science 2023-06-22 Nicolas Turenne

Large-scale pretraining datasets drive the success of large language models (LLMs). However, these web-scale corpora inevitably contain large amounts of noisy data due to unregulated web content or randomness inherent in data. Although LLM…

Machine Learning · Computer Science 2026-02-03 Qizhen Zhang , Ankush Garg , Jakob Foerster , Niladri Chatterji , Kshitiz Malik , Mike Lewis

The distance transform (DT) and its many variations are ubiquitous tools for image processing and analysis. In many imaging scenarios, the images of interest are corrupted by noise. This has a strong negative impact on the accuracy of the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Johan Öfverstedt , Joakim Lindblad , Nataša Sladoje

Consider an unlimited homogeneous medium disturbed by points generated via Poisson process. The neighborhood of a point plays an important role in spatial statistics problems. Here, we obtain analytically the distance statistics to $k$th…

Statistical Mechanics · Physics 2015-08-11 Cristiano Roberto Fabri Granzotti , Alexandre Souto Martinez

We consider the problem of positioning a cloud of points in the Euclidean space $\mathbb{R}^d$, using noisy measurements of a subset of pairwise distances. This task has applications in various areas, such as sensor network localization and…

Statistics Theory · Mathematics 2012-11-22 Adel Javanmard , Andrea Montanari

In non-stationary environments, learning machines usually confront the domain adaptation scenario where the data distribution does change over time. Previous domain adaptation works have achieved great success in theory and practice.…

Machine Learning · Computer Science 2020-05-06 Zhongyi Han , Xian-Jin Gui , Chaoran Cui , Yilong Yin

High-dimensional data must be highly structured to be learnable. Although the compositional and hierarchical nature of data is often put forward to explain learnability, quantitative measurements establishing these properties are scarce.…

Machine Learning · Statistics 2025-03-04 Antonio Sclocchi , Alessandro Favero , Noam Itzhak Levi , Matthieu Wyart

High-dimensional data and high-dimensional representations of reality are inherent features of modern Artificial Intelligence systems and applications of machine learning. The well-known phenomenon of the "curse of dimensionality" states:…

Machine Learning · Computer Science 2020-01-22 Alexander N. Gorban , Valery A. Makarov , Ivan Y. Tyukin

Classical multidimensional scaling is an important dimension reduction technique. Yet few theoretical results characterizing its statistical performance exist. This paper provides a theoretical framework for analyzing the quality of…

Statistics Theory · Mathematics 2020-07-09 Anna Little , Yuying Xie , Qiang Sun

Recent work has shown that Transformers can perform in-context learning for linear regression under restrictive assumptions, including i.i.d. data, Gaussian noise, and Gaussian regression coefficients. However, real-world data often violate…

Machine Learning · Computer Science 2026-03-20 Hoang T. H. Cao , Hai D. V. Trinh , Tho Quan , Lan V. Truong

The physics of dirty bosons highlights the intriguing interplay of disorder and interactions in quantum systems, playing a central role in describing, for instance, ultracold gases in a random potential, doped quantum magnets, and amorphous…

Disordered Systems and Neural Networks · Physics 2022-10-18 Lindsay Bassman Oftelie , Roel Van Beeumen , Daan Camps , Wibe A. de Jong , Maxime Dupont

Sparse coding, which refers to modeling a signal as sparse linear combinations of the elements of a learned dictionary, has proven to be a successful (and interpretable) approach in applications such as signal processing, computer vision,…

Machine Learning · Computer Science 2023-06-02 Muthu Chidambaram , Chenwei Wu , Yu Cheng , Rong Ge

The abundance of data produced daily from large variety of sources has boosted the need of novel approaches on causal inference analysis from observational data. Observational data often contain noisy or missing entries. Moreover, causal…

Methodology · Statistics 2017-03-14 Fani Tsapeli , Peter Tino , Mirco Musolesi