English
Related papers

Related papers: Interpreting the Curse of Dimensionality from Dist…

200 papers

The curse of dimensionality in the realm of association rules is twofold. Firstly, we have the well known exponential increase in computational complexity with increasing item set size. Secondly, there is a \emph{related curse} concerned…

Artificial Intelligence · Computer Science 2018-05-16 Tom Hanika , Friedrich Martin Schneider , Gerd Stumme

Real-world datasets are often of high dimension and effected by the curse of dimensionality. This hinders their comprehensibility and interpretability. To reduce the complexity feature selection aims to identify features that are crucial to…

Machine Learning · Computer Science 2023-04-18 Maximilian Stubbemann , Tobias Hille , Tom Hanika

High-dimensional computational challenges are frequently explained via the curse of dimensionality, i.e., increasing the number of dimensions leads to exponentially growing computational complexity. In this commentary, we argue that…

Adaptation and Self-Organizing Systems · Physics 2018-12-24 Christian Kuehn

We suggest that the curse of dimensionality affecting the similarity-based search in large datasets is a manifestation of the phenomenon of concentration of measure on high-dimensional structures. We prove that, under certain geometric…

Information Retrieval · Computer Science 2009-11-17 Vladimir Pestov

The failure of the Euclidean norm to reliably distinguish between nearby and distant points in high dimensional space is well-known. This phenomenon of distance concentration manifests in a variety of data distributions, with iid or…

Machine Learning · Computer Science 2022-01-17 Brian A. Powell

The stability of persistent homology has led to wide applications of the persistence diagram as a trusted topological descriptor in the presence of noise. However, with the increasing demand for high-dimension and low-sample-size data…

Statistics Theory · Mathematics 2025-11-04 Yasuaki Hiraoka , Yusuke Imoto , Shu Kanazawa , Enhao Liu

The curse of dimensionality is a common phenomenon which affects analysis of datasets characterized by large numbers of variables associated with each point. Problematic scenarios of this type frequently arise in classification algorithms…

Probability · Mathematics 2015-08-11 Benjamin Thirey , Randal Hickman

There is an increasing body of evidence suggesting that exact nearest neighbour search in high-dimensional spaces is affected by the curse of dimensionality at a fundamental level. Does it necessarily mean that the same is true for k…

Machine Learning · Statistics 2021-02-18 Vladimir Pestov

We study the integration and approximation problems for monotone and convex bounded functions that depend on $d$ variables, where $d$ can be arbitrarily large. We consider the worst case error for algorithms that use finitely many function…

Numerical Analysis · Mathematics 2013-12-13 Aicke Hinrichs , Erich Novak , Henryk Woźniakowski

We consider the problem of estimating a structured multivariate density, subject to Markov conditions implied by an undirected graph. In the worst case, without Markovian assumptions, this problem suffers from the curse of dimensionality.…

Machine Learning · Statistics 2024-10-11 Robert A. Vandermeulen , Wai Ming Tai , Bryon Aragam

High-dimensional data and high-dimensional representations of reality are inherent features of modern Artificial Intelligence systems and applications of machine learning. The well-known phenomenon of the "curse of dimensionality" states:…

Machine Learning · Computer Science 2020-01-22 Alexander N. Gorban , Valery A. Makarov , Ivan Y. Tyukin

In this dissertation we study the tractability of the information-based complexity $n(\varepsilon,d)$ for $d$-variate function approximation problems. In the deterministic setting for many unweighted problems the curse of dimensionality…

Numerical Analysis · Mathematics 2017-04-27 Robert J. Kunsch

Bayesian approach provides a coherent framework to address the model updating problem in structural health monitoring. The current practice, however, only focuses on low-dimension model (generally no more than 20 parameters), which limits…

Methodology · Statistics 2025-06-24 Li Binbin , Liao Zihan

The curse of dimensionality causes the well-known and widely discussed problems for machine learning methods. There is a hypothesis that using of the Manhattan distance and even fractional quasinorms lp (for p less than 1) can help to…

Machine Learning · Computer Science 2021-03-04 Evgeny M. Mirkes , Jeza Allohibi , Alexander N. Gorban

Modern vector databases enable efficient retrieval over high-dimensional neural embeddings, powering applications from web search to retrieval-augmented generation. However, classical theory predicts such tasks should suffer from the curse…

Information Retrieval · Computer Science 2026-02-13 Vihan Lakshman , Blaise Munyampirwa , Julian Shun , Benjamin Coleman

In this work we study the validity of the so-called curse of dimensionality for indexing of databases for similarity search. We perform an asymptotic analysis, with a test model based on a sequence of metric spaces $(\Omega_d)$ from which…

Data Structures and Algorithms · Computer Science 2009-05-14 Ilya Volnyansky

We offer a theoretical validation of the curse of dimensionality in the pivot-based indexing of datasets for similarity search, by proving, in the framework of statistical learning, that in high dimensions no pivot-based indexing scheme can…

Data Structures and Algorithms · Computer Science 2016-11-17 Ilya Volnyansky , Vladimir Pestov

Distances between data points are widely used in machine learning applications. Yet, when corrupted by noise, these distances -- and thus the models based upon them -- may lose their usefulness in high dimensions. Indeed, the small marginal…

Machine Learning · Computer Science 2022-03-08 Robin Vandaele , Bo Kang , Tijl De Bie , Yvan Saeys

Artificial intelligence, particularly the subfield of machine learning, has seen a paradigm shift towards data-driven models that learn from and adapt to data. This has resulted in unprecedented advancements in various domains such as…

Machine Learning · Computer Science 2023-10-26 Leonardo Petrini

Curse of Dimensionality is an unavoidable challenge in statistical probability models, yet diffusion models seem to overcome this limitation, achieving impressive results in high-dimensional data generation. Diffusion models assume that…

Machine Learning · Statistics 2025-10-01 Zhenxin Zheng , Zhenjie Zheng
‹ Prev 1 2 3 10 Next ›