English
Related papers

Related papers: Curse of Dimensionality in Pivot-based Indexes

200 papers

In this work we study the validity of the so-called curse of dimensionality for indexing of databases for similarity search. We perform an asymptotic analysis, with a test model based on a sequence of metric spaces $(\Omega_d)$ from which…

Data Structures and Algorithms · Computer Science 2009-05-14 Ilya Volnyansky

Within a mathematically rigorous model, we analyse the curse of dimensionality for deterministic exact similarity search in the context of popular indexing schemes: metric trees. The datasets $X$ are sampled randomly from a domain $\Omega$,…

Data Structures and Algorithms · Computer Science 2013-03-27 Vladimir Pestov

We suggest that the curse of dimensionality affecting the similarity-based search in large datasets is a manifestation of the phenomenon of concentration of measure on high-dimensional structures. We prove that, under certain geometric…

Information Retrieval · Computer Science 2009-11-17 Vladimir Pestov

Real-world datasets are often of high dimension and effected by the curse of dimensionality. This hinders their comprehensibility and interpretability. To reduce the complexity feature selection aims to identify features that are crucial to…

Machine Learning · Computer Science 2023-04-18 Maximilian Stubbemann , Tobias Hille , Tom Hanika

The curse of dimensionality in the realm of association rules is twofold. Firstly, we have the well known exponential increase in computational complexity with increasing item set size. Secondly, there is a \emph{related curse} concerned…

Artificial Intelligence · Computer Science 2018-05-16 Tom Hanika , Friedrich Martin Schneider , Gerd Stumme

Numerical experiments indicate that deep learning algorithms overcome the curse of dimensionality when approximating solutions of semilinear PDEs. For certain linear PDEs and semilinear PDEs with gradient-independent nonlinearities this has…

Numerical Analysis · Mathematics 2024-09-24 Ariel Neufeld , Tuan Anh Nguyen

We prove the curse of dimensionality in the worst case setting for numerical integration for a number of classes of smooth $d$-variate functions. Roughly speaking, we consider different bounds for the derivatives of $f \in C^k(D_d)$ and ask…

Numerical Analysis · Mathematics 2014-04-23 Aicke Hinrichs , Erich Novak , Mario Ullrich , Henryk Wozniakowski

The characteristics of data like distribution and heterogeneity, become more complex and counterintuitive as dimensionality increases. This phenomenon is known as curse of dimensionality, where common patterns and relationships (e.g.,…

Machine Learning · Computer Science 2025-03-21 Dehua Peng , Zhipeng Gui , Huayi Wu

We study the integration and approximation problems for monotone and convex bounded functions that depend on $d$ variables, where $d$ can be arbitrarily large. We consider the worst case error for algorithms that use finitely many function…

Numerical Analysis · Mathematics 2013-12-13 Aicke Hinrichs , Erich Novak , Henryk Woźniakowski

The aim of this paper is to propose a geometric framework for modelling similarity search in large and multidimensional data spaces of general nature, which seems to be flexible enough to address such issues as analysis of complexity,…

Information Retrieval · Computer Science 2016-11-17 Vladimir Pestov

We study the following range searching problem in high-dimensional Euclidean spaces: given a finite set $P\subset \mathbb{R}^d$, where each $p\in P$ is assigned a weight $w_p$, and radius $r>0$, we need to preprocess $P$ into a data…

Computational Geometry · Computer Science 2026-03-13 Andreas Kalavas , Ioannis Psarros

Integration is affected by the curse of dimensionality and quickly becomes intractable as the dimensionality of the problem grows. We propose a randomized algorithm that, with high probability, gives a constant-factor approximation of a…

Machine Learning · Computer Science 2013-02-28 Stefano Ermon , Carla P. Gomes , Ashish Sabharwal , Bart Selman

We prove the curse of dimensionality in the worst case setting for multivariate numerical integration for various classes of smooth functions. We prove the results when the domains are isotropic convex bodies with small diameter satisfying…

Numerical Analysis · Mathematics 2019-08-15 Aicke Hinrichs , Joscha Prochno , Mario Ullrich

We perform a deeper analysis of an axiomatic approach to the concept of intrinsic dimension of a dataset proposed by us in the IJCNN'07 paper (arXiv:cs/0703125). The main features of our approach are that a high intrinsic dimension of a…

Information Retrieval · Computer Science 2009-11-17 Vladimir Pestov

The curse-of-dimensionality taxes computational resources heavily with exponentially increasing computational cost as the dimension increases. This poses great challenges in solving high-dimensional PDEs, as Richard E. Bellman first pointed…

Machine Learning · Computer Science 2024-05-20 Zheyuan Hu , Khemraj Shukla , George Em Karniadakis , Kenji Kawaguchi

In this dissertation we study the tractability of the information-based complexity $n(\varepsilon,d)$ for $d$-variate function approximation problems. In the deterministic setting for many unweighted problems the curse of dimensionality…

Numerical Analysis · Mathematics 2017-04-27 Robert J. Kunsch

It is one of the most challenging issues in applied mathematics to approximately solve high-dimensional partial differential equations (PDEs) and most of the numerical approximation methods for PDEs in the scientific literature suffer from…

Probability · Mathematics 2024-06-04 Fabian Hornung , Arnulf Jentzen , Diyora Salimova

We consider the problem of estimating a structured multivariate density, subject to Markov conditions implied by an undirected graph. In the worst case, without Markovian assumptions, this problem suffers from the curse of dimensionality.…

Machine Learning · Statistics 2024-10-11 Robert A. Vandermeulen , Wai Ming Tai , Bryon Aragam

This paper deals with the classical problem of density estimation on the real line. Most of the existing papers devoted to minimax properties assume that the support of the underlying density is bounded and known. But this assumption may be…

Statistics Theory · Mathematics 2009-07-13 Patricia Reynaud-Bouret , Vincent Rivoirard , Christine Tuleau-Malot

Practical applications of nonparametric density estimators in more than three dimensions suffer a great deal from the well-known curse of dimensionality: convergence slows down as dimension increases. We show that one can evade the curse of…

Methodology · Statistics 2016-11-24 Thomas Nagler , Claudia Czado
‹ Prev 1 2 3 10 Next ›