English
Related papers

Related papers: Input Sparsity and Hardness for Robust Subspace Ap…

200 papers

The sparse Johnson-Lindenstrauss transform is one of the central techniques in dimensionality reduction. It supports embedding a set of $n$ points in $\mathbb{R}^d$ into $m=O(\varepsilon^{-2} \lg n)$ dimensions while preserving all pairwise…

Data Structures and Algorithms · Computer Science 2023-02-14 Mikael Møller Høgsgaard , Lion Kamma , Kasper Green Larsen , Jelani Nelson , Chris Schwiegelshohn

Consider a dataset of n(d) points generated independently from R^d according to a common p.d.f. f_d with support(f_d) = [0,1]^d and sup{f_d([0,1]^d)} growing sub-exponentially in d. We prove that: (i) if n(d) grows sub-exponentially in d,…

Databases · Computer Science 2009-09-01 Chris Giannella

Let $k$ be a nonnegative integer. In the approximate $k$-flat nearest neighbor ($k$-ANN) problem, we are given a set $P \subset \mathbb{R}^d$ of $n$ points in $d$-dimensional space and a fixed approximation factor $c > 1$. Our goal is to…

Computational Geometry · Computer Science 2014-11-07 Wolfgang Mulzer , Huy L. Nguyen , Paul Seiferth , Yannik Stein

The challenge of approximating functions in infinite-dimensional spaces from finite samples is widely regarded as formidable. We delve into the challenging problem of the numerical approximation of Sobolev-smooth functions defined on…

Optimization and Control · Mathematics 2024-10-11 Massimo Fornasier , Pascal Heid , Giacomo Enrico Sodini

Multidimensional Scaling (MDS) is one of the most popular methods for dimensionality reduction and visualization of high dimensional data. Apart from these tasks, it also found applications in the field of geometry processing for the…

Computational Geometry · Computer Science 2017-09-12 Amit Boyarski , Alex M. Bronstein , Michael M. Bronstein

\textit{Clustering problems} often arise in the fields like data mining, machine learning etc. to group a collection of objects into similar groups with respect to a similarity (or dissimilarity) measure. Among the clustering problems,…

Computational Geometry · Computer Science 2015-12-10 Sayan Bandyapadhyay , Kasturi Varadarajan

We consider static, external memory indexes for exact and approximate versions of the $k$-nearest neighbor ($k$-NN) problem, and show new lower bounds under a standard indivisibility assumption: - Polynomial space indexing schemes for…

Data Structures and Algorithms · Computer Science 2020-04-02 Mayank Goswami , Riko Jacob , Rasmus Pagh

Traditional problems in computational geometry involve aspects that are both discrete and continuous. One such example is nearest-neighbor searching, where the input is discrete, but the result depends on distances, which vary continuously.…

Computational Geometry · Computer Science 2023-08-21 Ahmed Abdelkader , David M. Mount

We consider the problem of finding high dimensional approximate nearest neighbors. Suppose there are d independent rare features, each having its own independent statistics. A point x will have x_{i}=0 denote the absence of feature i, and…

Information Theory · Computer Science 2008-10-24 Moshe Dubiner

The k Nearest Neighbors (kNN) method has received much attention in the past decades, where some theoretical bounds on its performance were identified and where practical optimizations were proposed for making it work fairly well in high…

Machine Learning · Computer Science 2016-06-14 Aleksander Lodwich , Faisal Shafait , Thomas Breuel

We generalize the monotone local search approach of Fomin, Gaspers, Lokshtanov and Saurabh [J. ACM 2019], by establishing a connection between parameterized approximation and exponential-time approximation algorithms for monotone subset…

Data Structures and Algorithms · Computer Science 2026-01-13 Barış Can Esmer , Ariel Kulik , Dániel Marx , Daniel Neuen , Roohani Sharma

This paper develops a comprehensive probabilistic setup to compute approximating functions in active subspaces. Constantine et al. proposed the active subspace method in (Constantine et al., 2014) to reduce the dimension of computational…

Probability · Mathematics 2019-04-09 Mario Teixeira Parente

We consider the problem of computing a $k$-sparse approximation to the Fourier transform of a length $N$ signal. Our main result is a randomized algorithm for computing such an approximation (i.e. achieving the $\ell_2/\ell_2$ sparse…

Data Structures and Algorithms · Computer Science 2016-04-05 Michael Kapralov

We study the problem of determining the minimum number $f(n,k,d)$ of affine subspaces of codimension $d$ that are required to cover all points of $\mathbb{F}_2^n\setminus \{\vec{0}\}$ at least $k$ times while covering the origin at most…

Combinatorics · Mathematics 2021-01-29 Anurag Bishnoi , Simona Boyadzhiyska , Shagnik Das , Tamás Mészáros

Nearest neighbor (NN) problem is an important scientific problem. The NN query, to find the closest one to a given query point among a set of points, is widely used in applications such as density estimation, pattern classification,…

Databases · Computer Science 2019-11-11 Yang Li , Gang Liu , Junbin Gao , Zhenwen He , Mingyuan Bai , Chengjun Li

The \emph{top-$k$-sum} operator computes the sum of the largest $k$ components of a given vector. The Euclidean projection onto the top-$k$-sum sublevel set serves as a crucial subroutine in iterative methods to solve composite…

Optimization and Control · Mathematics 2026-03-26 Jake Roth , Ying Cui

The volume of image repositories continues to grow. Despite the availability of content-based addressing, we still lack a lightweight tool that allows us to discover images of distinct characteristics from a large collection. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Shanfeng Hu

The greedy and nearest-neighbor TSP heuristics can both have $\log n$ approximation factors from optimal in worst case, even just for $n$ points in Euclidean space. In this note, we show that this approximation factor is only realized when…

Discrete Mathematics · Computer Science 2023-10-06 Alan Frieze , Wesley Pegden

We give near-tight lower bounds for the sparsity required in several dimensionality reducing linear maps. First, consider the JL lemma which states that for any set of n vectors in R there is a matrix A in R^{m x d} with m = O(eps^{-2}log…

Data Structures and Algorithms · Computer Science 2012-11-07 Jelani Nelson , Huy L. Nguyen

There are a number of approximation algorithms for NP-hard versions of low rank approximation, such as finding a rank-$k$ matrix $B$ minimizing the sum of absolute values of differences to a given $n$-by-$n$ matrix $A$,…

Data Structures and Algorithms · Computer Science 2020-04-20 Zhao Song , David P. Woodruff , Peilin Zhong