English
Related papers

Related papers: On the I/O complexity of the k-nearest neighbor pr…

200 papers

Feature correspondence selection is pivotal to many feature-matching based tasks in computer vision. Searching for spatially k-nearest neighbors is a common strategy for extracting local information in many previous works. However, there is…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Chen Zhao , Zhiguo Cao , Chi Li , Xin Li , Jiaqi Yang

Learning a robust classifier from a few samples remains a key challenge in machine learning. A major thrust of research has been focused on developing $k$-nearest neighbor ($k$-NN) based algorithms combined with metric learning that…

Machine Learning · Statistics 2022-02-17 Shixiang Zhu , Liyan Xie , Minghe Zhang , Rui Gao , Yao Xie

In this paper we study the problem of finding the approximate nearest neighbor of a query point in the high dimensional space, focusing on the Euclidean space. The earlier approaches use locality-preserving hash functions (that tend to map…

Data Structures and Algorithms · Computer Science 2007-05-23 Rina Panigrahy

We study the design of efficient approximation algorithms for the $\ell$-center clustering and minimum-diameter $\ell$-clustering problems in high dimensional Euclidean and Hamming spaces. Our main tool is randomized dimension reduction.…

Data Structures and Algorithms · Computer Science 2025-12-04 Mirosław Kowaluk , Andrzej Lingas , Mia Persson

The k-means algorithm is a well-known method for partitioning n points that lie in the d-dimensional space into k clusters. Its main features are simplicity and speed in practice. Theoretically, however, the best known upper bound on its…

Computational Geometry · Computer Science 2008-12-03 Andrea Vattani

The nearest neighbor problem is defined as follows: Given a set $P$ of $n$ points in some metric space $(X,D)$, build a data structure that, given any point $q$, returns a point in $P$ that is closest to $q$ (its "nearest neighbor" in $P$).…

Data Structures and Algorithms · Computer Science 2018-06-27 Alexandr Andoni , Piotr Indyk , Ilya Razenshteyn

Analyzing high-dimensional data with manifold learning algorithms often requires searching for the nearest neighbors of all observations. This presents a computational bottleneck in statistical manifold learning when observations of…

Machine Learning · Computer Science 2022-03-11 Fan Cheng , Anastasios Panagiotelis , Rob J Hyndman

This paper considers the problem of approximate nearest neighbor search in the compressed domain. We introduce polysemous codes, which offer both the distance estimation quality of product quantization and the efficient comparison of binary…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Matthijs Douze , Hervé Jégou , Florent Perronnin

KNN has the reputation to be the word simplest but efficient supervised learning algorithm used for either classification or regression. KNN prediction efficiency highly depends on the size of its training data but when this training data…

Machine Learning · Computer Science 2021-07-01 Jude Tchaye-Kondi , Yanlong Zhai , Liehuang Zhu

The problem of non-monotone $k$-submodular maximization under a knapsack constraint ($\kSMK$) over the ground set size $n$ has been raised in many applications in machine learning, such as data summarization, information propagation, etc.…

Data Structures and Algorithms · Computer Science 2023-09-22 Dung T. K. Ha , Canh V. Pham , Tan D. Tran , Huan X. Hoang

Binary vector embeddings enable fast nearest neighbor retrieval in large databases of high-dimensional objects, and play an important role in many practical applications, such as image and video retrieval. We study the problem of learning…

Computer Vision and Pattern Recognition · Computer Science 2018-06-26 Fatih Cakir , Kun He , Sarah Adel Bargal , Stan Sclaroff

The k-means objective is arguably the most widely-used cost function for modeling clustering tasks in a metric space. In practice and historically, k-means is thought of in a continuous setting, namely where the centers can be located…

Computational Complexity · Computer Science 2020-10-08 Vincent Cohen-Addad , Karthik C. S. , Euiwoong Lee

To what extent is it possible to visualize high-dimensional data in two- or three-dimensional plots? We reframe this question in terms of embedding $n$-vertex graphs (representing the neighborhood structure of the input points) into metric…

Computational Geometry · Computer Science 2026-01-19 Szymon Snoeck , Noah Bergam , Nakul Verma

Similarity search is a fundamental algorithmic primitive, widely used in many computer science disciplines. Given a set of points $S$ and a radius parameter $r>0$, the $r$-near neighbor ($r$-NN) problem asks for a data structure that, given…

Data Structures and Algorithms · Computer Science 2021-01-27 Martin Aumüller , Sariel Har-Peled , Sepideh Mahabadi , Rasmus Pagh , Francesco Silvestri

Nearest neighbor (NN) search is inherently computationally expensive in high-dimensional spaces due to the curse of dimensionality. As a well-known solution, locality-sensitive hashing (LSH) is able to answer c-approximate NN (c-ANN)…

Databases · Computer Science 2021-07-13 Bolong Zheng , Xi Zhao , Lianggui Weng , Nguyen Quoc Viet Hung , Hang Liu , Christian S. Jensen

We initiate the study of multi-attribute group fairness in $k$-nearest neighbor ($k$-NN) search over vector databases. Unlike prior work that optimizes efficiency or query filtering, fairness imposes count constraints to ensure proportional…

Databases · Computer Science 2026-02-23 Thinh On , Senjuti Basu Roy , Baruch Schieber

We study the Approximate Nearest Neighbor (ANN) problem under a powerful adaptive adversary that controls both the dataset and a sequence of $Q$ queries. Primarily, for the high-dimensional regime of $d = \omega(\sqrt{Q})$, we introduce a…

Data Structures and Algorithms · Computer Science 2026-01-05 Alexandr Andoni , Themistoklis Haris , Esty Kelman , Krzysztof Onak

Explicitly or implicitly, most of dimensionality reduction methods need to determine which samples are neighbors and the similarity between the neighbors in the original highdimensional space. The projection matrix is then learned on the…

Computer Vision and Pattern Recognition · Computer Science 2017-09-12 Yanwei Pang , Bo Zhou , Feiping Nie

In this work, we study the hardness of approximation of the fair $k$-center problem. In this problem, we are given a set of data points in a metric space that is partitioned into groups and the task is to choose a subset of $k$-data points,…

Computational Complexity · Computer Science 2026-02-24 Suhas Thejaswi

Top-k Nearest Neighbors (kNN) problem on road network has numerous applications on location-based services. As direct search using the Dijkstra's algorithm results in a large search space, a plethora of complex-index-based approaches have…

Databases · Computer Science 2024-08-13 Yiqi Wang , Long Yuan , Wenjie Zhang , Xuemin Lin , Zi Chen , Qing Liu