English
Related papers

Related papers: INSQ: An Influential Neighbor Set Based Moving kNN…

200 papers

High time complexity is one of the biggest challenges faced by $k$-Nearest Neighbors ($k$NN). Although current classical and quantum $k$NN algorithms have made some improvements, they still have a speed bottleneck when facing large amounts…

Quantum Physics · Physics 2025-05-30 Shuyin Xia , Xiaojiang Tian , Suzhen Yuan , Jeremiah D. Deng

Despite their power, Transformers face challenges with long sequences due to the quadratic complexity of self-attention. To address this limitation, methods like $k$-Nearest-Neighbor ($k$NN) attention have been introduced [Roy, Saffar,…

Machine Learning · Computer Science 2024-11-11 Themistoklis Haris

Suppose $V$ is an $n$-element set where for each $x \in V$, the elements of $V \setminus \{x\}$ are ranked by their similarity to $x$. The $K$-nearest neighbor graph is a directed graph including an arc from each $x$ to the $K$ points of $V…

Combinatorics · Mathematics 2020-12-29 Jacob D. Baron , R. W. R. Darling

Nearest neighbor search (NNS) has a wide range of applications in information retrieval, computer vision, machine learning, databases, and other areas. Existing state-of-the-art algorithm for nearest neighbor search, Hierarchical Navigable…

Information Retrieval · Computer Science 2020-10-20 Ishita Doshi , Dhritiman Das , Ashish Bhutani , Rajeev Kumar , Rushi Bhatt , Niranjan Balasubramanian

k-nearest neighbor graph is a fundamental data structure in many disciplines such as information retrieval, data-mining, pattern recognition, and machine learning, etc. In the literature, considerable research has been focusing on how to…

Information Retrieval · Computer Science 2021-07-30 Wan-Lei Zhao , Hui Wang , Peng-Cheng Lin , Chong-Wah Ngo

Nearest neighbor (NN) search is inherently computationally expensive in high-dimensional spaces due to the curse of dimensionality. As a well-known solution, locality-sensitive hashing (LSH) is able to answer c-approximate NN (c-ANN)…

Databases · Computer Science 2021-07-13 Bolong Zheng , Xi Zhao , Lianggui Weng , Nguyen Quoc Viet Hung , Hang Liu , Christian S. Jensen

Existing systems dealing with the increasing volume of data series cannot guarantee interactive response times, even for fundamental tasks such as similarity search. Therefore, it is necessary to develop analytic approaches that support…

Databases · Computer Science 2022-12-29 Karima Echihabi , Theophanis Tsandilas , Anna Gogolou , Anastasia Bezerianos , Themis Palpanas

Deep Neural Networks require large amounts of labeled data for their training. Collecting this data at scale inevitably causes label noise.Hence,the need to develop learning algorithms that are robust to label noise. In recent years, k…

Machine Learning · Computer Science 2021-07-22 Itzik Mizrahi , Shai Avidan

Neural network classifiers have become the de-facto choice for current "pre-train then fine-tune" paradigms of visual classification. In this paper, we investigate k-Nearest-Neighbor (k-NN) classifiers, a classical model-free learning…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Menglin Jia , Bor-Chun Chen , Zuxuan Wu , Claire Cardie , Serge Belongie , Ser-Nam Lim

Nearest-neighbour retrieval is central to classification and explainable-AI pipelines, but current practice relies on hand-tuning feature layers and distance metrics. We propose Targeted Manifold Manipulation-Nearest Neighbour (TMM-NN),…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 B. Ghosh , H. Harikumar , S. Rana

In many scientific disciplines structures in high-dimensional data have to be found, e.g., in stellar spectra, in genome data, or in face recognition tasks. In this work we present a novel approach to non-linear dimensionality reduction. It…

Machine Learning · Statistics 2011-09-27 Oliver Kramer

This work presents a secure novel solution based on inertial measurement units to provide indoor location and positioning in airports. The use of different technologies allows to locate people with precision in this kind of indoor places…

Cryptography and Security · Computer Science 2022-09-29 I Santos-González , A Rivero-García , P Caballero-Gil

The k-Nearest Neighbors (kNN) classifier is a fundamental non-parametric machine learning algorithm. However, it is well known that it suffers from the curse of dimensionality, which is why in practice one often applies a kNN classifier on…

Machine Learning · Computer Science 2020-10-16 Luka Rimanic , Cedric Renggli , Bo Li , Ce Zhang

The $k$-nearest neighbour ($k$-NN) classifier is one of the oldest and most important supervised learning algorithms for classifying datasets. Traditionally the Euclidean norm is used as the distance for the $k$-NN classifier. In this…

Machine Learning · Statistics 2015-12-02 Stan Hatko

In this paper, we propose a data structure, a quadruple neighbor list (QN-list, for short), to support real time queries of all longest increasing subsequence (LIS) and LIS with constraints over sequential data streams. The QN-List built by…

Data Structures and Algorithms · Computer Science 2016-10-12 Youhuan Li , Lei Zou , Huaming Zhang , Dongyan Zhao

The primary example of instance-based learning is the $k$-nearest neighbor rule (kNN), praised for its simplicity and the capacity to adapt to new unseen data and toss away old data. The main disadvantages often mentioned are the…

Machine Learning · Computer Science 2021-02-05 Ariana Talamantes , Edgar Chavez

In this work we introduce a quantum sorting algorithm with adaptable requirements of memory and circuit depth, and then use it to develop a new quantum version of the classical machine learning algorithm known as k-nearest neighbors (k-NN).…

Quantum Physics · Physics 2022-04-11 L. F. Quezada , Guo-Hua Sun , Shi-Hai Dong

Approximate nearest neighbor search (ANN) data structures have widespread applications in machine learning, computational biology, and text processing. The goal of ANN is to preprocess a set S so that, given a query q, we can find a point y…

Data Structures and Algorithms · Computer Science 2024-07-03 Samuel McCauley

This paper presents how to perform minimax optimal classification, regression, and density estimation based on fixed-$k$ nearest neighbor (NN) searches. We consider a distributed learning scenario, in which a massive dataset is split into…

Statistics Theory · Mathematics 2024-09-11 J. Jon Ryu , Young-Han Kim

Similarity search retrieves the nearest neighbors of a query vector from a dataset of high-dimensional vectors. As the size of the dataset grows, the cost of performing the distance computations needed to implement a query can become…

Machine Learning · Computer Science 2019-12-20 Soroosh Khoram , Stephen J Wright , Jing Li