English
Related papers

Related papers: Dynamic Feature Scaling for K-Nearest Neighbor Alg…

200 papers

Several researchers proposed using non-Euclidean metrics on point sets in Euclidean space for clustering noisy data. Almost always, a distance function is desired that recognizes the closeness of the points in the same cluster, even if the…

Computational Geometry · Computer Science 2015-03-02 Michael B. Cohen , Brittany Terese Fasy , Gary L. Miller , Amir Nayyeri , Donald R. Sheehy , Ameya Velingker

The distance metric plays an important role in nearest neighbor (NN) classification. Usually the Euclidean distance metric is assumed or a Mahalanobis distance metric is optimized to improve the NN performance. In this paper, we study the…

Machine Learning · Statistics 2007-06-26 Bharath K. Sriperumbudur , Gert R. G. Lanckriet

Perhaps the most straightforward classifier in the arsenal or machine learning techniques is the Nearest Neighbour Classifier -- classification is achieved by identifying the nearest neighbours to a query example and using those neighbours…

Machine Learning · Computer Science 2021-08-10 Padraig Cunningham , Sarah Jane Delany

Nearest neighbor search is known as a challenging issue that has been studied for several decades. Recently, this issue becomes more and more imminent in viewing that the big data problem arises from various fields. In this paper, a…

Computer Vision and Pattern Recognition · Computer Science 2017-02-06 Wan-Lei Zhao , Jie Yang , Cheng-Hao Deng

The k-nearest neighbors (kNN) algorithm is a cornerstone of non-parametric classification in artificial intelligence, yet its deployment in large-scale applications is persistently constrained by the computational trade-off between…

Machine Learning · Computer Science 2026-01-26 Jiaye Li , Gang Chen , Hang Xu , Shichao Zhang

We suggest a robust nearest-neighbor approach to classifying high-dimensional data. The method enhances sensitivity by employing a threshold and truncates to a sequence of zeros and ones in order to reduce the deleterious impact of…

Statistics Theory · Mathematics 2009-09-02 Yao-ban Chan , Peter Hall

This paper proposes a soft range limited K nearest neighbours (SRL-KNN) localization fingerprinting algorithm. The conventional KNN determines the neighbours of a user by calculating and ranking the fingerprint distance measured at the…

Signal Processing · Electrical Eng. & Systems 2022-11-09 Minh Tu Hoang , Yizhou Zhu , Brosnan Yuen , Tyler Reese , Xiaodai Dong , Tao Lu , Robert Westendorp , Michael Xie

Nearest neighbor is a popular nonparametric method for classification and regression with many appealing properties. In the big data era, the sheer volume and spatial/temporal disparity of big data may prohibit centrally processing and…

Statistics Theory · Mathematics 2018-12-13 Jiexin Duan , Xingye Qiao , Guang Cheng

Probabilistic k-nearest neighbour (PKNN) classification has been introduced to improve the performance of original k-nearest neighbour (KNN) classification algorithm by explicitly modelling uncertainty in the classification of each feature…

Machine Learning · Computer Science 2013-05-07 Ji Won Yoon , Nial Friel

Explicitly or implicitly, most of dimensionality reduction methods need to determine which samples are neighbors and the similarity between the neighbors in the original highdimensional space. The projection matrix is then learned on the…

Computer Vision and Pattern Recognition · Computer Science 2017-09-12 Yanwei Pang , Bo Zhou , Feiping Nie

Modern neural network technologies, including large language models, have achieved remarkable success in various applied artificial intelligence applications, however, they face a range of fundamental limitations. Among them are…

Artificial Intelligence · Computer Science 2025-08-27 I. I. Priezzhev , D. A. Danko , A. V. Shubin

We present several quantum algorithms for performing nearest-neighbor learning. At the core of our algorithms are fast and coherent quantum methods for computing distance metrics such as the inner product and Euclidean distance. We prove…

Quantum Physics · Physics 2014-12-12 Nathan Wiebe , Ashish Kapoor , Krysta Svore

Embedding into hyperbolic space is emerging as an effective representation technique for datasets that exhibit hierarchical structure. This development motivates the need for algorithms that are able to effectively extract knowledge and…

Data Structures and Algorithms · Computer Science 2020-09-03 Xian Wu , Moses Charikar

Nearest neighbor classifier is arguably the most simple and popular nonparametric classifier available in the literature. However, due to the concentration of pairwise distances and the violation of the neighborhood structure, this…

Machine Learning · Statistics 2024-10-25 Annesha Ghosh , Deep Ghoshal , Bilol Banerjee , Anil K. Ghosh

Approximate nearest neighbor algorithms are used to speed up nearest neighbor search in a wide array of applications. However, current indexing methods feature several hyperparameters that need to be tuned to reach an acceptable…

Data Structures and Algorithms · Computer Science 2019-04-25 Elias Jääsaari , Ville Hyvönen , Teemu Roos

In pattern recognition or machine learning, it is a very fundamental task to find nearest neighbors of a given point. All the methods for the task work basically by comparing the given point to all the points in the data set. That is why…

Machine Learning · Computer Science 2019-12-10 Hayoung Um , Heeyoul Choi

Local learning of sparse image models has proven to be very effective to solve inverse problems in many computer vision applications. To learn such models, the data samples are often clustered using the K-means algorithm with the Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2016-04-20 Julio Cesar Ferreira , Elif Vural , Christine Guillemot

Let $P$ be a set of points in some metric space. The approximate furthest neighbor problem is, given a second point set $C,$ to find a point $p \in P$ that is a $(1+\epsilon)$ approximate furthest neighbor from $C.$ The dynamic version is…

Data Structures and Algorithms · Computer Science 2023-02-21 Jinxiang Gan , Mordecai Jay Golin

The k-nearest neighbors (k-NN) classification rule has proven extremely successful in countless many computer vision applications. For example, image categorization often relies on uniform voting among the nearest prototypes in the space of…

Computer Vision and Pattern Recognition · Computer Science 2010-01-11 Paolo Piro , Richard Nock , Frank Nielsen , Michel Barlaud

We consider the problem of embedding unweighted, directed k-nearest neighbor graphs in low-dimensional Euclidean space. The k-nearest neighbors of each vertex provides ordinal information on the distances between points, but not the…

Machine Learning · Statistics 2015-11-06 Mihai Cucuringu , Joseph Woodworth