English
Related papers

Related papers: Adaptive Nearest Neighbor: A General Framework for…

200 papers

We propose a new method for local distance metric learning based on sample similarity as side information. These local metrics, which utilize conical combinations of metric weight matrices, are learned from the pooled spatial…

Machine Learning · Computer Science 2019-02-25 YInjie Huang , Cong Li , Michael Georgiopoulos , Georgios C. Anagnostopoulos

Trustworthiness in model predictions is crucial for safety-critical applications in the real world. However, deep neural networks often suffer from the issues of uncertainty estimation, such as miscalibration. In this study, we propose…

Computation and Language · Computer Science 2025-02-07 Wataru Hashimoto , Hidetaka Kamigaito , Taro Watanabe

The K-Nearest Neighbors (KNN) algorithm is widely used for classification and regression; however, it suffers from limitations, including the equal treatment of all samples. We propose Information-Modified KNN (IM-KNN), a novel approach…

Machine Learning · Computer Science 2025-07-11 Mohammad Ali Vahedifar , Azim Akhtarshenas , Mohammad Mohammadi Rafatpanah , Maryam Sabbaghian

$k$ Nearest Neighbors ($k$NN) is one of the most widely used supervised learning algorithms to classify Gaussian distributed data, but it does not achieve good results when it is applied to nonlinear manifold distributed data, especially…

Machine Learning · Computer Science 2016-06-06 Enmei Tu , Yaqian Zhang , Lin Zhu , Jie Yang , Nikola Kasabov

Traditional deep learning models implicity encode knowledge limiting their transparency and ability to adapt to data changes. Yet, this adaptability is vital for addressing user data privacy concerns. We address this limitation by storing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Sebastian Doerrich , Tobias Archut , Francesco Di Salvo , Christian Ledig

The k-nearest neighbors (k-NN) classification rule has proven extremely successful in countless many computer vision applications. For example, image categorization often relies on uniform voting among the nearest prototypes in the space of…

Computer Vision and Pattern Recognition · Computer Science 2010-01-11 Paolo Piro , Richard Nock , Frank Nielsen , Michel Barlaud

Suppose $V$ is an $n$-element set where for each $x \in V$, the elements of $V \setminus \{x\}$ are ranked by their similarity to $x$. The $K$-nearest neighbor graph is a directed graph including an arc from each $x$ to the $K$ points of $V…

Combinatorics · Mathematics 2020-12-29 Jacob D. Baron , R. W. R. Darling

Deep neural networks have been shown to be vulnerable to adversarial examples---maliciously crafted examples that can trigger the target model to misbehave by adding imperceptible perturbations. Existing attack methods for k-nearest…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Xiaodan Li , Yuefeng Chen , Yuan He , Hui Xue

In this paper, we propose an ensemble learning algorithm called \textit{under-bagging $k$-nearest neighbors} (\textit{under-bagging $k$-NN}) for imbalanced classification problems. On the theoretical side, by developing a new learning…

Machine Learning · Statistics 2021-09-03 Hanyuan Hang , Yuchao Cai , Hanfang Yang , Zhouchen Lin

kNN based ensemble methods minimise the effect of outliers by identifying a set of data points in the given feature space that are nearest to an unseen observation in order to predict its response by using majority voting. The ordinary…

Machine Learning · Computer Science 2022-05-31 Amjad Ali , Muhammad Hamraz , Naz Gul , Dost Muhammad Khan , Zardad Khan , Saeed Aldahmani

Nearest-neighbor (NN) procedures are well studied and widely used in both supervised and unsupervised learning problems. In this paper we are concerned with investigating the performance of NN-based methods for anomaly detection. We first…

Machine Learning · Statistics 2019-07-10 Xiaoyi Gu , Leman Akoglu , Alessandro Rinaldo

High-dimensional approximate $K$ nearest neighbor search (AKNN) is a fundamental task for various applications, including information retrieval. Most existing algorithms for AKNN can be decomposed into two main components, i.e., candidate…

Databases · Computer Science 2024-12-03 Liwei Deng , Penghao Chen , Ximu Zeng , Tianfu Wang , Yan Zhao , Kai Zheng

Nearest Neighbors Algorithm is a Lazy Learning Algorithm, in which the algorithm tries to approximate the predictions with the help of similar existing vectors in the training dataset. The predictions made by the K-Nearest Neighbors…

Machine Learning · Computer Science 2018-11-14 Chandrasekaran Anirudh Bhardwaj , Megha Mishra , Kalyani Desikan

K-Nearest neighbor classifier (k-NNC) is simple to use and has little design time like finding k values in k-nearest neighbor classifier, hence these are suitable to work with dynamically varying data-sets. There exists some fundamental…

Computer Vision and Pattern Recognition · Computer Science 2013-01-29 T. Hitendra Sarma , P. Viswanath , D. Sai Koti Reddy , S. Sri Raghava

In machine learning, classifiers are used to predict a class of a given query based on an existing (classified) database. Given a database S of n d-dimensional points and a d-dimensional query q, the k-nearest neighbors (kNN) classifier…

Data Structures and Algorithms · Computer Science 2019-05-01 Hayim Shaul , Dan Feldman , Daniela Rus

Approximate K Nearest Neighbor (AKNN) search in high-dimensional spaces is a critical yet challenging problem. In AKNN search, distance computation is the core task that dominates the runtime. Existing approaches typically use approximate…

Databases · Computer Science 2025-01-20 Mingyu Yang , Wentao Li , Jiabao Jin , Xiaoyao Zhong , Xiangyu Wang , Zhitao Shen , Wei Jia , Wei Wang

This study combines two different learning paradigms, k-nearest neighbor (k-NN) rule, as memory-based learning paradigm and relevance vector machines (RVM), as statistical learning paradigm. This combination is performed in kernel space and…

Machine Learning · Computer Science 2021-03-09 Sara Hosseinzadeh Kassani , Farhood Rismanchian , Peyman Hosseinzadeh Kassani

Data-driven neighborhood definitions and graph constructions are often used in machine learning and signal processing applications. k-nearest neighbor~(kNN) and $\epsilon$-neighborhood methods are among the most common methods used for…

Machine Learning · Computer Science 2023-04-18 Sarath Shekkizhar , Antonio Ortega

K-nearest neighbor classification algorithm is one of the most basic algorithms in machine learning, which determines the sample's category by the similarity between samples. In this paper, we propose a quantum K-nearest neighbor…

Quantum Physics · Physics 2023-04-03 Jing Li , Song Lin , Yu Kai , Gongde Guo

Inspired by recent advances in retrieval augmented methods in NLP~\citep{khandelwal2019generalization,khandelwal2020nearest,meng2021gnn}, in this paper, we introduce a $k$ nearest neighbor NER ($k$NN-NER) framework, which augments the…

Computation and Language · Computer Science 2022-04-01 Shuhe Wang , Xiaoya Li , Yuxian Meng , Tianwei Zhang , Rongbin Ouyang , Jiwei Li , Guoyin Wang