English
Related papers

Related papers: Secure $k$-ish Nearest Neighbors Classifier

200 papers

The K-nearest neighbor (KNN) classifier is one of the simplest and most common classifiers, yet its performance competes with the most complex classifiers in the literature. The core of this classifier depends mainly on measuring the…

kNN based ensemble methods minimise the effect of outliers by identifying a set of data points in the given feature space that are nearest to an unseen observation in order to predict its response by using majority voting. The ordinary…

Machine Learning · Computer Science 2022-05-31 Amjad Ali , Muhammad Hamraz , Naz Gul , Dost Muhammad Khan , Zardad Khan , Saeed Aldahmani

K-nearest neighbor classification algorithm is one of the most basic algorithms in machine learning, which determines the sample's category by the similarity between samples. In this paper, we propose a quantum K-nearest neighbor…

Quantum Physics · Physics 2023-04-03 Jing Li , Song Lin , Yu Kai , Gongde Guo

We show that a simple modification of the 1-nearest neighbor classifier yields a strongly Bayes consistent learner. Prior to this work, the only strongly Bayes consistent proximity-based method was the k-nearest neighbor classifier, for k…

Machine Learning · Computer Science 2018-08-20 Aryeh Kontorovich , Roi Weiss

The $k$-nearest neighbour ($k$-NN) classifier is one of the oldest and most important supervised learning algorithms for classifying datasets. Traditionally the Euclidean norm is used as the distance for the $k$-NN classifier. In this…

Machine Learning · Statistics 2015-12-02 Stan Hatko

This paper presents a novel quantum K-nearest neighbors (QKNN) algorithm, which offers improved performance over the classical k-NN technique by incorporating quantum computing (QC) techniques to enhance classification accuracy,…

Quantum Physics · Physics 2025-08-05 Asif Akhtab Ronggon , Md. Saifur Rahman

The k-nearest-neighbor method performs classification tasks for a query sample based on the information contained in its neighborhood. Previous studies into the k-nearest-neighbor algorithm usually achieved the decision value for a class by…

Machine Learning · Computer Science 2018-12-10 Chengsheng Mao , Bin Hu , Lei Chen , Philip Moore , Xiaowei Zhang

The k Nearest Neighbors (kNN) method has received much attention in the past decades, where some theoretical bounds on its performance were identified and where practical optimizations were proposed for making it work fairly well in high…

Machine Learning · Computer Science 2016-06-14 Aleksander Lodwich , Faisal Shafait , Thomas Breuel

Despite a large amount of attention on adversarial examples, very few works have demonstrated an effective defense against this threat. We examine Deep k-Nearest Neighbor (DkNN), a proposed defense that combines k-Nearest Neighbor (kNN) and…

Cryptography and Security · Computer Science 2019-03-21 Chawin Sitawarin , David Wagner

k-nearest neighbour (kNN) is one of the most prominent, simple and basic algorithm used in machine learning and data mining. However, kNN has limited prediction ability, i.e., kNN cannot predict any instance correctly if it does not belong…

Machine Learning · Computer Science 2020-03-03 Muhammad Asim , Muaaz Zakria

This paper presents a new solution for choosing the K parameter in the k-nearest neighbor (KNN) algorithm, the solution depending on the idea of ensemble learning, in which a weak KNN classifier is used each time with a different K,…

Machine Learning · Computer Science 2014-09-04 Ahmad Basheer Hassanat , Mohammad Ali Abbadi , Ghada Awad Altarawneh , Ahmad Ali Alhasanat

High dimensionality, i.e. data having a large number of variables, tends to be a challenge for most machine learning tasks, including classification. A classifier usually builds a model representing how a set of inputs explain the outputs.…

Machine Learning · Computer Science 2018-03-12 Francisco J. Pulgar , Francisco Charte , Antonio J. Rivera , María J. del Jesus

Nearest neighbor is a popular class of classification methods with many desirable properties. For a large data set which cannot be loaded into the memory of a single machine due to computation, communication, privacy, or ownership…

Machine Learning · Statistics 2019-11-01 Xingye Qiao , Jiexin Duan , Guang Cheng

K-nearest neighbors (KNN) is one of the earliest and most established algorithms in machine learning. For regression tasks, KNN averages the targets within a neighborhood which poses a number of challenges: the neighborhood definition is…

Machine Learning · Computer Science 2022-05-18 Youssef Nader , Leon Sixt , Tim Landgraf

Data poisoning attacks and backdoor attacks aim to corrupt a machine learning classifier via modifying, adding, and/or removing some carefully selected training examples, such that the corrupted classifier makes incorrect predictions as the…

Cryptography and Security · Computer Science 2021-12-03 Jinyuan Jia , Yupei Liu , Xiaoyu Cao , Neil Zhenqiang Gong

The k-Nearest Neighbor (k-NN) classification algorithm is one of the most widely-used lazy classifiers because of its simplicity and ease of implementation. It is considered to be an effective classifier and has many applications. However,…

Machine Learning · Computer Science 2014-02-13 Stefanos Ougiaroglou , Georgios Evangelidis , Dimitris A. Dervos

Big data mining is well known to be an important task for data science, because it can provide useful observations and new knowledge hidden in given large datasets. Proximity-based data analysis is particularly utilized in many real-life…

Databases · Computer Science 2022-11-29 Daichi Amagata , Yusuke Arai , Sumio Fujita , Takahiro Hara

$k$-nearest neighbor classification is a popular non-parametric method because of desirable properties like automatic adaption to distributional scale changes. Unfortunately, it has thus far proved difficult to design active learning…

Machine Learning · Computer Science 2023-08-22 Nick Rittler , Kamalika Chaudhuri

We revisit the moving k nearest neighbor (MkNN) query, which computes one's k nearest neighbor set and maintains it while at move. Existing MkNN algorithms are mostly safe region based, which lack efficiency due to either computing small…

Databases · Computer Science 2021-01-13 Chuanwen Li , Yu Gu , Jianzhong Qi , Ge Yu , Rui Zhang , Qingxu Deng

We propose a method for certifying the fairness of the classification result of a widely used supervised learning algorithm, the k-nearest neighbors (KNN), under the assumption that the training data may have historical bias caused by…

Machine Learning · Computer Science 2023-07-19 Yannan Li , Jingbo Wang , Chao Wang