English
Related papers

Related papers: Advanced kNN: A Mature Machine Learning Series

200 papers

We apply several machine learning algorithms to the problem of anomaly detection in operational data for large-scale, high-voltage electric power grids. We observe important differences in the performance of the algorithms. Neural networks…

Systems and Control · Electrical Eng. & Systems 2026-02-12 Marc Gillioz , Guillaume Dubuis , Étienne Voutaz , Philippe Jacquod

In this paper, we address the problem of unsupervised video anomaly detection (UVAD). The task aims to detect abnormal events in test video using unlabeled videos as training data. The presence of anomalies in the training data poses a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Jihun Yi , Sungroh Yoon

The k-nearest neighbors (k-NN) is a basic machine learning (ML) algorithm, and several quantum versions of it, employing different distance metrics, have been presented in the last few years. Although the Euclidean distance is one of the…

Emerging Technologies · Computer Science 2024-04-25 Enrico Zardini , Enrico Blanzieri , Davide Pastorello

This paper introduces the innovative Power Muirhead Mean K-Nearest Neighbors (PMM-KNN) algorithm, a novel data classification approach that combines the K-Nearest Neighbors method with the adaptive Power Muirhead Mean operator. The proposed…

Machine Learning · Computer Science 2024-05-28 Kourosh Shahnazari , Seyed Moein Ayyoubzadeh

In many signal processing applications, including communications, sonar, radar, and localization, a fundamental problem is the detection of a signal of interest in background noise, known as signal detection [1] [2]. A simple version of…

Signal Processing · Electrical Eng. & Systems 2025-12-16 Tom Anders , Hiten Prakash Kothari , R. Michael Buehrer

Deep neural network (DNN) models are wellknown to easily misclassify prediction results by using input images with small perturbations, called adversarial examples. In this paper, we propose a novel adversarial detector, which consists of a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Takayuki Osakabe , Maungmaung Aprilpyone , Sayaka Shiota , Hitoshi Kiya

Since Convolutional Neural Networks (CNNs) have become the leading learning paradigm in visual recognition, Naive Bayes Nearest Neighbour (NBNN)-based classifiers have lost momentum in the community. This is because (1) such algorithms…

Computer Vision and Pattern Recognition · Computer Science 2015-11-18 Ilja Kuzborskij , Fabio Maria Carlucci , Barbara Caputo

Nonparametric learning is a fundamental concept in machine learning that aims to capture complex patterns and relationships in data without making strong assumptions about the underlying data distribution. Owing to simplicity and…

Machine Learning · Computer Science 2024-02-06 Amartya Banerjee , Christopher J. Hazard , Jacob Beel , Cade Mack , Jack Xia , Michael Resnick , Will Goddin

We propose a method for certifying the fairness of the classification result of a widely used supervised learning algorithm, the k-nearest neighbors (KNN), under the assumption that the training data may have historical bias caused by…

Machine Learning · Computer Science 2023-07-19 Yannan Li , Jingbo Wang , Chao Wang

Trustworthiness in model predictions is crucial for safety-critical applications in the real world. However, deep neural networks often suffer from the issues of uncertainty estimation, such as miscalibration. In this study, we propose…

Computation and Language · Computer Science 2025-02-07 Wataru Hashimoto , Hidetaka Kamigaito , Taro Watanabe

The K-nearest neighbor (KNN) classifier is one of the simplest and most common classifiers, yet its performance competes with the most complex classifiers in the literature. The core of this classifier depends mainly on measuring the…

Nearest neighbor is a popular class of classification methods with many desirable properties. For a large data set which cannot be loaded into the memory of a single machine due to computation, communication, privacy, or ownership…

Machine Learning · Statistics 2019-11-01 Xingye Qiao , Jiexin Duan , Guang Cheng

This paper presents a novel quantum K-nearest neighbors (QKNN) algorithm, which offers improved performance over the classical k-NN technique by incorporating quantum computing (QC) techniques to enhance classification accuracy,…

Quantum Physics · Physics 2025-08-05 Asif Akhtab Ronggon , Md. Saifur Rahman

Deep Neural Networks (DNNs) have achieved excellent performance in various fields. However, DNNs' vulnerability to Adversarial Examples (AE) hinders their deployments to safety-critical applications. This paper presents a novel AE detection…

Machine Learning · Computer Science 2022-09-02 Zhiyuan He , Yijun Yang , Pin-Yu Chen , Qiang Xu , Tsung-Yi Ho

k Nearest Neighbor (kNN) method is a simple and popular statistical method for classification and regression. For both classification and regression problems, existing works have shown that, if the distribution of the feature vector has…

Statistics Theory · Mathematics 2019-10-24 Puning Zhao , Lifeng Lai

This paper proposes a soft range limited K nearest neighbours (SRL-KNN) localization fingerprinting algorithm. The conventional KNN determines the neighbours of a user by calculating and ranking the fingerprint distance measured at the…

Signal Processing · Electrical Eng. & Systems 2022-11-09 Minh Tu Hoang , Yizhou Zhu , Brosnan Yuen , Tyler Reese , Xiaodai Dong , Tao Lu , Robert Westendorp , Michael Xie

The K-Nearest Neighbors (KNN) algorithm is widely used for classification and regression; however, it suffers from limitations, including the equal treatment of all samples. We propose Information-Modified KNN (IM-KNN), a novel approach…

Machine Learning · Computer Science 2025-07-11 Mohammad Ali Vahedifar , Azim Akhtarshenas , Mohammad Mohammadi Rafatpanah , Maryam Sabbaghian

Machine learning has revolutionized many fields of science and technology. Through the $k$-Nearest Neighbors algorithm, we develop a model-independent classifier, where the algorithm can classify phases of a model to which it has never had…

Quantum Physics · Physics 2023-09-06 Felipe Mahlow , Fabrício S. Luiz , André L. Malvezzi , Felipe F. Fanchini

This paper presents a comprehensive evaluation of the potential of Quantum Convolutional Neural Networks (QCNNs) in comparison to classical Convolutional Neural Networks (CNNs) and Artificial / Classical Neural Network (ANN) models. With…

Quantum Physics · Physics 2023-07-25 Gowri Namratha Meedinti , Kandukuri Sai Srirekha , Radhakrishnan Delhibabu

In this work we introduce a quantum sorting algorithm with adaptable requirements of memory and circuit depth, and then use it to develop a new quantum version of the classical machine learning algorithm known as k-nearest neighbors (k-NN).…

Quantum Physics · Physics 2022-04-11 L. F. Quezada , Guo-Hua Sun , Shi-Hai Dong