English
Related papers

Related papers: K-Nearest Neighbor Classification Using Anatomized…

200 papers

When training automated systems, it has been shown to be beneficial to adapt the representation of data by learning a problem-specific metric. This metric is global. We extend this idea and, for the widely used family of k nearest neighbors…

Machine Learning · Computer Science 2021-09-30 Jan Philip Göpfert , Heiko Wersing , Barbara Hammer

The $k$-nearest neighbour ($k$-NN) classifier is one of the oldest and most important supervised learning algorithms for classifying datasets. Traditionally the Euclidean norm is used as the distance for the $k$-NN classifier. In this…

Machine Learning · Statistics 2015-12-02 Stan Hatko

The $k$th-nearest neighbor rule is arguably the simplest and most intuitively appealing nonparametric classification procedure. However, application of this method is inhibited by lack of knowledge about its properties, in particular, about…

Statistics Theory · Mathematics 2008-10-30 Peter Hall , Byeong U. Park , Richard J. Samworth

In many scientific disciplines structures in high-dimensional data have to be found, e.g., in stellar spectra, in genome data, or in face recognition tasks. In this work we present a novel approach to non-linear dimensionality reduction. It…

Machine Learning · Statistics 2011-09-27 Oliver Kramer

Suppose $V$ is an $n$-element set where for each $x \in V$, the elements of $V \setminus \{x\}$ are ranked by their similarity to $x$. The $K$-nearest neighbor graph is a directed graph including an arc from each $x$ to the $K$ points of $V…

Combinatorics · Mathematics 2020-12-29 Jacob D. Baron , R. W. R. Darling

Big data mining is well known to be an important task for data science, because it can provide useful observations and new knowledge hidden in given large datasets. Proximity-based data analysis is particularly utilized in many real-life…

Databases · Computer Science 2022-11-29 Daichi Amagata , Yusuke Arai , Sumio Fujita , Takahiro Hara

The weighted k-nearest neighbors algorithm is one of the most fundamental non-parametric methods in pattern recognition and machine learning. The question of setting the optimal number of neighbors as well as the optimal weights has…

Machine Learning · Statistics 2017-01-26 Oren Anava , Kfir Y. Levy

Traditional deep learning models implicity encode knowledge limiting their transparency and ability to adapt to data changes. Yet, this adaptability is vital for addressing user data privacy concerns. We address this limitation by storing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Sebastian Doerrich , Tobias Archut , Francesco Di Salvo , Christian Ledig

Objective: The use of routinely-acquired medical data for research purposes requires the protection of patient confidentiality via data anonymisation. The objective of this work is to calculate the risk of re-identification arising from a…

Machine Learning · Computer Science 2022-04-01 Anna Antoniou , Giacomo Dossena , Julia MacMillan , Steven Hamblin , David Clifton , Paula Petrone

We design a data-dependent metric in $\mathbb R^d$ and use it to define the $k$-nearest neighbors of a given point. Our metric is invariant under all affine transformations. We show that, with this metric, the standard $k$-nearest neighbor…

Statistics Theory · Mathematics 2012-05-23 Gérard Biau , Luc Devroye , Vida Dujmovic , Adam Krzyzak

Privacy-preserving machine learning (ML) seeks to balance data utility and privacy, especially as regulations like the GDPR mandate the anonymization of personal data for ML applications. Conventional anonymization approaches often reduce…

Cryptography and Security · Computer Science 2025-07-08 Sri Harsha Gajavalli

Motivated by safety-critical applications, test-time attacks on classifiers via adversarial examples has recently received a great deal of attention. However, there is a general lack of understanding on why adversarial examples arise;…

Machine Learning · Statistics 2019-06-20 Yizhen Wang , Somesh Jha , Kamalika Chaudhuri

The popularity of Artificial intelligence and machine learning have prompted researchers to use it in the recent researches. The proposed method uses K-Nearest Neighbor (KNN) algorithm for segmentation of medical images, extracting of image…

Image and Video Processing · Electrical Eng. & Systems 2023-03-17 Ayesha Heena , Nagashettappa Biradar , Najmuddin M. Maroof , Surbhi Bhatia , Rashmi Agarwal , Kanta Prasad

The k-nearest-neighbor method performs classification tasks for a query sample based on the information contained in its neighborhood. Previous studies into the k-nearest-neighbor algorithm usually achieved the decision value for a class by…

Machine Learning · Computer Science 2018-12-10 Chengsheng Mao , Bin Hu , Lei Chen , Philip Moore , Xiaowei Zhang

Anonymization techniques based on obfuscating the quasi-identifiers by means of value generalization hierarchies are widely used to achieve preset levels of privacy. To prevent different types of attacks against database privacy it is…

Machine Learning · Computer Science 2023-05-15 Judith Sáinz-Pardo Díaz , Álvaro López García

In the era of deep learning, understanding over-fitting phenomenon becomes increasingly important. It is observed that carefully designed deep neural networks achieve small testing error even when the training error is close to zero. One…

Machine Learning · Statistics 2018-12-04 Yue Xing , Qifan Song , Guang Cheng

Avoiding the risk of undefined categorical labels using nearest neighbor interpolation overlooks the risk of exacerbating pixel level annotation errors in augmented training data. Additionally, the inherent low pass filtering effects of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Olivier Rukundo

Biased sampling and missing data complicates statistical problems ranging from causal inference to reinforcement learning. We often correct for biased sampling of summary statistics with matching methods and importance weighting. In this…

Statistics Theory · Mathematics 2022-06-02 James Sharpnack

k Nearest Neighbor (kNN) method is a simple and popular statistical method for classification and regression. For both classification and regression problems, existing works have shown that, if the distribution of the feature vector has…

Statistics Theory · Mathematics 2019-10-24 Puning Zhao , Lifeng Lai

Skeleton-based action recognition attracts practitioners and researchers due to the lightweight, compact nature of datasets. Compared with RGB-video-based action recognition, skeleton-based action recognition is a safer way to protect the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Saemi Moon , Myeonghyeon Kim , Zhenyue Qin , Yang Liu , Dongwoo Kim