English
Related papers

Related papers: Classification using distance nearest neighbours

200 papers

Markov networks are widely studied and used throughout multivariate statistics and computer science. In particular, the problem of learning the structure of Markov networks from data without invoking chordality assumptions in order to…

Machine Learning · Statistics 2025-12-29 Juri Kuronen , Jukka Corander , Johan Pensar

For many data-intensive tasks, feature selection is an important preprocessing step. However, most existing methods do not directly and intuitively explore the intrinsic discriminative information of features. We propose a novel feature…

Machine Learning · Computer Science 2024-01-17 Chunxu Cao , Qiang Zhang

KNN has the reputation to be the word simplest but efficient supervised learning algorithm used for either classification or regression. KNN prediction efficiency highly depends on the size of its training data but when this training data…

Machine Learning · Computer Science 2021-07-01 Jude Tchaye-Kondi , Yanlong Zhai , Liehuang Zhu

In this article, we develop and investigate a new classifier based on features extracted using spatial depth. Our construction is based on fitting a generalized additive model to the posterior probabilities of the different competing…

Methodology · Statistics 2015-04-16 Subhajit Dutta , Anil K. Ghosh

Label ranking aims to learn a mapping from instances to rankings over a finite number of predefined labels. Random forest is a powerful and one of the most successful general-purpose machine learning algorithms of modern times. In this…

Machine Learning · Computer Science 2018-06-19 Yangming Zhou , Guoping Qiu

kNN is a very effective Instance based learning method, and it is easy to implement. Due to heterogeneous nature of data, noises from different possible sources are also widespread in nature especially in case of large-scale databases. For…

Machine Learning · Computer Science 2020-05-19 Joydip Dhar , Ashaya Shukla , Mukul Kumar , Prashant Gupta

Supervised deep-embedding methods project inputs of a domain to a representational space in which same-class instances lie near one another and different-class instances lie far apart. We propose a probabilistic method that treats…

Machine Learning · Statistics 2019-09-27 Tyler R. Scott , Karl Ridgeway , Michael C. Mozer

We propose a similarity-based method, using the similarity between nodes, to address the problem of classification in partially labeled networks. The basic assumption is that two nodes are more likely to be categorized into the same class…

Data Analysis, Statistics and Probability · Physics 2010-10-05 Qian-Ming Zhang , Ming-Sheng Shang , Linyuan Lu

Learning a robust classifier from a few samples remains a key challenge in machine learning. A major thrust of research has been focused on developing $k$-nearest neighbor ($k$-NN) based algorithms combined with metric learning that…

Machine Learning · Statistics 2022-02-17 Shixiang Zhu , Liyan Xie , Minghe Zhang , Rui Gao , Yao Xie

This paper draws a parallel between similarity-based categorisation models developed in cognitive psychology and the nearest neighbour classifier (1-NN) in machine learning. Conceived as a result of the historical rivalry between prototype…

Artificial Intelligence · Computer Science 2018-06-05 Julian Zubek , Ludmila Kuncheva

K-nearest neighbor classification algorithm is one of the most basic algorithms in machine learning, which determines the sample's category by the similarity between samples. In this paper, we propose a quantum K-nearest neighbor…

Quantum Physics · Physics 2023-04-03 Jing Li , Song Lin , Yu Kai , Gongde Guo

$k$-nearest neighbor classification is a popular non-parametric method because of desirable properties like automatic adaption to distributional scale changes. Unfortunately, it has thus far proved difficult to design active learning…

Machine Learning · Computer Science 2023-08-22 Nick Rittler , Kamalika Chaudhuri

The nearest neighbor rule is a classic yet essential classification model, particularly in problems where the supervising information is given by pairwise dissimilarities and the embedding function are not easily obtained. Prototype…

Machine Learning · Computer Science 2018-01-09 Shin Ando

The estimation of the generalization error of classifiers often relies on a validation set. Such a set is hardly available in few-shot learning scenarios, a highly disregarded shortcoming in the field. In these scenarios, it is common to…

Neural network classifiers have become the de-facto choice for current "pre-train then fine-tune" paradigms of visual classification. In this paper, we investigate k-Nearest-Neighbor (k-NN) classifiers, a classical model-free learning…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Menglin Jia , Bor-Chun Chen , Zuxuan Wu , Claire Cardie , Serge Belongie , Ser-Nam Lim

Perhaps the most straightforward classifier in the arsenal or machine learning techniques is the Nearest Neighbour Classifier -- classification is achieved by identifying the nearest neighbours to a query example and using those neighbours…

Machine Learning · Computer Science 2021-08-10 Padraig Cunningham , Sarah Jane Delany

Analyzing high-dimensional data with manifold learning algorithms often requires searching for the nearest neighbors of all observations. This presents a computational bottleneck in statistical manifold learning when observations of…

Machine Learning · Computer Science 2022-03-11 Fan Cheng , Anastasios Panagiotelis , Rob J Hyndman

Demands for minimum parameter setup in machine learning models are desirable to avoid time-consuming optimization processes. The $k$-Nearest Neighbors is one of the most effective and straightforward models employed in numerous problems.…

Machine Learning · Computer Science 2022-10-03 Danilo Samuel Jodas , Leandro Aparecido Passos , Ahsan Adeel , João Paulo Papa

We consider a problem of multiclass classification, where the training sample $S_n = \{(X_i, Y_i)\}_{i=1}^n$ is generated from the model $\mathbb P(Y = m | X = x) = \eta_m(x)$, $1 \leq m \leq M$, and $\eta_1(x), \dots, \eta_M(x)$ are…

Machine Learning · Statistics 2019-11-05 Nikita Puchkin , Vladimir Spokoiny

Both supervised and unsupervised machine learning algorithms have been used to learn partition-based index structures for approximate nearest neighbor (ANN) search. Existing supervised algorithms formulate the learning task as finding a…

Machine Learning · Computer Science 2022-10-14 Ville Hyvönen , Elias Jääsaari , Teemu Roos