English
Related papers

Related papers: Local Distribution in Neighborhood for Classificat…

200 papers

The k Nearest Neighbors (kNN) method has received much attention in the past decades, where some theoretical bounds on its performance were identified and where practical optimizations were proposed for making it work fairly well in high…

Machine Learning · Computer Science 2016-06-14 Aleksander Lodwich , Faisal Shafait , Thomas Breuel

$k$ Nearest Neighbors ($k$NN) is one of the most widely used supervised learning algorithms to classify Gaussian distributed data, but it does not achieve good results when it is applied to nonlinear manifold distributed data, especially…

Machine Learning · Computer Science 2016-06-06 Enmei Tu , Yaqian Zhang , Lin Zhu , Jie Yang , Nikola Kasabov

The nearest neighbor rule is a classic yet essential classification model, particularly in problems where the supervising information is given by pairwise dissimilarities and the embedding function are not easily obtained. Prototype…

Machine Learning · Computer Science 2018-01-09 Shin Ando

K-nearest neighbors (KNN) is one of the earliest and most established algorithms in machine learning. For regression tasks, KNN averages the targets within a neighborhood which poses a number of challenges: the neighborhood definition is…

Machine Learning · Computer Science 2022-05-18 Youssef Nader , Leon Sixt , Tim Landgraf

Data-driven neighborhood definitions and graph constructions are often used in machine learning and signal processing applications. k-nearest neighbor~(kNN) and $\epsilon$-neighborhood methods are among the most common methods used for…

Machine Learning · Computer Science 2023-04-18 Sarath Shekkizhar , Antonio Ortega

Various kinds of k-nearest neighbor (KNN) based classification methods are the bases of many well-established and high-performance pattern-recognition techniques, but both of them are vulnerable to their parameter choice. Essentially, the…

Artificial Intelligence · Computer Science 2016-12-08 Ji Feng , Qingsheng Zhu , Jinlong Huang , Lijun Yang

Local search is a fundamental method in operations research and combinatorial optimisation. It has been widely applied to a variety of challenging problems, including multi-objective optimisation where multiple, often conflicting,…

Neural and Evolutionary Computing · Computer Science 2026-01-13 Zimin Liang , Miqing Li

kNN is a very effective Instance based learning method, and it is easy to implement. Due to heterogeneous nature of data, noises from different possible sources are also widespread in nature especially in case of large-scale databases. For…

Machine Learning · Computer Science 2020-05-19 Joydip Dhar , Ashaya Shukla , Mukul Kumar , Prashant Gupta

Estimating statistical models within sensor networks requires distributed algorithms, in which both data and computation are distributed across the nodes of the network. We propose a general approach for distributed learning based on…

Machine Learning · Computer Science 2012-07-03 Qiang Liu , Alexander Ihler

Most approaches that tackle the problem of node classification consider nodes to be similar, if they have shared neighbors or are close to each other in the graph. Recent methods for attributed graphs additionally take attributes of…

Machine Learning · Computer Science 2018-05-23 Evgeniy Faerman , Felix Borutta , Julian Busch , Matthias Schubert

The k-Nearest Neighbor (kNN) classification approach is conceptually simple - yet widely applied since it often performs well in practical applications. However, using a global constant k does not always provide an optimal solution, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Mark Kibanov , Martin Becker , Juergen Mueller , Martin Atzmueller , Andreas Hotho , Gerd Stumme

In the k-nearest neighbor algorithm (k-NN), the determination of classes for test instances is usually performed via a majority vote system, which may ignore the similarities among data. In this research, the researcher proposes an approach…

Machine Learning · Computer Science 2019-06-13 Jasper Kyle Catapang

Local search is a widely used technique for tackling challenging optimization problems, offering significant advantages in terms of computational efficiency and exhibiting strong empirical behavior across a wide range of problem domains. In…

Data Structures and Algorithms · Computer Science 2025-05-14 Lars Rohwedder , Ashkan Safari , Tjark Vredeveld

Developing increasingly efficient and accurate algorithms for approximate nearest neighbor search is a paramount goal in modern information retrieval. A primary approach to addressing this question is clustering, which involves partitioning…

Information Retrieval · Computer Science 2024-12-10 Thomas Vecchiato

In this paper we target the class of modal clustering methods where clusters are defined in terms of the local modes of the probability density function which generates the data. The most well-known modal clustering method is the k-means…

Machine Learning · Computer Science 2022-03-04 Gaël Beck , Tarn Duong , Mustapha Lebbah , Hanane Azzag , Christophe Cérin

We suggest a robust nearest-neighbor approach to classifying high-dimensional data. The method enhances sensitivity by employing a threshold and truncates to a sequence of zeros and ones in order to reduce the deleterious impact of…

Statistics Theory · Mathematics 2009-09-02 Yao-ban Chan , Peter Hall

We present Local Naive Bayes Nearest Neighbor, an improvement to the NBNN image classification algorithm that increases classification accuracy and improves its ability to scale to large numbers of object classes. The key observation is…

Computer Vision and Pattern Recognition · Computer Science 2011-12-02 Sancho McCann , David G. Lowe

Many modern methods for prediction leverage nearest neighbor search to find past training examples most similar to a test example, an idea that dates back in text to at least the 11th century and has stood the test of time. This monograph…

Machine Learning · Computer Science 2025-02-25 George H. Chen , Devavrat Shah

In the supervised learning domain, considering the recent prevalence of algorithms with high computational cost, the attention is steering towards simpler, lighter, and less computationally extensive training and inference approaches. In…

Machine Learning · Computer Science 2022-09-02 Antonello Rosato , Massimo Panella , Denis Kleyko

In machine learning, crowdsourcing is an economical way to label a large amount of data. However, the noise in the produced labels may deteriorate the accuracy of any classification method applied to the labelled data. We propose an…

Human-Computer Interaction · Computer Science 2022-03-03 Jiexin Duan , Xingye Qiao , Guang Cheng