English
Related papers

Related papers: Instance-based learning using the Half-Space Proxi…

200 papers

There is a large body of work on convergence rates either in passive or active learning. Here we outline some of the results that have been obtained, more specifically in a nonparametric setting under assumptions about the smoothness and…

Machine Learning · Statistics 2021-05-05 Boris Ndjia Njike , Xavier Siebert

Neural net classifiers trained on data with annotated class labels can also capture apparent visual similarity among categories without being directed to do so. We study whether this observation can be extended beyond the conventional…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Zhirong Wu , Yuanjun Xiong , Stella Yu , Dahua Lin

We show that a simple modification of the 1-nearest neighbor classifier yields a strongly Bayes consistent learner. Prior to this work, the only strongly Bayes consistent proximity-based method was the k-nearest neighbor classifier, for k…

Machine Learning · Computer Science 2018-08-20 Aryeh Kontorovich , Roi Weiss

Using prototype methods to reduce the size of training datasets can drastically reduce the computational cost of classification with instance-based learning algorithms like the k-Nearest Neighbour classifier. The number and distribution of…

Machine Learning · Computer Science 2021-04-13 Ilia Sucholutsky , Matthias Schonlau

This paper proposes a spatial k-nearest neighbor method for nonparametric prediction of real-valued spatial data and supervised classification for categorical spatial data. The proposed method is based on a double nearest neighbor rule…

Statistics Theory · Mathematics 2023-01-02 Mohamed-Salem Ahmed , Mamadou N'diaye , Mohammed Kadi Attouch , Sophie Dabo-Niang

In many scientific disciplines structures in high-dimensional data have to be found, e.g., in stellar spectra, in genome data, or in face recognition tasks. In this work we present a novel approach to non-linear dimensionality reduction. It…

Machine Learning · Statistics 2011-09-27 Oliver Kramer

One of the simplest and most effective classical machine learning algorithms is the $k$-nearest neighbors algorithm ($k$NN) which classifies an unknown test state by finding the $k$ nearest neighbors from a set of $M$ train states. Here we…

Quantum Physics · Physics 2021-06-18 Afrad Basheer , A. Afham , Sandeep K. Goyal

K-nearest neighbor classification algorithm is one of the most basic algorithms in machine learning, which determines the sample's category by the similarity between samples. In this paper, we propose a quantum K-nearest neighbor…

Quantum Physics · Physics 2023-04-03 Jing Li , Song Lin , Yu Kai , Gongde Guo

Analyzing high-dimensional data with manifold learning algorithms often requires searching for the nearest neighbors of all observations. This presents a computational bottleneck in statistical manifold learning when observations of…

Machine Learning · Computer Science 2022-03-11 Fan Cheng , Anastasios Panagiotelis , Rob J Hyndman

The k-nearest neighbors (k-NN) classification rule has proven extremely successful in countless many computer vision applications. For example, image categorization often relies on uniform voting among the nearest prototypes in the space of…

Computer Vision and Pattern Recognition · Computer Science 2010-01-11 Paolo Piro , Richard Nock , Frank Nielsen , Michel Barlaud

k-nearest neighbour (kNN) is one of the most prominent, simple and basic algorithm used in machine learning and data mining. However, kNN has limited prediction ability, i.e., kNN cannot predict any instance correctly if it does not belong…

Machine Learning · Computer Science 2020-03-03 Muhammad Asim , Muaaz Zakria

This work proposed a novel learning objective to train a deep neural network to perform end-to-end image pixel clustering. We applied the approach to instance segmentation, which is at the intersection of image semantic segmentation and…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Yen-Chang Hsu , Zheng Xu , Zsolt Kira , Jiawei Huang

Learning a robust classifier from a few samples remains a key challenge in machine learning. A major thrust of research has been focused on developing $k$-nearest neighbor ($k$-NN) based algorithms combined with metric learning that…

Machine Learning · Statistics 2022-02-17 Shixiang Zhu , Liyan Xie , Minghe Zhang , Rui Gao , Yao Xie

Natural language processing often involves computations with semantic or syntactic graphs to facilitate sophisticated reasoning based on structural relationships. While convolution kernels provide a powerful tool for comparing graph…

Computation and Language · Computer Science 2018-02-13 Sahil Garg , Greg Ver Steeg , Aram Galstyan

In the realm of machine learning, the KNN classification algorithm is widely recognized for its simplicity and efficiency. However, its sensitivity to the K value poses challenges, especially with small sample sizes or outliers, impacting…

Machine Learning · Computer Science 2024-05-29 Junzhuo Chen , Zhixin Lu , Shitong Kang

The nearest neighbor (NN) technique is very simple, highly efficient and effective in the field of pattern recognition, text categorization, object recognition etc. Its simplicity is its main advantage, but the disadvantages can't be…

Computer Vision and Pattern Recognition · Computer Science 2010-07-02 Nitin Bhatia , Vandana

Nearest neighbor search has found numerous applications in machine learning, data mining and massive data processing systems. The past few years have witnessed the popularity of the graph-based nearest neighbor search paradigm because of…

Machine Learning · Computer Science 2020-12-22 Hongya Wang , Zhizheng Wang , Wei Wang , Yingyuan Xiao , Zeng Zhao , Kaixiang Yang

K-nearest neighbors (KNN) is one of the earliest and most established algorithms in machine learning. For regression tasks, KNN averages the targets within a neighborhood which poses a number of challenges: the neighborhood definition is…

Machine Learning · Computer Science 2022-05-18 Youssef Nader , Leon Sixt , Tim Landgraf

In existing image classification systems that use deep neural networks, the knowledge needed for image classification is implicitly stored in model parameters. If users want to update this knowledge, then they need to fine-tune the model…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Kengo Nakata , Youyang Ng , Daisuke Miyashita , Asuka Maki , Yu-Chieh Lin , Jun Deguchi

Many machine learning algorithms are based on the assumption that training examples are drawn independently. However, this assumption does not hold anymore when learning from a networked sample where two or more training examples may share…

Machine Learning · Computer Science 2017-02-21 Yuyi Wang , Jan Ramon , Zheng-Chu Guo