English
Related papers

Related papers: Adaptive $k$-nearest neighbor classifier based on …

200 papers

Nearest neighbor search is known as a challenging issue that has been studied for several decades. Recently, this issue becomes more and more imminent in viewing that the big data problem arises from various fields. In this paper, a…

Computer Vision and Pattern Recognition · Computer Science 2017-02-06 Wan-Lei Zhao , Jie Yang , Cheng-Hao Deng

Existing methods for retrieving k-nearest neighbours suffer from the curse of dimensionality. We argue this is caused in part by inherent deficiencies of space partitioning, which is the underlying strategy used by most existing methods. We…

Data Structures and Algorithms · Computer Science 2017-04-07 Ke Li , Jitendra Malik

Random feature approximation is arguably one of the most widely used techniques for kernel methods in large-scale learning algorithms. In this work, we analyze the generalization properties of random feature methods, extending previous…

Machine Learning · Statistics 2025-06-23 Mike Nguyen , Nicole Mücke

Learning from many real-world datasets is limited by a problem called the class imbalance problem. A dataset is imbalanced when one class (the majority class) has significantly more samples than the other class (the minority class). Such…

Machine Learning · Computer Science 2017-11-30 Soroush Saryazdi , Bahareh Nikpour , Hossein Nezamabadi-pour

This paper develops a new automatic and location-adaptive procedure for estimating regression in a Functional Single-Index Model (FSIM). This procedure is based on $k$-Nearest Neighbours ($k$NN) ideas. The asymptotic study includes results…

Statistics Theory · Mathematics 2024-01-29 Silvia Novo , Germán Aneiros , Philippe Vieu

The popularity of Artificial intelligence and machine learning have prompted researchers to use it in the recent researches. The proposed method uses K-Nearest Neighbor (KNN) algorithm for segmentation of medical images, extracting of image…

Image and Video Processing · Electrical Eng. & Systems 2023-03-17 Ayesha Heena , Nagashettappa Biradar , Najmuddin M. Maroof , Surbhi Bhatia , Rashmi Agarwal , Kanta Prasad

Many nonparametric regressors were recently shown to converge at rates that depend only on the intrinsic dimension of data. These regressors thus escape the curse of dimension when high-dimensional data has low intrinsic dimension (e.g. a…

Machine Learning · Statistics 2011-10-20 Samory Kpotufe

Recent works have theoretically and empirically shown that deep neural networks (DNNs) have an inherent vulnerability to small perturbations. Applying the Deep k-Nearest Neighbors (DkNN) classifier, we observe a dramatically increasing…

Machine Learning · Computer Science 2021-10-08 Ren Wang , Tianqi Chen , Alfred Hero

In machine learning, classifiers are used to predict a class of a given query based on an existing (classified) database. Given a database S of n d-dimensional points and a d-dimensional query q, the k-nearest neighbors (kNN) classifier…

Data Structures and Algorithms · Computer Science 2019-05-01 Hayim Shaul , Dan Feldman , Daniela Rus

We study the k nearest neighbors problem in the plane for general, convex, pairwise disjoint sites of constant description complexity such as line segments, disks, and quadrilaterals and with respect to a general family of distance…

Computational Geometry · Computer Science 2019-10-29 Chih-Hung Liu

Bearings are among the most failure-prone components in rotating machinery, and their condition directly impacts overall performance. Therefore, accurately diagnosing bearing faults is essential for ensuring system stability. However,…

Signal Processing · Electrical Eng. & Systems 2025-09-26 Amir Eshaghi Chaleshtori , Abdollah Aghaie

We are interested in the problem of finding $k$ nearest neighbours in the plane and in the presence of polygonal obstacles ($\textit{OkNN}$). Widely used algorithms for OkNN are based on incremental visibility graphs, which means they…

Artificial Intelligence · Computer Science 2018-08-14 Shizhe Zhao , Daniel D. Harabor , David Taniar

In the panoply of pattern classification techniques, few enjoy the intuitive appeal and simplicity of the nearest neighbor rule: given a set of samples in some metric domain space whose value under some function is known, we estimate the…

Machine Learning · Computer Science 2013-09-10 Shaun N. Joseph , Seif Omar Abu Bakr , Gabriel Lugo

Approximate nearest neighbor (ANN) search is a fundamental problem in many areas of data mining, machine learning and computer vision. The performance of traditional hierarchical structure (tree) based methods decreases as the…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Cong Fu , Deng Cai

The complexity of nearest-neighbor search dominates the asymptotic running time of many sampling-based motion-planning algorithms. However, collision detection is often considered to be the computational bottleneck in practice. Examining…

Robotics · Computer Science 2016-11-01 Michal Kleinbort , Oren Salzman , Dan Halperin

Neighborhood sampling is an important ingredient in the training of large-scale graph neural networks. It suppresses the exponential growth of the neighborhood size across network layers and maintains feasible memory consumption and time…

Machine Learning · Computer Science 2025-09-30 Zehao Niu , Mihai Anitescu , Jie Chen

k-Nearest Neighbors is one of the most fundamental but effective classification models. In this paper, we propose two families of models built on a sequence to sequence model and a memory network model to mimic the k-Nearest Neighbors…

Machine Learning · Computer Science 2019-11-28 Yiming Xu , Diego Klabjan

The fused lasso, also known as total-variation denoising, is a locally-adaptive function estimator over a regular grid of design points. In this paper, we extend the fused lasso to settings in which the points do not occur on a regular…

Methodology · Statistics 2019-07-09 Oscar Hernan Madrid Padilla , James Sharpnack , Yanzhen Chen , Daniela M. Witten

In crowded scenes, detection and localization of abnormal behaviors is challenging in that high-density people make object segmentation and tracking extremely difficult. We associate the optical flows of multiple frames to capture…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Xinfeng Zhang , Su Yang , Xinjian Zhang , Weishan Zhang , Jiulong Zhang

The nearest neighbor rule is a classic yet essential classification model, particularly in problems where the supervising information is given by pairwise dissimilarities and the embedding function are not easily obtained. Prototype…

Machine Learning · Computer Science 2018-01-09 Shin Ando