English
Related papers

Related papers: Guarantees on Nearest-Neighbor Condensation heuris…

200 papers

The nearest-neighbor rule is a well-known classification technique that, given a training set P of labeled points, classifies any unlabeled query point with the label of its closest point in P. The nearest-neighbor condensation problem aims…

Computational Geometry · Computer Science 2020-06-30 Alejandro Flores-Velazco

Nearest Neighbor Search (NNS) is a central task in knowledge representation, learning, and reasoning. There is vast literature on efficient algorithms for constructing data structures and performing exact and approximate NNS. This paper…

Machine Learning · Statistics 2021-03-10 Blake Mason , Ardhendu Tripathy , Robert Nowak

Given a training set $P$ of labeled points, the nearest-neighbor rule predicts the class of an unlabeled query point as the label of its closest point in the set. To improve the time and space complexity of classification, a natural…

Computational Geometry · Computer Science 2020-07-24 Alejandro Flores-Velazco , David M. Mount

Nearest neighbor is a popular class of classification methods with many desirable properties. For a large data set which cannot be loaded into the memory of a single machine due to computation, communication, privacy, or ownership…

Machine Learning · Statistics 2019-11-01 Xingye Qiao , Jiexin Duan , Guang Cheng

The problem of nearest neighbor condensing has enjoyed a long history of study, both in its theoretical and practical aspects. In this paper, we introduce the problem of weighted distance nearest neighbor condensing, where one assigns…

Machine Learning · Computer Science 2023-10-25 Lee-Ad Gottlieb , Timor Sharabi , Roi Weiss

We examine the Bayes-consistency of a recently proposed 1-nearest-neighbor-based multiclass learning algorithm. This algorithm is derived from sample compression bounds and enjoys the statistical advantages of tight, fully empirical…

Machine Learning · Computer Science 2019-06-27 Aryeh Kontorovich , Sivan Sabato , Roi Weiss

KNN has the reputation to be the word simplest but efficient supervised learning algorithm used for either classification or regression. KNN prediction efficiency highly depends on the size of its training data but when this training data…

Machine Learning · Computer Science 2021-07-01 Jude Tchaye-Kondi , Yanlong Zhai , Liehuang Zhu

Near neighbor search (NNS) is a powerful abstraction for data access; however, data indexing is troublesome even for approximate indexes. For intrinsically high-dimensional data, high-quality fast searches demand either indexes with…

Data Structures and Algorithms · Computer Science 2021-06-30 Eric S. Tellez , Guillermo Ruiz , Edgar Chavez , Mario Graff

We study the problem of computing the minimum adversarial perturbation of the Nearest Neighbor (NN) classifiers. Previous attempts either conduct attacks on continuous approximations of NN models or search for the perturbation by some…

Machine Learning · Computer Science 2019-06-11 Lu Wang , Xuanqing Liu , Jinfeng Yi , Zhi-Hua Zhou , Cho-Jui Hsieh

The nearest neighbor (NN) technique is very simple, highly efficient and effective in the field of pattern recognition, text categorization, object recognition etc. Its simplicity is its main advantage, but the disadvantages can't be…

Computer Vision and Pattern Recognition · Computer Science 2010-07-02 Nitin Bhatia , Vandana

The condensed nearest neighbor (CNN) algorithm is a heuristic for reducing the number of prototypical points stored by a nearest neighbor classifier, while keeping the classification rule given by the reduced prototypical set consistent…

Machine Learning · Computer Science 2013-10-01 Eric Christiansen

In scenarios involving text classification where the number of classes is large (in multiples of 10000s) and training samples for each class are few and often verbose, nearest neighbor methods are effective but very slow in computing a…

Information Retrieval · Computer Science 2017-12-12 Gautam Singh , Gargi Dasgupta , Yu Deng

When data is of an extraordinarily large size or physically stored in different locations, the distributed nearest neighbor (NN) classifier is an attractive tool for classification. We propose a novel distributed adaptive NN classifier for…

Machine Learning · Statistics 2023-06-06 Ruiqi Liu , Ganggang Xu , Zuofeng Shang

Graph-based approaches are empirically shown to be very successful for the nearest neighbor search (NNS). However, there has been very little research on their theoretical guarantees. We fill this gap and rigorously analyze the performance…

Data Structures and Algorithms · Computer Science 2020-08-21 Liudmila Prokhorenkova , Aleksandr Shekhovtsov

The Nearest subspace classifier (NSS) finds an estimation of the underlying subspace within each class and assigns data points to the class that corresponds to its nearest subspace. This paper mainly studies how well NSS can be generalized…

Machine Learning · Statistics 2015-01-27 Yi Wang

In Near-Neighbor Search (NNS), a new client queries a database (held by a server) for the most similar data (near-neighbors) given a certain similarity metric. The Privacy-Preserving variant (PP-NNS) requires that neither server nor the…

Cryptography and Security · Computer Science 2019-10-18 M. Sadegh Riazi , Beidi Chen , Anshumali Shrivastava , Dan Wallach , Farinaz Koushanfar

In this paper, we present an overview of Nearest neighbor (NN) methods, which are frequently employed for solving classification problems using supervised learning. The article concisely introduces the theoretical background, algorithmic,…

Networking and Internet Architecture · Computer Science 2021-07-19 Syed Ali Raza Zaidi

Nearest neighbor (NN) sampling provides more semantic variations than pre-defined transformations for self-supervised learning (SSL) based image recognition problems. However, its performance is restricted by the quality of the support set,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Momojit Biswas , Himanshu Buckchash , Dilip K. Prasad

We present the first sample compression algorithm for nearest neighbors with non-trivial performance guarantees. We complement these guarantees by demonstrating almost matching hardness lower bounds, which show that our bound is nearly…

Machine Learning · Computer Science 2018-03-28 Lee-Ad Gottlieb , Aryeh Kontorovich , Pinhas Nisnevitch

To denoise a reference patch, the Non-Local-Means denoising filter processes a set of neighbor patches. Few Nearest Neighbors (NN) are used to limit the computational burden of the algorithm. Here here we show analytically that the NN…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Iuri Frosio , Jan Kautz
‹ Prev 1 2 3 10 Next ›