English
Related papers

Related papers: k-Nearest Neighbour Classifiers: 2nd Edition (with…

200 papers

We examine the Bayes-consistency of a recently proposed 1-nearest-neighbor-based multiclass learning algorithm. This algorithm is derived from sample compression bounds and enjoys the statistical advantages of tight, fully empirical…

Machine Learning · Computer Science 2019-06-27 Aryeh Kontorovich , Sivan Sabato , Roi Weiss

Metric based comparison operations such as finding maximum, nearest and farthest neighbor are fundamental to studying various clustering techniques such as $k$-center clustering and agglomerative hierarchical clustering. These techniques…

Data Structures and Algorithms · Computer Science 2021-05-13 Raghavendra Addanki , Sainyam Galhotra , Barna Saha

A critical piece of the modern information retrieval puzzle is approximate nearest neighbor search. Its objective is to return a set of $k$ data points that are closest to a query point, with its accuracy measured by the proportion of exact…

Information Retrieval · Computer Science 2024-07-15 Thomas Vecchiato , Claudio Lucchese , Franco Maria Nardini , Sebastian Bruch

In this paper we present an extension of existing Nearest-Neighbor heuristics to an algorithm called k-Repetitive-Nearest-Neighbor. The idea is to start with a tour of k nodes and then perform a Nearest-Neighbor search from there on. After…

Artificial Intelligence · Computer Science 2018-10-19 Nikolas Klug , Alok Chauhan , Ramesh Ragala , V Vijayakumar

Nearest neighbor search is known as a challenging issue that has been studied for several decades. Recently, this issue becomes more and more imminent in viewing that the big data problem arises from various fields. In this paper, a…

Computer Vision and Pattern Recognition · Computer Science 2017-02-06 Wan-Lei Zhao , Jie Yang , Cheng-Hao Deng

Motivated by applications in computer vision and databases, we introduce and study the Simultaneous Nearest Neighbor Search (SNN) problem. Given a set of data points, the goal of SNN is to design a data structure that, given a collection of…

Data Structures and Algorithms · Computer Science 2016-04-11 Piotr Indyk , Robert Kleinberg , Sepideh Mahabadi , Yang Yuan

Recent works have proven the effectiveness of k-nearest-neighbor machine translation(a.k.a kNN-MT) approaches to produce remarkable improvement in cross-domain translations. However, these models suffer from heavy retrieve overhead on the…

Computation and Language · Computer Science 2025-01-07 Xiangyu Shi , Yunlong Liang , Jinan Xu , Yufeng Chen

Deep neural networks (DNNs) enable innovative applications of machine learning like image recognition, machine translation, or malware detection. However, deep learning is often criticized for its lack of robustness in adversarial settings…

Machine Learning · Computer Science 2018-03-14 Nicolas Papernot , Patrick McDaniel

With the growing integration of structured and unstructured data, new methods have emerged for performing similarity searches on vectors while honoring structured attribute constraints, i.e., a process known as Filtering Approximate Nearest…

Databases · Computer Science 2025-09-23 Mocheng Li , Xiao Yan , Baotong Lu , Yue Zhang , James Cheng , Chenhao Ma

k nearest neighbor join (kNN join), designed to find k nearest neighbors from a dataset S for every object in another dataset R, is a primitive operation widely adopted by many data mining applications. As a combination of the k nearest…

Databases · Computer Science 2015-03-20 Wei Lu , Yanyan Shen , Su Chen , Beng Chin Ooi

Given a training set $P$ of labeled points, the nearest-neighbor rule predicts the class of an unlabeled query point as the label of its closest point in the set. To improve the time and space complexity of classification, a natural…

Computational Geometry · Computer Science 2020-07-24 Alejandro Flores-Velazco , David M. Mount

Pre-trained models are widely used in fine-tuning downstream tasks with linear classifiers optimized by the cross-entropy loss, which might face robustness and stability problems. These problems can be improved by learning representations…

Computation and Language · Computer Science 2021-10-07 Linyang Li , Demin Song , Ruotian Ma , Xipeng Qiu , Xuanjing Huang

Nearest neighbor search is a fundamental data structure problem with many applications in machine learning, computer vision, recommendation systems and other fields. Although the main objective of the data structure is to quickly report…

Data Structures and Algorithms · Computer Science 2025-02-20 Piyush Anand , Piotr Indyk , Ravishankar Krishnaswamy , Sepideh Mahabadi , Vikas C. Raykar , Kirankumar Shiragur , Haike Xu

We introduce a new variant of the nearest neighbor search problem, which allows for some coordinates of the dataset to be arbitrarily corrupted or unknown. Formally, given a dataset of $n$ points $P=\{ x_1,\ldots, x_n\}$ in high-dimensions,…

Computational Geometry · Computer Science 2015-11-24 Sariel Har-Peled , Sepideh Mahabadi

In this study, we present a novel ranking model based on learning neighborhood relationships embedded in the index space. Given a query point, conventional approximate nearest neighbor search calculates the distances to the cluster…

Information Retrieval · Computer Science 2019-05-01 Chih-Yi Chiu , Amorntip Prayoonwong , Yin-Chih Liao

In one-class classification problems, only the data for the target class is available, whereas the data for the non-target class may be completely absent. In this paper, we study one-class nearest neighbour (OCNN) classifiers and their…

Machine Learning · Computer Science 2017-12-29 Shehroz S. Khan , Amir Ahmad

We focus in this paper on dataset reduction techniques for use in k-nearest neighbor classification. In such a context, feature and prototype selections have always been independently treated by the standard storage reduction algorithms.…

Machine Learning · Computer Science 2013-01-18 Marc Sebban , Richard Nock

We study the problem of computing the minimum adversarial perturbation of the Nearest Neighbor (NN) classifiers. Previous attempts either conduct attacks on continuous approximations of NN models or search for the perturbation by some…

Machine Learning · Computer Science 2019-06-11 Lu Wang , Xuanqing Liu , Jinfeng Yi , Zhi-Hua Zhou , Cho-Jui Hsieh

Nearest Neighbor Search (NNS) is a central task in knowledge representation, learning, and reasoning. There is vast literature on efficient algorithms for constructing data structures and performing exact and approximate NNS. This paper…

Machine Learning · Statistics 2021-03-10 Blake Mason , Ardhendu Tripathy , Robert Nowak

Let $k$ be a nonnegative integer. In the approximate $k$-flat nearest neighbor ($k$-ANN) problem, we are given a set $P \subset \mathbb{R}^d$ of $n$ points in $d$-dimensional space and a fixed approximation factor $c > 1$. Our goal is to…

Computational Geometry · Computer Science 2014-11-07 Wolfgang Mulzer , Huy L. Nguyen , Paul Seiferth , Yannik Stein