English
Related papers

Related papers: Minimax Rate Optimal Adaptive Nearest Neighbor Cla…

200 papers

In this paper, we propose a novel and efficient parameter estimator based on $k$-Nearest Neighbor ($k$NN) and data generation method for the Lognormal-Rician turbulence channel. The Kolmogorov-Smirnov (KS) goodness-of-fit statistical tools…

Signal Processing · Electrical Eng. & Systems 2025-02-14 Maoke Miao , Xinyu Zhang , Bo Liu , Rui Yin , Jiantao Yuan , Feng Gao , Xiao-Yu Chen

We investigate the concept of Best Approximation for Feedforward Neural Networks (FNN) and explore their convergence properties through the lens of Random Projection (RPNNs). RPNNs have predetermined and fixed, once and for all, internal…

Machine Learning · Computer Science 2024-02-20 Gianluca Fabiani

We study the densest subgraph problem and its NP-hard densest at-most-$k$ subgraph variant through the lens of learning-augmented algorithms. We show that, given a reasonably accurate predictor that estimates whether a node belongs to the…

Data Structures and Algorithms · Computer Science 2026-04-16 Thai Bui , Luan Nguyen , Hoa T. Vu

The present paper deals with optimisation of Nearest Neighbour rule Classifiers via Genetic Algorithms. The methodology consists on implement a Genetic Algorithm capable of search the input feature space used by the NNR classifier. Results…

Artificial Intelligence · Computer Science 2007-05-23 Vitorino Ramos , Fernando Muge

K-nearest neighbor classification algorithm is one of the most basic algorithms in machine learning, which determines the sample's category by the similarity between samples. In this paper, we propose a quantum K-nearest neighbor…

Quantum Physics · Physics 2023-04-03 Jing Li , Song Lin , Yu Kai , Gongde Guo

Motivated by applications in computer vision and databases, we introduce and study the Simultaneous Nearest Neighbor Search (SNN) problem. Given a set of data points, the goal of SNN is to design a data structure that, given a collection of…

Data Structures and Algorithms · Computer Science 2016-04-11 Piotr Indyk , Robert Kleinberg , Sepideh Mahabadi , Yang Yuan

We study the consistency of the $k$-nearest neighbor regressor under complex survey designs. While consistency results for this algorithm are well established for independent and identically distributed data, corresponding results for…

Machine Learning · Statistics 2026-03-19 Caren Hasler

Nearest neighbor (NN) methods are employed for drawing inferences about spatial patterns of points from two or more classes. We consider Pielou's test of niche specificity which is defined using a contingency table based on the NN…

Methodology · Statistics 2014-05-16 Elvan Ceyhan

In adaptive data analysis, the user makes a sequence of queries on the data, where at each step the choice of query may depend on the results in previous steps. The releases are often randomized in order to reduce overfitting for such…

Machine Learning · Statistics 2016-02-16 Yu-Xiang Wang , Jing Lei , Stephen E. Fienberg

Speech recognition performance varies by language, domain, and speaker characteristics such as accent, but fine-tuning a model on any of these categories may lead to catastrophic forgetting. Token-level $k$ nearest neighbor search ($k$NN),…

Computation and Language · Computer Science 2025-02-12 Maya K. Nachesa , Vlad Niculae

Nearest neighbor (NN) sampling provides more semantic variations than pre-defined transformations for self-supervised learning (SSL) based image recognition problems. However, its performance is restricted by the quality of the support set,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Momojit Biswas , Himanshu Buckchash , Dilip K. Prasad

The amount of large-scale real data around us increase in size very quickly and so does the necessity to reduce its size by obtaining a representative sample. Such sample allows us to use a great variety of analytical methods, whose direct…

Social and Information Networks · Computer Science 2014-02-10 Milos Kudelka , Sarka Zehnalova , Jan Platos

Recommendation systems aim to provide personalized predictions by identifying items that are most appealing to individual users. Among various recommendation approaches, k-nearest-neighbor (kNN)-based collaborative filtering (CF) remains…

Information Retrieval · Computer Science 2025-12-16 Yongyu Wang

Approximate Nearest Neighbor Search (ANNS) is the task of finding the database vector that is closest to a given query vector. Graph-based ANNS is the family of methods with the best balance of accuracy and speed for million-scale datasets.…

Information Retrieval · Computer Science 2023-11-01 Naoki Ono , Yusuke Matsui

k nearest neighbor join (kNN join), designed to find k nearest neighbors from a dataset S for every object in another dataset R, is a primitive operation widely adopted by many data mining applications. As a combination of the k nearest…

Databases · Computer Science 2015-03-20 Wei Lu , Yanyan Shen , Su Chen , Beng Chin Ooi

Score function estimation is the cornerstone of both training and sampling from diffusion generative models. Despite this fact, the most commonly used estimators are either biased neural network approximations or high variance Monte Carlo…

Very few K-nearest-neighbor (KNN) ensembles exist, despite the efficacy of this approach in regression, classification, and outlier detection. Those that do exist focus on bagging features, rather than varying k or bagging observations; it…

Machine Learning · Statistics 2017-08-08 Colleen M. Farrelly

K Nearest Neighbor (KNN) joins are used in scientific domains for data analysis, and are building blocks of several well-known algorithms. KNN-joins find the KNN of all points in a dataset. This paper focuses on a hybrid CPU/GPU approach…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-19 Michael Gowanlock

Introduction. Case Based Reasoning (CBR) is an emerg- ing decision making paradigm in medical research where new cases are solved relying on previously solved similar cases. Usually, a database of solved cases is provided, and every case is…

Artificial Intelligence · Computer Science 2013-03-08 Boris Campillo-Gimenez , Wassim Jouini , Sahar Bayat , Marc Cuggia

This paper proposes an inexpensive way to learn an effective dissimilarity function to be used for $k$-nearest neighbor ($k$-NN) classification. Unlike Mahalanobis metric learning methods that map both query (unlabeled) objects and labeled…

Machine Learning · Computer Science 2020-08-31 Yutaro Shigeto , Masashi Shimbo , Yuji Matsumoto