English
Related papers

Related papers: A new hashing based nearest neighbors selection te…

200 papers

Fixed-radius near neighbor search is a fundamental data operation that retrieves all data points within a user-specified distance to a query point. There are efficient algorithms that can provide fast approximate query responses, but they…

Information Retrieval · Computer Science 2024-01-30 Xinye Chen , Stefan Güttel

Suppose $V$ is an $n$-element set where for each $x \in V$, the elements of $V \setminus \{x\}$ are ranked by their similarity to $x$. The $K$-nearest neighbor graph is a directed graph including an arc from each $x$ to the $K$ points of $V…

Combinatorics · Mathematics 2020-12-29 Jacob D. Baron , R. W. R. Darling

This study compares various superlearner and deep learning architectures (machine-learning-based and neural-network-based) for classification problems across several simulated and industrial datasets to assess performance and computational…

Machine Learning · Statistics 2017-08-23 Colleen M. Farrelly

The amount of large-scale real data around us increase in size very quickly and so does the necessity to reduce its size by obtaining a representative sample. Such sample allows us to use a great variety of analytical methods, whose direct…

Social and Information Networks · Computer Science 2014-02-10 Milos Kudelka , Sarka Zehnalova , Jan Platos

The K-nearest neighbor (KNN) classifier is one of the simplest and most common classifiers, yet its performance competes with the most complex classifiers in the literature. The core of this classifier depends mainly on measuring the…

Similarity search (nearest neighbor search) is a problem of pursuing the data items whose distances to a query item are the smallest from a large database. Various methods have been developed to address this problem, and recently a lot of…

Data Structures and Algorithms · Computer Science 2014-08-14 Jingdong Wang , Heng Tao Shen , Jingkuan Song , Jianqiu Ji

Research on nearest-neighbor methods tends to focus somewhat dichotomously either on the statistical or the computational aspects -- either on, say, Bayes consistency and rates of convergence or on techniques for speeding up the proximity…

Statistics Theory · Mathematics 2020-04-17 Klim Efremenko , Aryeh Kontorovich , Moshe Noivirt

Nearest Neighbor Search (NNS) has recently drawn a rapid increase of interest due to its core role in managing high-dimensional vector data in data science and AI applications. The interest is fueled by the success of neural embedding,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-01 Zhen Peng , Minjia Zhang , Kai Li , Ruoming Jin , Bin Ren

Approximate K-Nearest Neighbor Search (AKNNS) has now become ubiquitous in modern applications, for example, as a fast search procedure with two tower deep learning models. Graph-based methods for AKNNS in particular have received great…

Machine Learning · Computer Science 2022-06-24 Patrick H. Chen , Chang Wei-cheng , Yu Hsiang-fu , Inderjit S. Dhillon , Hsieh Cho-jui

We propose a new architecture for difficult image processing operations, such as natural edge detection or thin object segmentation. The architecture is based on a simple combination of convolutional neural networks with the nearest…

Computer Vision and Pattern Recognition · Computer Science 2014-07-04 Yaroslav Ganin , Victor Lempitsky

This paper presents a new solution for choosing the K parameter in the k-nearest neighbor (KNN) algorithm, the solution depending on the idea of ensemble learning, in which a weak KNN classifier is used each time with a different K,…

Machine Learning · Computer Science 2014-09-04 Ahmad Basheer Hassanat , Mohammad Ali Abbadi , Ghada Awad Altarawneh , Ahmad Ali Alhasanat

Nonparametric learning is a fundamental concept in machine learning that aims to capture complex patterns and relationships in data without making strong assumptions about the underlying data distribution. Owing to simplicity and…

Machine Learning · Computer Science 2024-02-06 Amartya Banerjee , Christopher J. Hazard , Jacob Beel , Cade Mack , Jack Xia , Michael Resnick , Will Goddin

K-Neares Neighbors (KNN) and its variant weighted KNN (WKNN) have been explored for years in both academy and industry to provide stable and reliable performance in WiFi-based indoor positioning systems. Such algorithms estimate the…

Signal Processing · Electrical Eng. & Systems 2023-02-03 Yinhuan Dong , Francisco Zampella , Firas Alsehly

Both supervised and unsupervised machine learning algorithms have been used to learn partition-based index structures for approximate nearest neighbor (ANN) search. Existing supervised algorithms formulate the learning task as finding a…

Machine Learning · Computer Science 2022-10-14 Ville Hyvönen , Elias Jääsaari , Teemu Roos

Graph-based approaches are empirically shown to be very successful for the nearest neighbor search (NNS). However, there has been very little research on their theoretical guarantees. We fill this gap and rigorously analyze the performance…

Data Structures and Algorithms · Computer Science 2020-08-21 Liudmila Prokhorenkova , Aleksandr Shekhovtsov

In data stream clustering, systematic theory of stream clustering algorithms remains relatively scarce. Recently, density-based methods have gained attention. However, existing algorithms struggle to simultaneously handle arbitrarily…

Machine Learning · Computer Science 2026-05-07 Qifen Zeng , Haomin Bao , Yuanzhuo Hu , Zirui Zhang , Yuheng Zheng , Luosheng Wen

We propose a nearest neighbor based clustering algorithm that results in a naturally defined hierarchy of clusters. In contrast to the agglomerative and divisive hierarchical clustering algorithms, our approach is not dependent on the…

Data Structures and Algorithms · Computer Science 2022-03-16 Kaan Gokcesu , Hakan Gokcesu

We study the problem of approximate near neighbor (ANN) search and show the following results: - An improved framework for solving the ANN problem using locality-sensitive hashing, reducing the number of evaluations of locality-sensitive…

Data Structures and Algorithms · Computer Science 2019-06-25 Tobias Christiani

Motivated by applications in computer vision and databases, we introduce and study the Simultaneous Nearest Neighbor Search (SNN) problem. Given a set of data points, the goal of SNN is to design a data structure that, given a collection of…

Data Structures and Algorithms · Computer Science 2016-04-11 Piotr Indyk , Robert Kleinberg , Sepideh Mahabadi , Yang Yuan

In this paper, we propose a method, based on graph signal processing, to optimize the choice of $k$ in $k$-nearest neighbor graphs ($k$NNGs). $k$NN is one of the most popular approaches and is widely used in machine learning and signal…

Machine Learning · Computer Science 2024-01-17 Asuka Tamaru , Junya Hara , Hiroshi Higashi , Yuichi Tanaka , Antonio Ortega