English
Related papers

Related papers: K-nearest Neighbor Search by Random Projection For…

200 papers

This paper presents a new ensemble learning method for classification problems called projection pursuit random forest (PPF). PPF uses the PPtree algorithm introduced in Lee et al. (2013). In PPF, trees are constructed by splitting on…

Machine Learning · Statistics 2021-05-24 Natalia da Silva , Dianne Cook , Eun-Kyung Lee

The problem of identifying the k-Nearest Neighbors (kNNS) of a point has proven to be very useful both as a standalone application and as a subroutine in larger applications. Given its far-reaching applicability in areas such as machine…

Machine Learning · Computer Science 2023-05-31 Vani Nagarajan , Durga Mandarapu , Milind Kulkarni

We present a novel method of stacking decision trees by projection into an ordered time split out-of-fold (OOF) one nearest neighbor (1NN) space. The predictions of these one nearest neighbors are combined through a linear model. This…

Machine Learning · Computer Science 2021-03-31 Michael Kim

Nearest neighbor search on high-dimensional vectors is fundamental in modern AI and database systems. In many real-world applications, queries involve constraints on multiple numeric attributes, giving rise to range-filtering approximate…

Databases · Computer Science 2026-02-18 Yuanhang Yu , Dawei Cheng , Ying Zhang , Lu Qin , Wenjie Zhang , Xuemin Lin

Feature correspondence selection is pivotal to many feature-matching based tasks in computer vision. Searching for spatially k-nearest neighbors is a common strategy for extracting local information in many previous works. However, there is…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Chen Zhao , Zhiguo Cao , Chi Li , Xin Li , Jiaqi Yang

Neighborhood finders and nearest neighbor queries are fundamental parts of sampling based motion planning algorithms. Using different distance metrics or otherwise changing the definition of a neighborhood produces different algorithms with…

Robotics · Computer Science 2025-06-17 Stav Ashur , Nancy M. Amato , Sariel Har-Peled

A random forest is a popular tool for estimating probabilities in machine learning classification tasks. However, the means by which this is accomplished is unprincipled: one simply counts the fraction of trees in a forest that vote for a…

Machine Learning · Statistics 2018-12-17 Matthew A. Olson , Abraham J. Wyner

The reverse k-nearest neighbor (RkNN) query is an established query type with various applications reaching from identifying highly influential objects over incrementally updating kNN graphs to optimizing sensor communication and outlier…

Databases · Computer Science 2020-11-04 Sandra Obermeier , Max Berrendorf , Peer Kröger

We start with a review of the pervasiveness of the nearest neighbor search problem and techniques used to solve it along with some experimental results. In the second chapter, we show reductions between two different classes of geo- metric…

Computational Geometry · Computer Science 2015-07-14 Mark Saroufim

KNN has the reputation to be the word simplest but efficient supervised learning algorithm used for either classification or regression. KNN prediction efficiency highly depends on the size of its training data but when this training data…

Machine Learning · Computer Science 2021-07-01 Jude Tchaye-Kondi , Yanlong Zhai , Liehuang Zhu

Graph convolutional networks (GCNs) were a great step towards extending deep learning to unstructured data such as graphs. But GCNs still need a constructed graph to work with. To solve this problem, classical graphs such as $k$-nearest…

Machine Learning · Computer Science 2023-10-24 Mashaan Alshammari , John Stavrakakis , Adel F. Ahmed , Masahiro Takatsuka

This study proposes an efficient exact k-flexible aggregate nearest neighbor (k-FANN) search algorithm in road networks using the M-tree. The state-of-the-art IER-kNN algorithm used the R-tree and pruned off unnecessary nodes based on the…

Databases · Computer Science 2021-09-14 Moonyoung Chung , Soon J. Hyun , Woong-Kee Loh

Given a collection of points in R^3, KD-Tree and R-Tree are well-known nearest neighbor search (NNS) algorithms that rely on space partitioning and spatial indexing techniques. However, when the query point is far from the data points or…

Computational Geometry · Computer Science 2025-07-30 Pengfei Wang , Jiantao Song , Shiqing Xin , Shuangmin Chen , Changhe Tu , Wenping Wang , Jiaye Wang

Top-k Nearest Neighbors (kNN) problem on road network has numerous applications on location-based services. As direct search using the Dijkstra's algorithm results in a large search space, a plethora of complex-index-based approaches have…

Databases · Computer Science 2024-08-13 Yiqi Wang , Long Yuan , Wenjie Zhang , Xuemin Lin , Zi Chen , Qing Liu

Random forests are a learning algorithm proposed by Breiman [Mach. Learn. 45 (2001) 5--32] that combines several randomized decision trees and aggregates their predictions by averaging. Despite its wide usage and outstanding practical…

Statistics Theory · Mathematics 2015-08-11 Erwan Scornet , Gérard Biau , Jean-Philippe Vert

Given a reference set $R$ of $n$ points and a query set $Q$ of $m$ points in a metric space, this paper studies an important problem of finding $k$-nearest neighbors of every point $q \in Q$ in the set $R$ in a near-linear time. In the…

Computational Geometry · Computer Science 2024-03-05 Yury Elkin , Vitaliy Kurlin

Approximate k-Nearest Neighbour (ANN) methods are often used for mining information and aiding machine learning on large scale high-dimensional datasets. ANN methods typically differ in the index structure used for accelerating searches,…

Machine Learning · Computer Science 2025-02-04 Ben Harwood , Amir Dezfouli , Iadine Chades , Conrad Sanderson

Nearest neighbor (NN) problem is an important scientific problem. The NN query, to find the closest one to a given query point among a set of points, is widely used in applications such as density estimation, pattern classification,…

Databases · Computer Science 2019-11-11 Yang Li , Gang Liu , Junbin Gao , Zhenwen He , Mingyuan Bai , Chengjun Li

Nearest-neighbor search dominates the asymptotic complexity of sampling-based motion planning algorithms and is often addressed with k-d tree data structures. While it is generally believed that the expected complexity of nearest-neighbor…

Computational Geometry · Computer Science 2017-09-25 Valerio Varricchio , Brian Paden , Dmitry Yershov , Emilio Frazzoli

Customizable contraction hierarchies are one of the most popular route planning frameworks in practice, due to their simplicity and versatility. In this work, we present a novel algorithm for finding k-nearest neighbors in customizable…

Data Structures and Algorithms · Computer Science 2021-03-19 Valentin Buchhold , Dorothea Wagner