English
Related papers

Related papers: Randomized partition trees for exact nearest neigh…

200 papers

In this article, we propose a new fast nearest neighbor search algorithm, based on vector quantization. Like many other branch and bound search algorithms [1,10], a preprocessing recursively partitions the data set into disjointed subsets…

Data Structures and Algorithms · Computer Science 2011-05-26 Sylvain Corlay

Dealing with datasets of very high dimension is a major challenge in machine learning. In this paper, we consider the problem of feature selection in applications where the memory is not large enough to contain all features. In this…

Machine Learning · Statistics 2017-09-07 Antonio Sutera , Célia Châtel , Gilles Louppe , Louis Wehenkel , Pierre Geurts

Nearest neighbor (NN) problem is an important scientific problem. The NN query, to find the closest one to a given query point among a set of points, is widely used in applications such as density estimation, pattern classification,…

Databases · Computer Science 2019-11-11 Yang Li , Gang Liu , Junbin Gao , Zhenwen He , Mingyuan Bai , Chengjun Li

Nearest neighbor search is a fundamental data structure problem with many applications in machine learning, computer vision, recommendation systems and other fields. Although the main objective of the data structure is to quickly report…

Data Structures and Algorithms · Computer Science 2025-02-20 Piyush Anand , Piotr Indyk , Ravishankar Krishnaswamy , Sepideh Mahabadi , Vikas C. Raykar , Kirankumar Shiragur , Haike Xu

For practical applications, any neighborhood concept imposed on a finite point set P is not of any use if it cannot be computed efficiently. Thus, in this paper, we give an introduction to the data structure of k-d trees, first presented by…

Data Structures and Algorithms · Computer Science 2019-03-13 Martin Skrodzki

Nearest neighbor searching of large databases in high-dimensional spaces is inherently difficult due to the curse of dimensionality. A flavor of approximation is, therefore, necessary to practically solve the problem of nearest neighbor…

Databases · Computer Science 2018-04-24 Akhil Arora , Sakshi Sinha , Piyush Kumar , Arnab Bhattacharya

Computing $k$-Nearest Neighbors (KNN) is one of the core kernels used in many machine learning, data mining and scientific computing applications. Although kd-tree based $O(\log n)$ algorithms have been proposed for computing KNN, due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Md. Mostofa Ali Patwary , Nadathur Rajagopalan Satish , Narayanan Sundaram , Jialin Liu , Peter Sadowski , Evan Racah , Suren Byna , Craig Tull , Wahid Bhimji , Prabhat , Pradeep Dubey

Nearest neighbor (kNN) methods have been gaining popularity in recent years in light of advances in hardware and efficiency of algorithms. There is a plethora of methods to choose from today, each with their own advantages and…

Machine Learning · Computer Science 2017-03-01 Daniel Zoran , Balaji Lakshminarayanan , Charles Blundell

We define and investigate the problem of $\textit{c-approximate window search}$: approximate nearest neighbor search where each point in the dataset has a numeric label, and the goal is to find nearest neighbors to queries within arbitrary…

Data Structures and Algorithms · Computer Science 2024-06-05 Joshua Engels , Benjamin Landrum , Shangdi Yu , Laxman Dhulipala , Julian Shun

The Random Projection Tree structures proposed in [Freund-Dasgupta STOC08] are space partitioning data structures that automatically adapt to various notions of intrinsic dimensionality of data. We prove new results for both the RPTreeMax…

Data Structures and Algorithms · Computer Science 2012-11-01 Aman Dhesi , Purushottam Kar

Let R^d -> A be a query problem over R^d for which there exists a data structure S that can compute P(q) in O(log n) time for any query point q in R^d. Let D be a probability measure over R^d representing a distribution of queries. We…

Computational Geometry · Computer Science 2010-02-08 Prosenjit Bose , Luc Devroye , Karim Douieb , Vida Dujmovic , James King , Pat Morin

Let $k$ be a nonnegative integer. In the approximate $k$-flat nearest neighbor ($k$-ANN) problem, we are given a set $P \subset \mathbb{R}^d$ of $n$ points in $d$-dimensional space and a fixed approximation factor $c > 1$. Our goal is to…

Computational Geometry · Computer Science 2014-11-07 Wolfgang Mulzer , Huy L. Nguyen , Paul Seiferth , Yannik Stein

Both supervised and unsupervised machine learning algorithms have been used to learn partition-based index structures for approximate nearest neighbor (ANN) search. Existing supervised algorithms formulate the learning task as finding a…

Machine Learning · Computer Science 2022-10-14 Ville Hyvönen , Elias Jääsaari , Teemu Roos

Location-based services rely heavily on efficient methods that search for relevant points-of-interest (POIs) near a given location. A k Nearest Neighbor (kNN) query is one such example that finds the k closest POIs from an agent's location.…

Databases · Computer Science 2026-02-02 Tenindra Abeywickrama , Muhammad Aamir Cheema , Sabine Storandt

We present a set of parallel algorithms for computing exact k-nearest neighbors in low dimensions. Many k-nearest neighbor algorithms use either a kd-tree or the Morton ordering of the point set; our algorithms combine these approaches…

Data Structures and Algorithms · Computer Science 2021-11-09 Magdalen Dobson , Guy Blelloch

A buffer k-d tree is a k-d tree variant for massively-parallel nearest neighbor search. While providing valuable speed-ups on modern many-core devices in case both a large number of reference and query points are given, buffer k-d trees are…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-10 Fabian Gieseke , Cosmin Eugen Oancea , Ashish Mahabal , Christian Igel , Tom Heskes

Nearest neighbor search has found numerous applications in machine learning, data mining and massive data processing systems. The past few years have witnessed the popularity of the graph-based nearest neighbor search paradigm because of…

Machine Learning · Computer Science 2020-12-22 Hongya Wang , Zhizheng Wang , Wei Wang , Yingyuan Xiao , Zeng Zhao , Kaixiang Yang

Label ranking aims to learn a mapping from instances to rankings over a finite number of predefined labels. Random forest is a powerful and one of the most successful general-purpose machine learning algorithms of modern times. In this…

Machine Learning · Computer Science 2018-06-19 Yangming Zhou , Guoping Qiu

We present several modifications to the previously proposed MSPP algorithm that can speed-up its execution considerably. The MSPP algorithm leverages a multiscale representation of the environment in $n$ dimensions. The information of the…

Data Structures and Algorithms · Computer Science 2016-02-16 Florian Hauer , Panagiotis Tsiotras

Approximate nearest neighbour (ANN) search is one of the most important problems in computer science fields such as data mining or computer vision. In this paper, we focus on ANN for high-dimensional binary vectors and we propose a simple…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Michal Komorowski , Tomasz Trzcinski