English
Related papers

Related papers: Comparison Based Nearest Neighbor Search

200 papers

We consider the problem of classification in a comparison-based setting: given a set of objects, we only have access to triplet comparisons of the form "object $x_i$ is closer to object $x_j$ than to object $x_k$." In this paper we…

Machine Learning · Statistics 2019-05-30 Michaël Perrot , Ulrike von Luxburg

Nearest neighbor (kNN) methods have been gaining popularity in recent years in light of advances in hardware and efficiency of algorithms. There is a plethora of methods to choose from today, each with their own advantages and…

Machine Learning · Computer Science 2017-03-01 Daniel Zoran , Balaji Lakshminarayanan , Charles Blundell

The k-d tree was one of the first spatial data structures proposed for nearest neighbor search. Its efficacy is diminished in high-dimensional spaces, but several variants, with randomization and overlapping cells, have proved to be…

Data Structures and Algorithms · Computer Science 2013-02-11 Sanjoy Dasgupta , Kaushik Sinha

Approximate nearest neighbor algorithms are used to speed up nearest neighbor search in a wide array of applications. However, current indexing methods feature several hyperparameters that need to be tuned to reach an acceptable…

Data Structures and Algorithms · Computer Science 2019-04-25 Elias Jääsaari , Ville Hyvönen , Teemu Roos

In this paper we show how the complexity of performing nearest neighbor (NNS) search on a metric space is related to the expansion of the metric space. Given a metric space we look at the graph obtained by connecting every pair of points…

Data Structures and Algorithms · Computer Science 2010-05-05 Rina Panigrahy , Kunal Talwar , Udi Wieder

The approximate nearest neighbor (ANN) search problem is fundamental to efficiently serving many real-world machine learning applications. A number of techniques have been developed for ANN search that are efficient, accurate, and scalable.…

Machine Learning · Computer Science 2023-02-23 Philip Sun , Ruiqi Guo , Sanjiv Kumar

We study very simple sorting algorithms based on a probabilistic comparator model. In our model, errors in comparing two elements are due to (1) the energy or effort put in the comparison and (2) the difference between the compared…

Data Structures and Algorithms · Computer Science 2018-05-16 Barbara Geissmann , Paolo Penna

Nearest neighbor search is a problem of finding the data points from the database such that the distances from them to the query point are the smallest. Learning to hash is one of the major solutions to this problem and has been widely…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Jingdong Wang , Ting Zhang , Jingkuan Song , Nicu Sebe , Heng Tao Shen

Big data mining is well known to be an important task for data science, because it can provide useful observations and new knowledge hidden in given large datasets. Proximity-based data analysis is particularly utilized in many real-life…

Databases · Computer Science 2022-11-29 Daichi Amagata , Yusuke Arai , Sumio Fujita , Takahiro Hara

Nearest neighbor search is a fundamental data structure problem with many applications in machine learning, computer vision, recommendation systems and other fields. Although the main objective of the data structure is to quickly report…

Data Structures and Algorithms · Computer Science 2025-02-20 Piyush Anand , Piotr Indyk , Ravishankar Krishnaswamy , Sepideh Mahabadi , Vikas C. Raykar , Kirankumar Shiragur , Haike Xu

We explore the fundamental problem of sorting through the lens of learning-augmented algorithms, where algorithms can leverage possibly erroneous predictions to improve their efficiency. We consider two different settings: In the first…

Data Structures and Algorithms · Computer Science 2023-11-03 Xingjian Bai , Christian Coester

Demands for minimum parameter setup in machine learning models are desirable to avoid time-consuming optimization processes. The $k$-Nearest Neighbors is one of the most effective and straightforward models employed in numerous problems.…

Machine Learning · Computer Science 2022-10-03 Danilo Samuel Jodas , Leandro Aparecido Passos , Ahsan Adeel , João Paulo Papa

One of the approaches for the nearest neighbor search problem is to build a network which nodes correspond to the given set of indexed objects. In this case the search of the closest object can be thought as a search of a node in a network.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-25 Alexander Ponomarenko , Irina Utkina , Mikhail Batsyn

In many situations, the choice of an adequate similarity measure or metric on the feature space dramatically determines the performance of machine learning methods. Building automatically such measures is the specific purpose of…

Machine Learning · Statistics 2020-02-24 Stéphan Clémençon , Robin Vogel

We demonstrate that a graph-based search algorithm-relying on the construction of an approximate neighborhood graph-can directly work with challenging non-metric and/or non-symmetric distances without resorting to metric-space mapping…

Information Retrieval · Computer Science 2019-10-09 Leonid Boytsov , Eric Nyberg

K-nearest neighbor (kNN) search has wide applications in many areas, including data mining, machine learning, statistics and many applied domains. Inspired by the success of ensemble methods and the flexibility of tree-based methodology, we…

Machine Learning · Statistics 2020-05-27 Donghui Yan , Yingjie Wang , Jin Wang , Honggang Wang , Zhenpeng Li

Retrieving the most similar objects in a large-scale database for a given query is a fundamental building block in many application domains, ranging from web searches, visual, cross media, and document retrievals. State-of-the-art…

Machine Learning · Computer Science 2018-03-15 Muge Li , Liangyue Li , Feiping Nie

We present an algorithm of clustering of many-dimensional objects, where only the distances between objects are used. Centers of classes are found with the aid of neuron-like procedure with lateral inhibition. The result of clustering does…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Leonid B. Litinskii , Dmitry E. Romanov

We propose an extension of tree-based space-partitioning indexing structures for data with low intrinsic dimensionality embedded in a high dimensional space. We call this extension an Angle Tree. Our extension can be applied to both…

Data Structures and Algorithms · Computer Science 2010-04-19 Ilia Zvedeniouk , Sanjay Chawla

Clustering is an important part of many modern data analysis pipelines, including network analysis and data retrieval. There are many different clustering algorithms developed by various communities, and it is often not clear which…

Machine Learning · Computer Science 2019-10-04 Maria-Florina Balcan , Travis Dick , Manuel Lang