English
Related papers

Related papers: Learning Space Partitions for Nearest Neighbor Sea…

200 papers

Label prediction in neural networks (NNs) has O(n) complexity proportional to the number of classes. This holds true for classification using fully connected layers and cosine similarity with some set of class prototypes. In this paper we…

Machine Learning · Computer Science 2026-04-07 Nikita Gabdullin , Ilya Androsov

Training of modern large neural networks (NN) requires a combination of parallelization strategies encompassing data, model, or optimizer sharding. When strategies increase in complexity, it becomes necessary for partitioning tools to be 1)…

We present an I/O-efficient algorithm for computing similarity joins based on locality-sensitive hashing (LSH). In contrast to the filtering methods commonly suggested our method has provable sub-quadratic dependency on the data size.…

Data Structures and Algorithms · Computer Science 2017-03-29 Rasmus Pagh , Ninh Pham , Francesco Silvestri , Morten Stöckel

Nearest Neighbor Search (NNS) over generalized weighted distances is fundamental to a wide range of applications. The problem of NNS over the generalized weighted square Euclidean distance has been studied in previous work. However,…

Databases · Computer Science 2021-10-19 Huan Hu , Jianzhong Li

For a given dataset $\mathcal{D}$ and structured label $f$, the goal of Filtered Approximate Nearest Neighbor Search (FANNS) algorithms is to find top-$k$ points closest to a query that satisfy label constraints, while ensuring both recall…

Databases · Computer Science 2025-09-10 Jiayang Shi , Yuzheng Cai , Weiguo Zheng

Approximate nearest neighbor (ANN) search in high dimensions is an integral part of several computer vision systems and gains importance in deep learning with explicit memory representations. Since PQT, FAISS, and SONG started to leverage…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Fabian Groh , Lukas Ruppert , Patrick Wieschollek , Hendrik P. A. Lensch

Nearest neighbor search has found numerous applications in machine learning, data mining and massive data processing systems. The past few years have witnessed the popularity of the graph-based nearest neighbor search paradigm because of…

Machine Learning · Computer Science 2020-12-22 Hongya Wang , Zhizheng Wang , Wei Wang , Yingyuan Xiao , Zeng Zhao , Kaixiang Yang

We present a GPU-based Locality Sensitive Hashing (LSH) algorithm to speed up beam search for sequence models. We utilize the winner-take-all (WTA) hash, which is based on relative ranking order of hidden dimensions and thus resilient to…

Computation and Language · Computer Science 2018-06-05 Xing Shi , Shizhen Xu , Kevin Knight

In this paper, a neural architecture search (NAS) framework is proposed for 3D medical image segmentation, to automatically optimize a neural architecture from a large design space. Our NAS framework searches the structure of each layer…

Machine Learning · Computer Science 2021-10-28 Sungwoong Kim , Ildoo Kim , Sungbin Lim , Woonhyuk Baek , Chiheon Kim , Hyungjoo Cho , Boogeon Yoon , Taesup Kim

We study the optimization version of the set partition problem (where the difference between the partition sums are minimized), which has numerous applications in decision theory literature. While the set partitioning problem is NP-hard and…

Data Structures and Algorithms · Computer Science 2021-09-13 Kaan Gokcesu , Hakan Gokcesu

A celebrated technique for finding near neighbors for the angular distance involves using a set of \textit{random} hyperplanes to partition the space into hash regions [Charikar, STOC 2002]. Experiments later showed that using a set of…

Data Structures and Algorithms · Computer Science 2017-12-08 Thijs Laarhoven

The simple approach of retrieving a closest match of a query image from one in the gallery, compares an image pair using sum of absolute difference in pixel or feature space. The process is computationally expensive, ill-posed to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-02 Saket Singh , Debdoot Sheet , Mithun Dasgupta

Deep Graph Neural Networks (GNNs) show promising performance on a range of graph tasks, yet at present are costly to run and lack many of the optimisations applied to DNNs. We show, for the first time, how to systematically quantise GNNs…

Machine Learning · Computer Science 2020-09-22 Yiren Zhao , Duo Wang , Daniel Bates , Robert Mullins , Mateja Jamnik , Pietro Lio

Locality-sensitive hashing (LSH) based frameworks have been used efficiently to select weight vectors in a dense hidden layer with high cosine similarity to an input, enabling dynamic pruning. While this type of scheme has been shown to…

Machine Learning · Computer Science 2023-06-06 Tahseen Rabbani , Marco Bornstein , Furong Huang

We give new data-dependent locality sensitive hashing schemes (LSH) for the Earth Mover's Distance ($\mathsf{EMD}$), and as a result, improve the best approximation for nearest neighbor search under $\mathsf{EMD}$ by a quadratic factor.…

Data Structures and Algorithms · Computer Science 2024-03-11 Rajesh Jayaram , Erik Waingarten , Tian Zhang

Training neural networks requires increasing amounts of memory. Parameter sharing can reduce memory and communication costs, but existing methods assume networks have many identical layers and utilize hand-crafted sharing strategies that…

Machine Learning · Computer Science 2022-03-17 Bryan A. Plummer , Nikoli Dryden , Julius Frost , Torsten Hoefler , Kate Saenko

We present a novel method for graph partitioning, based on reinforcement learning and graph convolutional neural networks. Our approach is to recursively partition coarser representations of a given graph. The neural network is implemented…

Machine Learning · Computer Science 2021-06-30 Alice Gatti , Zhixiong Hu , Tess Smidt , Esmond G. Ng , Pieter Ghysels

A Locality-Sensitive Hash (LSH) function is called $(r,cr,p_1,p_2)$-sensitive, if two data-points with a distance less than $r$ collide with probability at least $p_1$ while data points with a distance greater than $cr$ collide with…

Data Structures and Algorithms · Computer Science 2020-05-26 Thomas Dybdahl Ahle

A new variant of the classic capacitated facility location problem, which considers incompatibilities between customers, has recently been introduced in the literature. This problem captures the situation where given pairs of customers…

Artificial Intelligence · Computer Science 2026-05-28 Ida Gjergji , Lucas Kletzander , Nysret Musliu , Andrea Schaerf

The most commonly used method to tackle the graph partitioning problem in practice is the multilevel approach. During a coarsening phase, a multilevel graph partitioning algorithm reduces the graph size by iteratively contracting nodes and…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-03-26 Henning Meyerhenke , Peter Sanders , Christian Schulz