English
Related papers

Related papers: On fast bounded locality sensitive hashing

200 papers

Locality Sensitive Hashing (LSH) is an effective method of indexing a set of items to support efficient nearest neighbors queries in high-dimensional spaces. The basic idea of LSH is that similar items should produce hash collisions with…

Data Structures and Algorithms · Computer Science 2021-02-22 Haim Kaplan , Jay Tenenbaum

We show that approximate similarity (near neighbour) search can be solved in high dimensions with performance matching state of the art (data independent) Locality Sensitive Hashing, but with a guarantee of no false negatives. Specifically,…

Data Structures and Algorithms · Computer Science 2018-06-28 Thomas Dybdahl Ahle

LSH (locality sensitive hashing) had emerged as a powerful technique in nearest-neighbor search in high dimensions [IM98, HIM12]. Given a point set $P$ in a metric space, and given parameters $r$ and $\varepsilon > 0$, the task is to…

Computational Geometry · Computer Science 2017-04-11 Sariel Har-Peled , Sepideh Mahabadi

An important question that arises in the study of high dimensional vector representations learned from data is: given a set $\mathcal{D}$ of vectors and a query $q$, estimate the number of points within a specified distance threshold of…

Data Structures and Algorithms · Computer Science 2018-09-21 Xian Wu , Moses Charikar , Vishnu Natchu

We propose a scalable divergence estimation method based on hashing. Consider two continuous random variables $X$ and $Y$ whose densities have bounded support. We consider a particular locality sensitive random hashing, and consider the…

Information Theory · Computer Science 2018-01-03 Morteza Noshad , Alfred O. Hero

Locality-sensitive hashing (LSH) is a fundamental technique for similarity search and similarity estimation in high-dimensional spaces. The basic idea is that similar objects should produce hash collisions with probability significantly…

Computational Geometry · Computer Science 2017-09-25 Joachim Gudmundsson , Rasmus Pagh

We propose to use the concept of the Hamming bound to derive the optimal criteria for learning hash codes with a deep network. In particular, when the number of binary hash codes (typically the number of image categories) and code length…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Xiang Xu , Xiaofang Wang , Kris M. Kitani

Let $\{X_{\alpha}\}$ be a family of random variables following a certain type of distributions with finite expectation $\mathbf{E}[X_{\alpha}]$ and finite variance ${\rm Var}(X_{\alpha})$, where $\alpha$ is a parameter. Motivated by the…

Probability · Mathematics 2024-04-04 Ze-Chun Hu , Renming Song , Yuan Tan

The problem of minimizing convex functionals of probability distributions is solved under the assumption that the density of every distribution is bounded from above and below. A system of sufficient and necessary first-order optimality…

Information Theory · Computer Science 2018-12-05 Michael Fauss , Abdelhak M. Zoubir

A sharp, distribution free, non-asymptotic result is proved for the concentration of a random function around the mean function, when the randomization is generated by a finite sequence of independent data and the random functions satisfy…

Probability · Mathematics 2023-12-25 Thomas Anton , Sutanuka Roy , Rabee Tourky

We show an optimal data-dependent hashing scheme for the approximate near neighbor problem. For an $n$-point data set in a $d$-dimensional space our data structure achieves query time $O(d n^{\rho+o(1)})$ and space $O(n^{1+\rho+o(1)} +…

Data Structures and Algorithms · Computer Science 2015-07-17 Alexandr Andoni , Ilya Razenshteyn

Hashing is a basic tool for dimensionality reduction employed in several aspects of machine learning. However, the perfomance analysis is often carried out under the abstract assumption that a truly random unit cost hash function is used,…

Machine Learning · Statistics 2017-11-27 Søren Dahlgaard , Mathias Bæk Tejs Knudsen , Mikkel Thorup

For a metric space $(X, d)$, a family $\mathcal{H}$ of locality sensitive hash functions is called $(r, cr, p_1, p_2)$ sensitive if a randomly chosen function $h\in \mathcal{H}$ has probability at least $p_1$ (at most $p_2$) to map any $a,…

Computational Geometry · Computer Science 2026-03-23 Chengyuan Deng , Jie Gao , Kevin Lu , Feng Luo , Cheng Xin

In this paper, we consider the problem of classification of $M$ high dimensional queries $y^1,\cdots,y^M\in B^S$ to $N$ high dimensional classes $x^1,\cdots,x^N\in A^S$ where $A$ and $B$ are discrete alphabets and the probabilistic model…

Machine Learning · Computer Science 2020-06-24 Arash Gholami Davoodi , Sean Chang , Hyun Gon Yoo , Anubhav Baweja , Mihir Mongia , Hosein Mohimani

Let $X$ be a Bernoulli random variable with the success probability $p$. We are interested in tight bounds on $\mathbb{E}[f(X_1,X_2)]$, where $X_i=\mathbb{E}[X| \mathcal{F}_i]$ and $\mathcal{F}_i$ are some sigma-algebras. This problem is…

Probability · Mathematics 2024-05-28 Egor Kravchenko

This work establishes computable bounds between f-divergences for probability measures within a generalized quasi-$\varepsilon_{(M,m)}$-neighborhood framework. We make the following key contributions. (1) a unified characterization of local…

Information Theory · Computer Science 2025-08-12 Xinchun Yu , Shuangqing Wei , Xiao-Ping Zhang

In large scale systems, approximate nearest neighbour search is a crucial algorithm to enable efficient data retrievals. Recently, deep learning-based hashing algorithms have been proposed as a promising paradigm to enable data dependent…

Machine Learning · Computer Science 2019-02-12 Jo Schlemper , Jose Caballero , Andy Aitken , Joost van Amersfoort

Motivated by the fact that circular or spherical data are often much concentrated around a location $\pmb\theta$, we consider inference about $\pmb\theta$ under "high concentration" asymptotic scenarios for which the probability of any…

Statistics Theory · Mathematics 2019-06-11 Davy Paindaveine , Thomas Verdebout

We show that a randomly chosen linear map over a finite field gives a good hash function in the $\ell_\infty$ sense. More concretely, consider a set $S \subset \mathbb{F}_q^n$ and a randomly chosen linear map $L : \mathbb{F}_q^n \to…

Combinatorics · Mathematics 2024-08-07 Manik Dhar , Zeev Dvir

With a graph $G=(V,E)$ we associate a collection of non-negative real weights $\cup_{v\in V}{\lambda_{i,v}:1\leq i \leq m} \cup \cup_{uv \in E} {\lambda_{ij,uv}:1\leq i \leq j \leq m}$. We consider the probability distribution on…

Combinatorics · Mathematics 2012-06-15 David Galvin