English
Related papers

Related papers: b-Bit Minwise Hashing in Practice: Large-Scale Bat…

200 papers

The Min-Hashing approach to sketching has become an important tool in data analysis, information retrial, and classification. To apply it to real-valued datasets, the ICWS algorithm has become a seminal approach that is widely used, and…

Machine Learning · Statistics 2018-10-24 Edward Raff , Jared Sylvester , Charles Nicholas

Weighted minwise hashing is a standard dimensionality reduction technique with applications to similarity search and large-scale kernel machines. We introduce a simple algorithm that takes a weighted set $x \in \mathbb{R}_{\geq 0}^{d}$ and…

Data Structures and Algorithms · Computer Science 2020-05-26 Tobias Christiani

Breadth-first Search (BFS) is one of the most important graph processing subroutines, especially for computing the unweighted distance. Many applications may require running BFS from multiple sources. Sequentially, when running BFS on a…

Data Structures and Algorithms · Computer Science 2024-10-29 Letong Wang , Guy Blelloch , Yan Gu , Yihan Sun

Recently, randomly mapping vectorial data to strings of discrete symbols (i.e., sketches) for fast and space-efficient similarity searches has become popular. Such random mapping is called similarity-preserving hashing and approximates a…

Machine Learning · Computer Science 2019-10-21 Shunsuke Kanda , Yasuo Tabei

Similarity search finds application in specialized database systems handling complex data such as images or videos, which are typically represented by high-dimensional features and require specific indexing structures. This paper tackles…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Jeff Johnson , Matthijs Douze , Hervé Jégou

Image similarity measures play an important role in nearest neighbor search and duplicate detection for large-scale image datasets. Recently, Minwise Hashing (or Minhash) and its related hashing algorithms have achieved great performances…

Multimedia · Computer Science 2018-07-11 Jun Long , Qunfeng Liu , Xinpan Yuan , Chengyuan Zhang , Junfeng Liu

Many real world problems require fast and efficient lexical comparison of large numbers of short text strings. Search personalization is one such domain. We introduce the use of feature bit vectors using the hashing trick for improving…

Information Retrieval · Computer Science 2019-10-22 Braddock Gaskill

We study explicit constructions of min-wise hash families and their extension to $k$-min-wise hash families. Informally, a min-wise hash family guarantees that for any fixed subset $X\subseteq[N]$, every element in $X$ has an equal chance…

Data Structures and Algorithms · Computer Science 2025-11-11 Xue Chen , Shengtang Huang , Xin Li

Graphics Processing Units (GPUs) were once used solely for graphical computation tasks but with the increase in the use of machine learning applications, the use of GPUs to perform general-purpose computing has increased in the last few…

Hardware Architecture · Computer Science 2021-02-16 Asim Ikram , Muhammad Awais Ali , Mirza Omer Beg

Advances in DNA sequencing technology have stimulated the development of algorithms and tools for processing very large collections of short strings (reads). Short-read alignment and assembly are among the most well-studied problems. Many…

Genomics · Quantitative Biology 2014-01-30 Chi-Man Liu , Ruibang Luo , Tak-Wah Lam

Traditional minwise hashing (MinHash) requires applying $K$ independent permutations to estimate the Jaccard similarity in massive binary (0/1) data, where $K$ can be (e.g.,) 1024 or even larger, depending on applications. The recent work…

Data Structures and Algorithms · Computer Science 2021-09-13 Xiaoyun Li , Ping Li

Minwise hashing has become a standard tool to calculate signatures which allow direct estimation of Jaccard similarities. While very efficient algorithms already exist for the unweighted case, the calculation of signatures for weighted sets…

Data Structures and Algorithms · Computer Science 2018-07-24 Otmar Ertl

Sorting and binary searching a dense array can be considered the simplest and most space efficient form of indexing. This holds especially on GPUs as they exhibit exceptional sorting performance. However, the popular opinion is that such a…

Databases · Computer Science 2026-02-24 Justus Henneberg , Felix Schuhknecht

In a recent paper from SODA11 \cite{kminwise} the authors introduced a general framework for exponential time improvement of \minwise based algorithms by defining and constructing almost \kmin independent family of hash functions. Here we…

Data Structures and Algorithms · Computer Science 2011-02-18 Guy Feigenblat , Ely Porat , Ariel Shiftan

GPUs are uniquely suited to accelerate (SQL) analytics workloads thanks to their massive compute parallelism and High Bandwidth Memory (HBM) -- when datasets fit in the GPU HBM, performance is unparalleled. Unfortunately, GPU HBMs remain…

Learning-based hashing methods are widely used for nearest neighbor retrieval, and recently, online hashing methods have demonstrated good performance-complexity trade-offs by learning hash functions from streaming data. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Fatih Cakir , Kun He , Sarah Adel Bargal , Stan Sclaroff

Often, machine learning applications have to cope with dynamic environments where data are collected in the form of continuous data streams with potentially infinite length and transient behavior. Compared to traditional (batch) data…

Machine Learning · Computer Science 2021-12-21 Guilherme Cassales , Heitor Gomes , Albert Bifet , Bernhard Pfahringer , Hermes Senger

Semantic hashing represents documents as compact binary vectors (hash codes) and allows both efficient and effective similarity search in large-scale information retrieval. The state of the art has primarily focused on learning hash codes…

Information Retrieval · Computer Science 2021-03-29 Christian Hansen , Casper Hansen , Jakob Grue Simonsen , Stephen Alstrup , Christina Lioma

Bit-level sparsity methods skip ineffectual zero-bit operations and are typically applicable within bit-serial deep learning accelerators. This type of sparsity at the bit-level is especially interesting because it is both orthogonal and…

Machine Learning · Computer Science 2024-09-10 Yuzong Chen , Jian Meng , Jae-sun Seo , Mohamed S. Abdelfattah

Hashing has been widely used for large-scale search due to its low storage cost and fast query speed. By using supervised information, supervised hashing can significantly outperform unsupervised hashing. Recently, discrete supervised…

Information Retrieval · Computer Science 2018-10-17 Qing-Yuan Jiang , Xue Cui , Wu-Jun Li