中文
相关论文

相关论文: BagMinHash - Minwise Hashing Algorithm for Weighte…

200 篇论文

Traditional minwise hashing (MinHash) requires applying $K$ independent permutations to estimate the Jaccard similarity in massive binary (0/1) data, where $K$ can be (e.g.,) 1024 or even larger, depending on applications. The recent work…

数据结构与算法 · 计算机科学 2021-09-13 Xiaoyun Li , Ping Li

Minwise hashing (MinHash) is a classical method for efficiently estimating the Jaccrad similarity in massive binary (0/1) data. To generate $K$ hash values for each data vector, the standard theory of MinHash requires $K$ independent…

机器学习 · 统计学 2021-11-19 Xiaoyun Li , Ping Li

Semantic hashing represents documents as compact binary vectors (hash codes) and allows both efficient and effective similarity search in large-scale information retrieval. The state of the art has primarily focused on learning hash codes…

信息检索 · 计算机科学 2021-03-29 Christian Hansen , Casper Hansen , Jakob Grue Simonsen , Stephen Alstrup , Christina Lioma

In this paper, we first demonstrate that b-bit minwise hashing, whose estimators are positive definite kernels, can be naturally integrated with learning algorithms such as SVM and logistic regression. We adopt a simple scheme to transform…

机器学习 · 统计学 2011-06-07 Ping Li , Anshumali Shrivastava , Joshua Moore , Arnd Christian Konig

Semantic Hashing is a popular family of methods for efficient similarity search in large-scale datasets. In Semantic Hashing, documents are encoded as short binary vectors (i.e., hash codes), such that semantic similarity can be efficiently…

信息检索 · 计算机科学 2020-07-02 Casper Hansen , Christian Hansen , Jakob Grue Simonsen , Stephen Alstrup , Christina Lioma

We aim to speed up approximate keyword matching by storing a lightweight, fixed-size block of data for each string, called a fingerprint. These work in a similar way to hash values; however, they can be also used for matching with errors.…

数据结构与算法 · 计算机科学 2017-11-27 Aleksander Cisłak , Szymon Grabowski

In this paper, we study several critical issues which must be tackled before one can apply b-bit minwise hashing to the volumes of data often used industrial applications, especially in the context of search. 1. (b-bit) Minwise hashing…

信息检索 · 计算机科学 2012-05-15 Ping Li , Anshumali Shrivastava , Arnd Christian Konig

Weighted Hamming distance, as a similarity measure between binary codes and binary queries, provides superior accuracy in search tasks than Hamming distance. However, how to efficiently and accurately find $K$ binary codes that have the…

计算机视觉与模式识别 · 计算机科学 2021-08-11 Zhenyu Weng , Yuesheng Zhu , Ruixin Liu

Recently, the method of b-bit minwise hashing has been applied to large-scale linear learning and sublinear time near-neighbor search. The major drawback of minwise hashing is the expensive preprocessing cost, as the method requires…

机器学习 · 计算机科学 2012-08-08 Ping Li , Art Owen , Cun-Hui Zhang

Given a set $S$ of $n$ keys, a perfect hash function for $S$ maps the keys in $S$ to the first $m \geq n$ integers without collisions. It may return an arbitrary result for any key not in $S$ and is called minimal if $m = n$. The most…

数据结构与算法 · 计算机科学 2026-02-06 Hans-Peter Lehmann , Thomas Mueller , Rasmus Pagh , Giulio Ermanno Pibiri , Peter Sanders , Sebastiano Vigna , Stefan Walzer

In their seminal work, Broder \textit{et. al.}~\citep{BroderCFM98} introduces the $\mathrm{minHash}$ algorithm that computes a low-dimensional sketch of high-dimensional binary data that closely approximates pairwise Jaccard similarity.…

机器学习 · 计算机科学 2023-08-23 Rameshwar Pratap , Raghav Kulkarni

Semantic hashing has become a crucial component of fast similarity search in many large-scale information retrieval systems, in particular, for text data. Variational auto-encoders (VAEs) with binary latent variables as hashing codes…

机器学习 · 计算机科学 2020-05-22 Siamak Zamani Dadaneh , Shahin Boluki , Mingzhang Yin , Mingyuan Zhou , Xiaoning Qian

Due to the high storage and search efficiency, hashing has become prevalent for large-scale similarity search. Particularly, deep hashing methods have greatly improved the search performance under supervised scenarios. In contrast,…

计算机视觉与模式识别 · 计算机科学 2019-05-10 Erkun Yang , Tongliang Liu , Cheng Deng , Wei Liu , Dacheng Tao

Estimating set similarity and detecting highly similar sets are fundamental problems in areas such as databases, machine learning, and information retrieval. MinHash is a well-known technique for approximating Jaccard similarity of sets and…

数据结构与算法 · 计算机科学 2019-05-23 Pinghui Wang , Yiyan Qi , Yuanming Zhang , Qiaozhu Zhai , Chenxu Wang , John C. S. Lui , Xiaohong Guan

With the growth of image on the web, research on hashing which enables high-speed image retrieval has been actively studied. In recent years, various hashing methods based on deep neural networks have been proposed and achieved higher…

计算机视觉与模式识别 · 计算机科学 2019-05-23 Yosuke Kaga , Masakazu Fujio , Kenta Takahashi , Tetsushi Ohki , Masakatsu Nishigaki

Bit arrays, or bitmaps, are used to significantly speed up set operations in several areas, such as data warehousing, information retrieval, and data mining, to cite a few. However, bitmaps usually use a large storage space, thus requiring…

数据结构与算法 · 计算机科学 2015-03-14 Alessandro Colantonio , Roberto Di Pietro

HalftimeHash is a new algorithm for hashing long strings. The goals are few collisions (different inputs that produce identical output hash values) and high performance. Compared to the fastest universal hash functions on long strings…

数据结构与算法 · 计算机科学 2021-04-22 Jim Apple

We study the Min-Weighted Sum Bin Packing problem, a variant of the classical Bin Packing problem in which items have a weight, and each item induces a cost equal to its weight multiplied by the index of the bin in which it is packed. This…

数据结构与算法 · 计算机科学 2023-04-06 Guillaume Sagnol

This work focuses on representing very high-dimensional global image descriptors using very compact 64-1024 bit binary hashes for instance retrieval. We propose DeepHash: a hashing scheme based on deep networks. Key to making DeepHash work…

计算机视觉与模式识别 · 计算机科学 2016-02-17 Jie Lin , Olivier Morere , Vijay Chandrasekhar , Antoine Veillard , Hanlin Goh

Minimal perfect hash functions provide space-efficient and collision-free hashing on static sets. Existing algorithms and implementations that build such functions have practical limitations on the number of input elements they can process,…

数据结构与算法 · 计算机科学 2018-11-06 Antoine Limasset , Guillaume Rizk , Rayan Chikhi , Pierre Peterlongo