English
Related papers

Related papers: Neural Locality Sensitive Hashing for Entity Block…

200 papers

Spectral clustering is a celebrated algorithm that partitions objects based on pairwise similarity information. While this approach has been successfully applied to a variety of domains, it comes with limitations. The reason is that there…

Statistics Theory · Mathematics 2018-05-24 Kwangjun Ahn , Kangwook Lee , Changho Suh

Hash coding has been widely used in the approximate nearest neighbor search for large-scale image retrieval. Recently, many deep hashing methods have been proposed and shown largely improved performance over traditional…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Zheng Zhang , Qin Zou , Yuewei Lin , Long Chen , Song Wang

Entity resolution, the task of identifying and merging records that refer to the same real-world entity, is crucial in sectors like e-commerce, healthcare, and law enforcement. Large Language Models (LLMs) introduce an innovative approach…

Computation and Language · Computer Science 2024-09-13 Huahang Li , Longyu Feng , Shuangyin Li , Fei Hao , Chen Jason Zhang , Yuanfeng Song

Fine-grained image hashing is a challenging problem due to the difficulties of discriminative region localization and hash code generation. Most existing deep hashing approaches solve the two tasks independently. While these two tasks are…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Haien Zeng , Hanjiang Lai , Jian Yin

Gene sequence search is a fundamental operation in computational genomics. Due to the petabyte scale of genome archives, most gene search systems now use hashing-based data structures such as Bloom Filters (BF). The state-of-the-art systems…

Information Retrieval · Computer Science 2024-06-24 Aditya Desai , Gaurav Gupta , Tianyi Zhang , Anshumali Shrivastava

Blocking is a critical step in entity resolution, and the emergence of neural network-based representation models has led to the development of dense blocking as a promising approach for exploring deep semantics in blocking. However,…

Databases · Computer Science 2024-04-26 Tianshu Wang , Hongyu Lin , Xianpei Han , Xiaoyang Chen , Boxi Cao , Le Sun

Supervised hashing methods are widely-used for nearest neighbor search in computer vision applications. Most state-of-the-art supervised hashing approaches employ batch-learners. Unfortunately, batch-learning strategies can be inefficient…

Computer Vision and Pattern Recognition · Computer Science 2015-11-11 Fatih Cakir , Sarah Adel Bargal , Stan Sclaroff

Hashing is at the heart of large-scale image similarity search, and recent methods have been substantially improved through deep learning techniques. Such algorithms typically learn continuous embeddings of the data. To avoid a subsequent…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Lucas R. Schwengber , Lucas Resende , Paulo Orenstein , Roberto I. Oliveira

Recently, locality sensitive hashing (LSH) was shown to be effective for MIPS and several algorithms including $L_2$-ALSH, Sign-ALSH and Simple-LSH have been proposed. In this paper, we introduce the norm-range partition technique, which…

Machine Learning · Computer Science 2018-11-06 Xiao Yan , Xinyan Dai , Jie Liu , Kaiwen Zhou , James Cheng

Hashing is widely applied to approximate nearest neighbor search for large-scale multimodal retrieval with storage and computation efficiency. Cross-modal hashing improves the quality of hash coding by exploiting semantic correlations…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Yue Cao , Mingsheng Long , Jianmin Wang , Philip S. Yu

Similarity joins are a fundamental database operation. Given data sets S and R, the goal of a similarity join is to find all points x in S and y in R with distance at most r. Recent research has investigated how locality-sensitive hashing…

Data Structures and Algorithms · Computer Science 2018-04-17 Samuel McCauley , Francesco Silvestri

Large language models (LLMs) exhibit a wide range of capabilities, including mathematical reasoning, code generation, and linguistic behaviors. We show that many capabilities are highly localized to small subsets of attention heads within…

Computation and Language · Computer Science 2026-03-05 Anna Bair , Yixuan Even Xu , Mingjie Sun , J. Zico Kolter

Entity Linking aims to link entity mentions in texts to knowledge bases, and neural models have achieved recent success in this task. However, most existing methods rely on local contexts to resolve entities independently, which may usually…

Computation and Language · Computer Science 2018-11-22 Yixin Cao , Lei Hou , Juanzi Li , Zhiyuan Liu

Large Neighborhood Search (LNS) is a popular heuristic algorithm for solving combinatorial optimization problems (COP). It starts with an initial solution to the problem and iteratively improves it by searching a large neighborhood around…

Artificial Intelligence · Computer Science 2023-06-02 Taoan Huang , Aaron Ferber , Yuandong Tian , Bistra Dilkina , Benoit Steiner

We present SLASH (Sketched LocAlity Sensitive Hashing), an MPI (Message Passing Interface) based distributed system for approximate similarity search over terabyte scale datasets. SLASH provides a multi-node implementation of the popular…

Databases · Computer Science 2020-08-19 Nicholas Meisburger , Anshumali Shrivastava

We present a framework for similarity search based on Locality-Sensitive Filtering (LSF), generalizing the Indyk-Motwani (STOC 1998) Locality-Sensitive Hashing (LSH) framework to support space-time tradeoffs. Given a family of filters,…

Data Structures and Algorithms · Computer Science 2016-11-23 Tobias Christiani

Supervised cross-modal hashing has gained increasing research interest on large-scale retrieval task owning to its satisfactory performance and efficiency. However, it still has some challenging issues to be further studied: 1) most of them…

Machine Learning · Computer Science 2019-05-07 Tao Yao , Xiangwei Kong , Lianshan Yan , Wenjing Tang , Qi Tian

We consider the problem of designing locality sensitive hashes (LSH) for inner product similarity, and of the power of asymmetric hashes in this context. Shrivastava and Li argue that there is no symmetric LSH for the problem and propose an…

Machine Learning · Statistics 2015-06-09 Behnam Neyshabur , Nathan Srebro

We present a novel framework for training large language models with continuously adjustable internal representations that span the full spectrum from localist (interpretable, rule-based) to distributed (generalizable, efficient) encodings.…

Artificial Intelligence · Computer Science 2025-11-04 Joachim Diederich

The existing work on densification of one permutation hashing reduces the query processing cost of the $(K,L)$-parameterized Locality Sensitive Hashing (LSH) algorithm with minwise hashing, from $O(dKL)$ to merely $O(d + KL)$, where $d$ is…

Methodology · Statistics 2014-06-19 Anshumali Shrivastava , Ping Li