English
Related papers

Related papers: LSH methods for data deduplication in a Wikipedia …

200 papers

Although hash function learning algorithms have achieved great success in recent years, most existing hash models are off-line, which are not suitable for processing sequential or online data. To address this problem, this work proposes an…

Computer Vision and Pattern Recognition · Computer Science 2017-04-10 Long-Kai Huang , Qiang Yang , Wei-Shi Zheng

Data deduplication emerged as a powerful solution for reducing storage and bandwidth costs in cloud settings by eliminating redundancies at the level of chunks. This has spurred the development of numerous Content-Defined Chunking (CDC)…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-22 Marcel Gregoriadis , Leonhard Balduf , Björn Scheuermann , Johan Pouwelse

Locality Sensitive Hashing (LSH) is an effective method to index a set of points such that we can efficiently find the nearest neighbors of a query point. We extend this method to our novel Set-query LSH (SLSH), such that it can find the…

Data Structures and Algorithms · Computer Science 2020-04-23 Haim Kaplan , Jay Tenenbaum

Nearest-neighbor query processing is a fundamental operation for many image retrieval applications. Often, images are stored and represented by high-dimensional vectors that are generated by feature-extraction algorithms. Since tree-based…

Databases · Computer Science 2019-12-17 Omid Jafari , Khandker Mushfiqul Islam , Parth Nagarkar

Locality-sensitive hashing (LSH) is an important tool for managing high-dimensional noisy or uncertain data, for example in connection with data cleaning (similarity join) and noise-robust search (similarity search). However, for a number…

Data Structures and Algorithms · Computer Science 2018-04-18 Martin Aumüller , Tobias Christiani , Rasmus Pagh , Francesco Silvestri

NLP research has attained high performances in abusive language detection as a supervised classification task. While in research settings, training and test datasets are usually obtained from similar data samples, in practice systems are…

Computation and Language · Computer Science 2021-05-21 Isar Nejadgholi , Svetlana Kiritchenko

We propose a novel framework DropTop that suppresses the shortcut bias in online continual learning (OCL) while being adaptive to the varying degree of the shortcut bias incurred by continuously changing environment. By the observed…

Machine Learning · Computer Science 2023-12-15 Doyoung Kim , Dongmin Park , Yooju Shin , Jihwan Bang , Hwanjun Song , Jae-Gil Lee

As data volumes continue to grow, clustering and outlier detection algorithms are becoming increasingly time-consuming. Classical index structures for neighbor search are no longer sustainable due to the "curse of dimensionality". Instead,…

Databases · Computer Science 2021-05-12 Li Wang

Malicious sockpuppet detection on Wikipedia is critical to preserving access to reliable information on the internet and preventing the spread of disinformation. Prior machine learning approaches rely on stylistic and meta-data features,…

Machine Learning · Computer Science 2025-10-29 Luc Raszewski , Christine De Kock

In our study, we conducted a comprehensive analysis of three widely used datasets in the domain of building footprint extraction using deep neural networks: the INRIA Aerial Image Labelling dataset, SpaceNet 2: Building Detection v2, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Yeshwanth Kumar Adimoolam , Charalambos Poullis , Melinos Averkiou

In this work, we report on a novel application of Locality Sensitive Hashing (LSH) to seismic data at scale. Based on the high waveform similarity between reoccurring earthquakes, our application identifies potential earthquakes by…

Much research effort is being applied to the task of compressing the knowledge of self-supervised models, which are powerful, yet large and memory consuming. In this work, we show that the original method of knowledge distillation (and its…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-19 Danilo de Oliveira , Timo Gerkmann

Nearest neighbors search is a fundamental problem in various research fields like machine learning, data mining and pattern recognition. Recently, hashing-based approaches, e.g., Locality Sensitive Hashing (LSH), are proved to be effective…

Information Retrieval · Computer Science 2012-05-15 Yue Lin , Deng Cai , Cheng Li

Computing approximate nearest neighbors in high dimensional spaces is a central problem in large-scale data mining with a wide range of applications in machine learning and data science. A popular and effective technique in computing…

Machine Learning · Computer Science 2019-10-29 Lin Chen , Hossein Esfandiari , Thomas Fu , Vahab S. Mirrokni

Knowledge distillation (KD) has witnessed its powerful capability in learning compact models in object detection. Previous KD methods for object detection mostly focus on imitating deep features within the imitation regions instead of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Zhaohui Zheng , Rongguang Ye , Ping Wang , Dongwei Ren , Wangmeng Zuo , Qibin Hou , Ming-Ming Cheng

We present NearBucket-LSH, an effective algorithm for similarity search in large-scale distributed online social networks organized as peer-to-peer overlays. As communication is a dominant consideration in distributed systems, we focus on…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-24 Naama Kraus , David Carmel , Idit Keidar , Meni Orenbach

Distributed frameworks are gaining increasingly widespread use in applications that process large amounts of data. One important example application is large scale similarity search, for which Locality Sensitive Hashing (LSH) has emerged as…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-10-29 Bahman Bahmani , Ashish Goel , Rajendra Shinde

Recent years have seen more and more demand for a unified framework to address multiple realistic image retrieval tasks concerning both category and attributes. Considering the scale of modern datasets, hashing is favorable for its low…

Computer Vision and Pattern Recognition · Computer Science 2016-07-20 Haomiao Liu , Ruiping Wang , Shiguang Shan , Xilin Chen

Learned Sparse Retrieval (LSR) models use vocabularies from pre-trained transformers, which often split entities into nonsensical fragments. Splitting entities can reduce retrieval accuracy and limits the model's ability to incorporate…

Information Retrieval · Computer Science 2024-10-17 Thong Nguyen , Shubham Chatterjee , Sean MacAvaney , Iain Mackie , Jeff Dalton , Andrew Yates

Locality-sensitive hashing (LSH) is a well-known solution for approximate nearest neighbor (ANN) search in high-dimensional spaces due to its robust theoretical guarantee on query accuracy. Traditional LSH-based methods mainly focus on…

Databases · Computer Science 2026-02-11 Jiuqi Wei , Botao Peng , Xiaodong Lee , Themis Palpanas