中文
相关论文

相关论文: LSH methods for data deduplication in a Wikipedia …

200 篇论文

Although hash function learning algorithms have achieved great success in recent years, most existing hash models are off-line, which are not suitable for processing sequential or online data. To address this problem, this work proposes an…

计算机视觉与模式识别 · 计算机科学 2017-04-10 Long-Kai Huang , Qiang Yang , Wei-Shi Zheng

Data deduplication emerged as a powerful solution for reducing storage and bandwidth costs in cloud settings by eliminating redundancies at the level of chunks. This has spurred the development of numerous Content-Defined Chunking (CDC)…

分布式、并行与集群计算 · 计算机科学 2024-10-22 Marcel Gregoriadis , Leonhard Balduf , Björn Scheuermann , Johan Pouwelse

Locality Sensitive Hashing (LSH) is an effective method to index a set of points such that we can efficiently find the nearest neighbors of a query point. We extend this method to our novel Set-query LSH (SLSH), such that it can find the…

数据结构与算法 · 计算机科学 2020-04-23 Haim Kaplan , Jay Tenenbaum

Nearest-neighbor query processing is a fundamental operation for many image retrieval applications. Often, images are stored and represented by high-dimensional vectors that are generated by feature-extraction algorithms. Since tree-based…

数据库 · 计算机科学 2019-12-17 Omid Jafari , Khandker Mushfiqul Islam , Parth Nagarkar

Locality-sensitive hashing (LSH) is an important tool for managing high-dimensional noisy or uncertain data, for example in connection with data cleaning (similarity join) and noise-robust search (similarity search). However, for a number…

数据结构与算法 · 计算机科学 2018-04-18 Martin Aumüller , Tobias Christiani , Rasmus Pagh , Francesco Silvestri

NLP research has attained high performances in abusive language detection as a supervised classification task. While in research settings, training and test datasets are usually obtained from similar data samples, in practice systems are…

计算与语言 · 计算机科学 2021-05-21 Isar Nejadgholi , Svetlana Kiritchenko

We propose a novel framework DropTop that suppresses the shortcut bias in online continual learning (OCL) while being adaptive to the varying degree of the shortcut bias incurred by continuously changing environment. By the observed…

机器学习 · 计算机科学 2023-12-15 Doyoung Kim , Dongmin Park , Yooju Shin , Jihwan Bang , Hwanjun Song , Jae-Gil Lee

As data volumes continue to grow, clustering and outlier detection algorithms are becoming increasingly time-consuming. Classical index structures for neighbor search are no longer sustainable due to the "curse of dimensionality". Instead,…

数据库 · 计算机科学 2021-05-12 Li Wang

Malicious sockpuppet detection on Wikipedia is critical to preserving access to reliable information on the internet and preventing the spread of disinformation. Prior machine learning approaches rely on stylistic and meta-data features,…

机器学习 · 计算机科学 2025-10-29 Luc Raszewski , Christine De Kock

In our study, we conducted a comprehensive analysis of three widely used datasets in the domain of building footprint extraction using deep neural networks: the INRIA Aerial Image Labelling dataset, SpaceNet 2: Building Detection v2, and…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Yeshwanth Kumar Adimoolam , Charalambos Poullis , Melinos Averkiou

In this work, we report on a novel application of Locality Sensitive Hashing (LSH) to seismic data at scale. Based on the high waveform similarity between reoccurring earthquakes, our application identifies potential earthquakes by…

Much research effort is being applied to the task of compressing the knowledge of self-supervised models, which are powerful, yet large and memory consuming. In this work, we show that the original method of knowledge distillation (and its…

音频与语音处理 · 电气工程与系统科学 2023-09-19 Danilo de Oliveira , Timo Gerkmann

Nearest neighbors search is a fundamental problem in various research fields like machine learning, data mining and pattern recognition. Recently, hashing-based approaches, e.g., Locality Sensitive Hashing (LSH), are proved to be effective…

信息检索 · 计算机科学 2012-05-15 Yue Lin , Deng Cai , Cheng Li

Computing approximate nearest neighbors in high dimensional spaces is a central problem in large-scale data mining with a wide range of applications in machine learning and data science. A popular and effective technique in computing…

机器学习 · 计算机科学 2019-10-29 Lin Chen , Hossein Esfandiari , Thomas Fu , Vahab S. Mirrokni

Knowledge distillation (KD) has witnessed its powerful capability in learning compact models in object detection. Previous KD methods for object detection mostly focus on imitating deep features within the imitation regions instead of…

计算机视觉与模式识别 · 计算机科学 2022-04-01 Zhaohui Zheng , Rongguang Ye , Ping Wang , Dongwei Ren , Wangmeng Zuo , Qibin Hou , Ming-Ming Cheng

We present NearBucket-LSH, an effective algorithm for similarity search in large-scale distributed online social networks organized as peer-to-peer overlays. As communication is a dominant consideration in distributed systems, we focus on…

分布式、并行与集群计算 · 计算机科学 2015-11-24 Naama Kraus , David Carmel , Idit Keidar , Meni Orenbach

Distributed frameworks are gaining increasingly widespread use in applications that process large amounts of data. One important example application is large scale similarity search, for which Locality Sensitive Hashing (LSH) has emerged as…

分布式、并行与集群计算 · 计算机科学 2012-10-29 Bahman Bahmani , Ashish Goel , Rajendra Shinde

Recent years have seen more and more demand for a unified framework to address multiple realistic image retrieval tasks concerning both category and attributes. Considering the scale of modern datasets, hashing is favorable for its low…

计算机视觉与模式识别 · 计算机科学 2016-07-20 Haomiao Liu , Ruiping Wang , Shiguang Shan , Xilin Chen

Learned Sparse Retrieval (LSR) models use vocabularies from pre-trained transformers, which often split entities into nonsensical fragments. Splitting entities can reduce retrieval accuracy and limits the model's ability to incorporate…

信息检索 · 计算机科学 2024-10-17 Thong Nguyen , Shubham Chatterjee , Sean MacAvaney , Iain Mackie , Jeff Dalton , Andrew Yates

Locality-sensitive hashing (LSH) is a well-known solution for approximate nearest neighbor (ANN) search in high-dimensional spaces due to its robust theoretical guarantee on query accuracy. Traditional LSH-based methods mainly focus on…

数据库 · 计算机科学 2026-02-11 Jiuqi Wei , Botao Peng , Xiaodong Lee , Themis Palpanas