中文
相关论文

相关论文: I/O-Efficient Similarity Join

200 篇论文

Local moments are used for local regression, to compute statistical measures such as sums, averages, and standard deviations, and to approximate probability distributions. We consider the case where the data source is a very large I/O array…

数据结构与算法 · 计算机科学 2020-04-28 Daniel Lemire , Owen Kaser

Single Molecule Real-Time (SMRT) sequencing is a recent advancement of Next Gen technology developed by Pacific Bio (PacBio). It comes with an explosion of long and noisy reads demanding cutting edge research to get most out of it. To deal…

基因组学 · 定量生物学 2019-03-13 Angana Chakraborty , Sanghamitra Bandyopadhyay

The ability of fast similarity search at large scale is of great importance to many Information Retrieval (IR) applications. A promising way to accelerate similarity search is semantic hashing which designs compact binary codes for a large…

信息检索 · 计算机科学 2010-04-30 Dell Zhang , Jun Wang , Deng Cai , Jinsong Lu

We study the problem of similarity self-join and similarity join size estimation in a streaming setting where the goal is to estimate, in one scan of the input and with sublinear space in the input size, the number of record pairs that have…

数据库 · 计算机科学 2020-05-11 Davood Rafiei , Fan Deng

Clustering is an unsupervised learning technique in which data or objects are grouped into sets based on some similarity measure. Most of the clustering algorithms assume that the main memory is infinite and can accommodate the set of…

数据结构与算法 · 计算机科学 2015-05-25 Pankaj Kumar Yadav , Sriniwas Pandey , Sraban Kumar Mohanty

Database management systems (DBMSs) carefully optimize complex multi-join queries to avoid expensive disk I/O. As servers today feature tens or hundreds of gigabytes of RAM, a significant fraction of many analytic databases becomes…

数据库 · 计算机科学 2015-07-22 Feilong Liu , Spyros Blanas

As data volumes continue to grow, searches in data are becoming increasingly time-consuming. Classical index structures for neighbor search are no longer sustainable due to the "curse of dimensionality". Instead, approximated index…

机器学习 · 计算机科学 2021-11-17 Li Wang , Lilon Wangner

Can we sense our location in an unfamiliar environment by taking a sublinear-size sample of our surroundings? Can we efficiently encrypt a message that only someone physically close to us can decrypt? To solve this kind of problems, we…

数据结构与算法 · 计算机科学 2022-01-11 Elette Boyle , Itai Dinur , Niv Gilboa , Yuval Ishai , Nathan Keller , Ohad Klein

Locality-sensitive hashing (LSH), introduced by Indyk and Motwani in STOC '98, has been an extremely influential framework for nearest neighbor search in high-dimensional data sets. While theoretical work has focused on the approximate…

数据结构与算法 · 计算机科学 2018-12-07 Tobias Christiani , Rasmus Pagh , Mikkel Thorup

In collaborative outlier detection, multiple participants exchange their local detectors trained on decentralized devices without exchanging their own data. A key problem of collaborative outlier detection is efficiently aggregating…

机器学习 · 计算机科学 2022-01-19 Kitty Li , Ninh Pham

We initiate the study of multi-attribute group fairness in $k$-nearest neighbor ($k$-NN) search over vector databases. Unlike prior work that optimizes efficiency or query filtering, fairness imposes count constraints to ensure proportional…

数据库 · 计算机科学 2026-02-23 Thinh On , Senjuti Basu Roy , Baruch Schieber

This paper introduces "Multi-Level Spherical LSH": parameter-free, a multi-level, data-dependant Locality Sensitive Hashing data structure for solving the Approximate Near Neighbors Problem (ANN). This data structure uses a modified version…

数据结构与算法 · 计算机科学 2017-09-19 Teresa Nicole Brooks , Rania Almajalid

Simultaneous inference allows for the exploration of data while deciding on criteria for proclaiming discoveries. It was recently proved that all admissible post-hoc inference methods for true discoveries must employ closed testing. In this…

统计理论 · 数学 2022-03-24 Jinjin Tian , Xu Chen , Eugene Katsevich , Jelle Goeman , Aaditya Ramdas

Among many solutions to the high-dimensional approximate nearest neighbor (ANN) search problem, locality sensitive hashing (LSH) is known for its sub-linear query time and robust theoretical guarantee on query accuracy. Traditional LSH…

数据库 · 计算机科学 2022-07-21 Yao Tian , Xi Zhao , Xiaofang Zhou

Sorting and hashing are two completely different concepts in computer science, and appear mutually exclusive to one another. Hashing is a search method using the data as a key to map to the location within memory, and is used for rapid…

数据结构与算法 · 计算机科学 2007-05-23 William F. Gilreath

In this work, we show deep connections between Locality Sensitive Hashability and submodular analysis. We show that the LSHablility of the most commonly analyzed set similarities is in one-to-one correspondance with the supermodularity of…

离散数学 · 计算机科学 2018-07-19 Maxim Berman , Matthew B. Blaschko

Learning-based hashing methods are widely used for nearest neighbor retrieval, and recently, online hashing methods have demonstrated good performance-complexity trade-offs by learning hash functions from streaming data. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2017-08-01 Fatih Cakir , Kun He , Sarah Adel Bargal , Stan Sclaroff

Correlation clustering is perhaps the most natural formulation of clustering. Given $n$ objects and a pairwise similarity measure, the goal is to cluster the objects so that, to the best possible extent, similar objects are put in the same…

数据结构与算法 · 计算机科学 2013-12-19 Francesco Bonchi , David García-Soriano , Konstantin Kutzkov

Learning from set-structured data is an essential problem with many applications in machine learning and computer vision. This paper focuses on non-parametric and data-independent learning from set-structured data using approximate nearest…

机器学习 · 计算机科学 2022-02-10 Yuzhe Lu , Xinran Liu , Andrea Soltoggio , Soheil Kolouri

We study the problem of approximate near neighbor (ANN) search and show the following results: - An improved framework for solving the ANN problem using locality-sensitive hashing, reducing the number of evaluations of locality-sensitive…

数据结构与算法 · 计算机科学 2019-06-25 Tobias Christiani