English
Related papers

Related papers: Maintaining $k$-MinHash Signatures over Fully-Dyna…

200 papers

When facing large-scale image datasets, online hashing serves as a promising solution for online retrieval and prediction tasks. It encodes the online streaming data into compact binary codes, and simultaneously updates the hash functions…

Information Retrieval · Computer Science 2019-04-24 Mingbao Lin , Rongrong Ji , Hong Liu , Xiaoshuai Sun , Yongjian Wu , Yunsheng Wu

The retrieval problem is the problem of associating data with keys in a set. Formally, the data structure must store a function f: U ->{0,1}^r that has specified values on the elements of a given set S, a subset of U, |S|=n, but may have…

Data Structures and Algorithms · Computer Science 2008-03-27 Martin Dietzfelbinger , Rasmus Pagh

The performance of a dynamic dictionary is measured mainly by its update time, lookup time, and space consumption. In terms of update time and lookup time there are known constructions that guarantee constant-time operations in the worst…

Data Structures and Algorithms · Computer Science 2015-03-13 Yuriy Arbitman , Moni Naor , Gil Segev

We study the dynamic connectivity problem for massive, dense graphs. Our goal is to build a system for dense graphs that simultaneously answers connectivity queries quickly, maintains a fast update throughput, and a uses a small amount of…

Data Structures and Algorithms · Computer Science 2025-09-19 Quinten De Man , Qamber Jafri , Daniel Delayo , Evan T. West , Michael A. Bender , David Tench

In rapid and massive data streams, it is often not possible to estimate the frequency of items with complete accuracy. To perform the operation in a reasonable amount of space and with sufficiently low latency, approximated methods are…

Databases · Computer Science 2019-04-18 Arijit Khan , Sixing Yan

In the dynamic metric $k$-median problem, we wish to maintain a set of $k$ centers $S \subseteq V$ in an input metric space $(V, d)$ that gets updated via point insertions/deletions, so as to minimize the objective $\sum_{x \in V} \min_{y…

Data Structures and Algorithms · Computer Science 2024-08-05 Sayan Bhattacharya , Martín Costa , Naveen Garg , Silvio Lattanzi , Nikos Parotsidis

This paper presents a general technique for optimally transforming any dynamic data structure that operates on atomic and indivisible keys by constant-time comparisons, into a data structure that handles unbounded-length keys whose…

Data Structures and Algorithms · Computer Science 2013-06-04 Amihood Amir , Gianni Franceschini , Roberto Grossi , Tsvi Kopelowitz , Moshe Lewenstein , Noa Lewenstein

Big data problems frequently require processing datasets in a streaming fashion, either because all data are available at once but collectively are larger than available memory or because the data intrinsically arrive one data point at a…

Computation · Statistics 2018-08-08 Andrea Giovannucci , Victor Minden , Cengiz Pehlevan , Dmitri B. Chklovskii

In submodular $k$-secretary problem, the goal is to select $k$ items in a randomly ordered input so as to maximize the expected value of a given monotone submodular function on the set of selected items. In this paper, we introduce a…

Data Structures and Algorithms · Computer Science 2018-09-18 Shipra Agrawal , Mohammad Shadravan , Cliff Stein

Traditional minwise hashing (MinHash) requires applying $K$ independent permutations to estimate the Jaccard similarity in massive binary (0/1) data, where $K$ can be (e.g.,) 1024 or even larger, depending on applications. The recent work…

Data Structures and Algorithms · Computer Science 2021-09-13 Xiaoyun Li , Ping Li

Approximate Nearest Neighbor (ANN) search and Approximate Kernel Density Estimation (A-KDE) are fundamental problems at the core of modern machine learning, with broad applications in data analysis, information systems, and large-scale…

Machine Learning · Computer Science 2025-10-28 Ved Danait , Srijan Das , Sujoy Bhore

We study how well one can recover sparse principal components of a data matrix using a sketch formed from a few of its elements. We show that for a wide class of optimization problems, if the sketch is close (in the spectral norm) to the…

Machine Learning · Computer Science 2015-03-16 Abhisek Kundu , Petros Drineas , Malik Magdon-Ismail

Minwise hashing has become a standard tool to calculate signatures which allow direct estimation of Jaccard similarities. While very efficient algorithms already exist for the unweighted case, the calculation of signatures for weighted sets…

Data Structures and Algorithms · Computer Science 2018-07-24 Otmar Ertl

We show that both clustering and subspace embeddings can be performed in the streaming model with the same asymptotic efficiency as in the central/offline setting. For $(k, z)$-clustering in the streaming model, we achieve a number of words…

Data Structures and Algorithms · Computer Science 2025-04-24 Vincent Cohen-Addad , Liudeng Wang , David P. Woodruff , Samson Zhou

Online string matching is a computational problem involving the search for patterns or substrings in a large text dataset, with the pattern and text being processed sequentially, without prior access to the entire text. Its relevance stems…

Data Structures and Algorithms · Computer Science 2023-10-25 Matthew N. Palmer , Simone Faro , Stefano Scafiti

Data sketches are approximate succinct summaries of long streams. They are widely used for processing massive amounts of data and answering statistical queries about it in real-time. Existing libraries producing sketches are very fast, but…

Data Structures and Algorithms · Computer Science 2019-12-06 Arik Rinberg , Alexander Spiegelman , Edward Bortnikov , Eshcar Hillel , Idit Keidar , Lee Rhodes , Hadar Serviansky

Efficient text indexing data structures have enabled large-scale genomic sequence analysis and are used to help solve problems ranging from assembly to read mapping. However, these data structures typically assume that the underlying…

Genomics · Quantitative Biology 2016-04-13 Nitish Gupta , Komal Sanjeev , Tim Wall , Carl Kingsford , Rob Patro

We propose a deep hashing framework for sketch retrieval that, for the first time, works on a multi-million scale human sketch dataset. Leveraging on this large dataset, we explore a few sketch-specific traits that were otherwise…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Peng Xu , Yongye Huang , Tongtong Yuan , Kaiyue Pang , Yi-Zhe Song , Tao Xiang , Timothy M. Hospedales , Zhanyu Ma , Jun Guo

Data similarity (or distance) computation is a fundamental research topic which underpins many high-level applications based on similarity measures in machine learning and data mining. However, in large-scale real-world scenarios, the exact…

Data Structures and Algorithms · Computer Science 2018-11-13 Wei Wu , Bin Li , Ling Chen , Junbin Gao , Chengqi Zhang

Sketching algorithms have recently proven to be a powerful approach both for designing low-space streaming algorithms as well as fast polynomial time approximation schemes (PTAS). In this work, we develop new techniques to extend the…

Data Structures and Algorithms · Computer Science 2023-10-31 Gregory Dexter , Petros Drineas , David P. Woodruff , Taisuke Yasuda