English
Related papers

Related papers: Maintaining $k$-MinHash Signatures over Fully-Dyna…

200 papers

Data reduction in storage systems is becoming increasingly important as an effective solution to minimize the management cost of a data center. To maximize data-reduction efficiency, existing post-deduplication delta-compression techniques…

Machine Learning · Computer Science 2022-02-23 Jisung Park , Jeoggyun Kim , Yeseong Kim , Sungjin Lee , Onur Mutlu

Minimal perfect hashing is the problem of mapping a static set of $n$ distinct keys into the address space $\{1,\ldots,n\}$ bijectively. It is well-known that $n\log_2(e)$ bits are necessary to specify a minimal perfect hash function (MPHF)…

Data Structures and Algorithms · Computer Science 2023-04-13 Giulio Ermanno Pibiri , Yoshihiro Shibuya , Antoine Limasset

We consider the classic Euclidean $k$-median and $k$-means objective on data streams, where the goal is to provide a $(1+\varepsilon)$-approximation to the optimal $k$-median or $k$-means solution, while using as little memory as possible.…

Data Structures and Algorithms · Computer Science 2023-10-05 Vincent Cohen-Addad , David P. Woodruff , Samson Zhou

We present a novel approach for the problem of frequency estimation in data streams that is based on optimization and machine learning. Contrary to state-of-the-art streaming frequency estimation algorithms, which heavily rely on random…

Data Structures and Algorithms · Computer Science 2022-07-19 Dimitris Bertsimas , Vassilis Digalakis

We present FLASH (\textbf{F}ast \textbf{L}SH \textbf{A}lgorithm for \textbf{S}imilarity search accelerated with \textbf{H}PC), a similarity search system for ultra-high dimensional datasets on a single machine, that does not require…

Data Structures and Algorithms · Computer Science 2018-07-04 Yiqiu Wang , Anshumali Shrivastava , Jonathan Wang , Junghee Ryu

Consistent hashing (CH) is a central building block in many networking applications, from datacenter load-balancing to distributed storage. Unfortunately, state-of-the-art CH solutions cannot ensure full consistency under arbitrary changes…

Data Structures and Algorithms · Computer Science 2020-11-24 Gal Mendelson , Shay Vargaftik , Katherine Barabash , Dean Lorenz , Isaac Keslassy , Ariel Orda

Frequency estimation is one of the most fundamental problems in streaming algorithms. Given a stream $S$ of elements from some universe $U=\{1 \ldots n\}$, the goal is to compute, in a single pass, a short sketch of $S$ so that for any…

Data Structures and Algorithms · Computer Science 2021-11-09 Piotr Indyk , Shyam Narayanan , David P. Woodruff

Consistent hashing (CH) has been pivotal as a data router and load balancer in diverse fields, including distributed databases, cloud infrastructure, and peer-to-peer networks. However, existing CH algorithms often fall short in…

Data Structures and Algorithms · Computer Science 2023-11-21 Chao Dong , Fang Wang , Dan Feng

Data management systems have traditionally been designed to support either long-running analytics queries or short-lived transactions, but an increasing number of applications need both. For example, online games, socio-mobile apps, and…

Databases · Computer Science 2012-05-31 Benjamin Sowell , Wojciech Golab , Mehul A. Shah

Record linkage is an essential part of nearly all real-world systems that consume structured and unstructured data coming from different sources. Typically no common key is available for connecting records. Massive data cleaning and data…

Databases · Computer Science 2019-09-30 Thomas Gschwind , Christoph Miksovic , Julian Minder , Katsiaryna Mirylenka , Paolo Scotton

Hashing methods have been widely used for efficient similarity retrieval on large scale image database. Traditional hashing methods learn hash functions to generate binary codes from hand-crafted features, which achieve limited accuracy…

Computer Vision and Pattern Recognition · Computer Science 2017-11-08 Jian Zhang , Yuxin Peng

Maintaining a dynamic $k$-core decomposition is an important problem that identifies dense subgraphs in dynamically changing graphs. Recent work by Liu et al. [SPAA 2022] presents a parallel batch-dynamic algorithm for maintaining an…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-17 Quanquan C. Liu , Julian Shun , Igor Zablotchi

Graph streams represent data interactions in real applications. The mining of graph streams plays an important role in network security, social network analysis, and traffic control, among others. However, the sheer volume and high dynamics…

Databases · Computer Science 2023-04-07 Yiling Zeng , Chunyao Song , Yuhan Li , Tingjian Ge

We present jump consistent hash, a fast, minimal memory, consistent hash algorithm that can be expressed in about 5 lines of code. In comparison to the algorithm of Karger et al., jump consistent hash requires no storage, is faster, and…

Data Structures and Algorithms · Computer Science 2014-06-10 John Lamping , Eric Veach

In this paper, we address the problem of recovering arbitrary-shaped data clusters from datasets while facing \emph{high space constraints}, as this is for instance the case in many real-world applications when analysis algorithms are…

Machine Learning · Computer Science 2018-05-29 Anne Morvan , Krzysztof Choromanski , Cédric Gouy-Pailler , Jamal Atif

Modern text retrieval systems often provide a similarity search utility, that allows the user to find efficiently a fixed number k of documents in the data set that are most similar to a given query (here a query is either a simple sequence…

Information Retrieval · Computer Science 2007-06-01 Filippo Geraci , Marco Pellegrini

We consider the problem of maintaining a hierarchical agglomerative clustering (HAC) in the dynamic setting, when the input is subject to point insertions and deletions. We introduce DynHAC - the first dynamic HAC algorithm for the popular…

Data Structures and Algorithms · Computer Science 2025-01-15 Shangdi Yu , Laxman Dhulipala , Jakub Łącki , Nikos Parotsidis

We consider the Euclidean $k$-means clustering problem in a dynamic setting, where we have to explicitly maintain a solution (a set of $k$ centers) $S \subseteq \mathbb{R}^d$ subject to point insertions/deletions in $\mathbb{R}^d$. We…

Data Structures and Algorithms · Computer Science 2026-04-03 Sayan Bhattacharya , Martín Costa , Ermiya Farokhnejad , Shaofeng H. -C. Jiang , Yaonan Jin , Jianing Lou

We study the classic NP-Hard problem of finding the maximum $k$-set coverage in the data stream model: given a set system of $m$ sets that are subsets of a universe $\{1,\ldots,n \}$, find the $k$ sets that cover the most number of distinct…

Data Structures and Algorithms · Computer Science 2018-05-11 Andrew McGregor , Hoa T. Vu

An immediate snapshot object is a high level communication object, built on top of a read/write distributed system in which all except one processes may crash. It allows a process to write a value and obtain a set of values that represent a…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-02 Carole Delporte , Hugues Fauconnier , Sergio Rajsbaum , Michel Raynal
‹ Prev 1 3 4 5 6 7 10 Next ›