English
Related papers

Related papers: Large-Scale Pattern Search Using Reduced-Space On-…

200 papers

In the last decades, the necessity to process massive amounts of textual data fueled the development of compressed text indexes: data structures efficiently answering queries on a given text while occupying space proportional to the…

Data Structures and Algorithms · Computer Science 2024-09-24 Dominik Kempa , Tomasz Kociumaka

Indexing a set of strings for prefix search or membership queries is a fundamental task with many applications such as information retrieval or database systems. A classic abstract data type for modelling such an index is a trie. Due to the…

Data Structures and Algorithms · Computer Science 2024-03-11 Hideo Bannai , Keisuke Goto , Shunsuke Kanda , Dominik Köppl

When building Burrows-Wheeler Transforms (BWTs) of truly huge datasets, prefix-free parsing (PFP) can use an unreasonable amount of memory. In this paper we show how if a dataset can be broken down into small datasets that are not very…

Data Structures and Algorithms · Computer Science 2025-06-09 Diego Diaz-Dominguez , Travis Gagie , Veronica Guerrini , Ben Langmead , Zsuzsanna Liptak , Giovanni Manzini , Francesco Masillo , Vikram Shivakumar

Differentiable architecture search (DARTS) is successfully applied in many vision tasks. However, directly using DARTS for Transformers is memory-intensive, which renders the search process infeasible. To this end, we propose a multi-split…

Machine Learning · Computer Science 2021-06-01 Yuekai Zhao , Li Dong , Yelong Shen , Zhihua Zhang , Furu Wei , Weizhu Chen

Text indexing is a classical algorithmic problem that has been studied for over four decades: given a text $T$, pre-process it off-line so that, later, we can quickly count and locate the occurrences of any string (the query pattern) in $T$…

Data Structures and Algorithms · Computer Science 2020-12-15 Nicola Prezza

Suffixient sets are a novel prefix array (PA) compression technique based on subsampling PA (rather than compressing the entire array like previous techniques used to do): by storing very few entries of PA (in fact, a compressed number of…

Data Structures and Algorithms · Computer Science 2025-06-11 Davide Cenzato , Francisco Olivares , Nicola Prezza

This paper presents a novel method for efficient image retrieval, based on a simple and effective hashing of CNN features and the use of an indexing structure based on Bloom filters. These filters are used as gatekeepers for the database of…

Multimedia · Computer Science 2016-05-04 Andrea Salvi , Simone Ercoli , Marco Bertini , Alberto Del Bimbo

Inverted indexes are vital in providing fast key-word-based search. For every term in the document collection, a list of identifiers of documents in which the term appears is stored, along with auxiliary information such as term frequency,…

Information Retrieval · Computer Science 2019-01-30 Harrie Oosterhuis , J. Shane Culpepper , Maarten de Rijke

Efficient spatial indexing is crucial for processing large-scale spatial data. Traditional spatial indexes, such as STR-Tree and Quad-Tree, organize spatial objects based on coarse approximations, such as their minimum bounding rectangles…

Databases · Computer Science 2026-03-10 Xiangyang Yang , Xuefeng Guan , Lanxue Dang , Yi Xie , Qingyang Xu , Huayi Wu , Jiayao Wang

High-dimensional vector similarity search (HVSS) is gaining prominence as a powerful tool for various data science and AI applications. As vector data scales up, in-memory indexes pose a significant challenge due to the substantial increase…

The paper is concerned with the time efficient processing of spatiotemporal predicates, i.e. spatial predicates associated with an exact temporal constraint. A set of such predicates forms a buffer query or a Spatio-temporal Pattern (STP)…

Databases · Computer Science 2008-12-18 Lagogiannis George , Lorentzos Nikos , Sioutas Spyros , Theodoridis Evaggelos

Vector searches on large-scale datasets are critical to modern online services like web search and RAG, which necessity storing the datasets and their index on the secondary storage like SSD. In this paper, we are the first to characterize…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-08 Rongxin Cheng , Yifan Peng , Xingda Wei , Hongrui Xie , Rong Chen , Sijie Shen , Haibo Chen

Music search at the scale of Amazon Music presents a unique challenge: queries frequently deviate from indexed metadata due to misspellings, transpositions, and phonetic variations, yet the retrieval system must operate under strict…

Artificial Intelligence · Computer Science 2026-05-19 Paul Greyson , Zhichao Geng , Wei Zhang , Yang Yang

The FM-index is a celebrated compressed data structure for full-text pattern searching. After the first wave of interest in its theoretical developments, we can observe a surge of interest in practical FM-index variants in the last few…

Data Structures and Algorithms · Computer Science 2015-10-27 Szymon Grabowski , Marcin Raniszewski , Sebastian Deorowicz

Rank and select data structures seek to preprocess a bit vector to quickly answer two kinds of queries: rank(i) gives the number of 1 bits in slots 0 through i, and select(j) gives the first slot s with rank(s) = j. A succinct data…

Data Structures and Algorithms · Computer Science 2024-05-09 Matthew D. Laws , Jocelyn Bliven , Kit Conklin , Elyes Laalai , Samuel McCauley , Zach S. Sturdevant

This work presents a novel trie (prefix-tree)-based parallel decoding method that addresses the memory inefficiency of batch-based beam search. By sharing a single KV cache across beams with common prefixes, our approach dramatically…

Computation and Language · Computer Science 2025-09-23 Brian J Chan , MaoXun Huang , Jui-Hung Cheng , Chao-Ting Chen , Hen-Hsen Huang

Previous work identifying depth-optimal $n$-channel sorting networks for $9\leq n \leq 16$ is based on exploiting symmetries of the first two layers. However, the naive generate-and-test approach typically applied does not scale. This paper…

Data Structures and Algorithms · Computer Science 2016-11-30 Michael Codish , Luis Cruz-Filipe , Peter Schneider-Kamp

High-dimensional similarity search underpins modern retrieval systems, yet uniform search strategies fail to exploit the heterogeneous nature of real-world query distributions. We present an adaptive prefiltering framework that leverages…

Information Retrieval · Computer Science 2026-02-27 Teodor-Ioan Calin

Text retrieval using learned sparse representations of queries and documents has, over the years, evolved into a highly effective approach to search. It is thanks to recent advances in approximate nearest neighbor search-with the emergence…

Information Retrieval · Computer Science 2026-02-06 Sebastian Bruch , Martino Fontana , Franco Maria Nardini , Cosimo Rulli , Rossano Venturini

Similarity search approaches based on graph walks have recently attained outstanding speed-accuracy trade-offs, taking aside the memory requirements. In this paper, we revisit these approaches by considering, additionally, the memory…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Matthijs Douze , Alexandre Sablayrolles , Hervé Jégou
‹ Prev 1 3 4 5 6 7 10 Next ›