English
Related papers

Related papers: Sequential-Access FM-Indexes

200 papers

Self-attention in transformer models is an incremental associative memory that maps key vectors to value vectors. One way to speed up self-attention is to employ GPU-compatible vector search algorithms based on standard partitioning methods…

Computation and Language · Computer Science 2025-06-04 Pierre-Emmanuel Mazaré , Gergely Szilvasy , Maria Lomeli , Francisco Massa , Naila Murray , Hervé Jégou , Matthijs Douze

Dual-encoder-based dense retrieval models have become the standard in IR. They employ large Transformer-based language models, which are notoriously inefficient in terms of resources and latency. We propose Fast-Forward indexes -- vector…

Information Retrieval · Computer Science 2023-11-03 Jurek Leonhardt , Henrik Müller , Koustav Rudra , Megha Khosla , Abhijit Anand , Avishek Anand

In this paper we describe algorithms for computing the BWT and for building (compressed) indexes in external memory. The innovative feature of our algorithms is that they are lightweight in the sense that, for an input of size $n$, they use…

Data Structures and Algorithms · Computer Science 2009-09-25 Paolo Ferragina , Travis Gagie , Giovanni Manzini

In a \emph{weighted sequence}, for every position of the sequence and every letter of the alphabet a probability of occurrence of this letter at this position is specified. Weighted sequences are commonly used to represent imprecise or…

Data Structures and Algorithms · Computer Science 2017-08-28 Carl Barton , Tomasz Kociumaka , Chang Liu , Solon P. Pissis , Jakub Radoszewski

Configuring databases for efficient querying is a complex task, often carried out by a database administrator. Solving the problem of building indexes that truly optimize database access requires a substantial amount of database and domain…

Databases · Computer Science 2024-04-12 Gabriel Paludo Licks , Felipe Meneguzzi

The problem of fast items retrieval from a fixed collection is often encountered in most computer science areas, from operating system components to databases and user interfaces. We present an approach based on hash tables that focuses on…

Neural and Evolutionary Computing · Computer Science 2020-07-17 Dan Domnita , Ciprian Oprisa

Hardware acceleration of database query processing can be done with the help of FPGAs. In particular, they are partially reconfigurable at runtime, which allows for the runtime adaption of the hardware to a variety of queries.…

Databases · Computer Science 2020-05-05 Lekshmi B. G. , Andreas Becher , Klaus Meyer-Wegener

We analyze quantitatively several strategies for better utilization of the {\em cache} or the {\em {fast access}} memory in computers. We define a performance factor $\alpha$ that denotes the fraction of the cache area utilized when the…

Statistical Mechanics · Physics 2007-05-23 Satya N. Majumdar , Jaikumar Radhakrishnan

Large-scale, parallel clusters composed of commodity processors are increasingly available, enabling the use of vast processing capabilities and distributed RAM to solve hard search problems. We investigate Hash-Distributed A* (HDA*), a…

Artificial Intelligence · Computer Science 2015-03-20 Akihiro Kishimoto , Alex Fukunaga , Adi Botea

While short read aligners, which predominantly use the FM-index, are able to easily index one or a few human genomes, they do not scale well to indexing databases containing thousands of genomes. To understand why, it helps to examine the…

Data Structures and Algorithms · Computer Science 2018-11-19 Alan Kuhnle , Taher Mun , Christina Boucher , Travis Gagie , Ben Langmead , Giovanni Manzini

The problem of frequent pattern mining has been studied quite extensively for various types of data, including sets, sequences, and graphs. Somewhat surprisingly, another important type of data, namely rank data, has received very little…

Machine Learning · Computer Science 2018-06-18 Sascha Henzgen , Eyke Hüllermeier

LRM-Trees are an elegant way to partition a sequence of values into sorted consecutive blocks, and to express the relative position of the first element of each block within a previous block. They were used to encode ordinal trees and to…

Data Structures and Algorithms · Computer Science 2010-09-30 Jérémy Barbay , Johannes Fischer

A compressed full-text self-index occupies space close to that of the compressed text and simultaneously allows fast pattern matching and random access to the underlying text. Among the best compressed self-indexes, in theory and in…

Data Structures and Algorithms · Computer Science 2011-04-20 Juha Kärkkäinen , Simon J. Puglisi

List Accessing Problem is a well studied research problem in the context of linear search. Input to the list accessing problem is an unsorted linear list of distinct elements along with a sequence of requests, where each request is an…

Data Structures and Algorithms · Computer Science 2015-05-30 Rakesh Mohanty , Burle Sharma , Sasmita Tripathy

Artificial intelligence-generated traffic is changing the shape of wireless networks. Specifically, as the amount of data generated to train machine learning models is massive, network resources must be carefully allocated to continue…

Networking and Internet Architecture · Computer Science 2026-02-03 Giovanni Perin , Eunjeong Jeong , Nikolaos Pappas

Density Peak Clustering (DPC), a popular density-based clustering approach, has received considerable attention from the research community primarily due to its simplicity and fewer-parameter requirement. However, the resultant clusters…

Databases · Computer Science 2020-07-24 Zafaryab Rasool , Rui Zhou , Lu Chen , Chengfei Liu , Jiajie Xu

Given a point set S and an unknown metric d on S, we study the problem of efficiently partitioning S into k clusters while querying few distances between the points. In our model we assume that we have access to one versus all queries that…

Data Structures and Algorithms · Computer Science 2011-05-10 Konstantin Voevodski , Maria-Florina Balcan , Heiko Roglin , Shang-Hua Teng , Yu Xia

Safe memory reclamation (SMR) algorithms are crucial for preventing use-after-free errors in optimistic data structures. SMR algorithms typically delay reclamation for safety and reclaim objects in batches for efficiency. It is difficult to…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-28 Ajay Singh , Trevor Brown , Michael Spear

With the wide development of databases in general and data warehouses in particular, it is important to reduce the tasks that a database administrator must perform manually. The idea of using data mining techniques to extract useful…

Databases · Computer Science 2007-05-23 Kamel Aouiche , Jérôme Darmont

We propose a new algorithm for fast approximate nearest neighbor search based on the properties of ordered vectors. Data vectors are classified based on the index and sign of their largest components, thereby partitioning the space in a…

Computer Vision and Pattern Recognition · Computer Science 2016-11-01 Luisa Verdoliva , Davide Cozzolino , Giovanni Poggi