English
Related papers

Related papers: Practical combinations of repetition-aware data st…

200 papers

In 1994, Burrows and Wheeler developed a data compression algorithm which performs significantly better than Lempel-Ziv based algorithms. Since then, a lot of work has been done in order to improve their algorithm, which is based on a…

Data Structures and Algorithms · Computer Science 2007-05-23 Dragos Trinca

Extracting automatically the complex set of features composing real high-dimensional data is crucial for achieving high performance in machine--learning tasks. Restricted Boltzmann Machines (RBM) are empirically known to be efficient for…

Data Analysis, Statistics and Probability · Physics 2017-04-05 Jérôme Tubiana , Rémi Monasson

This work presents a discovery to advance the wisdom in a particular Succinct Data Structure: Wavelet Tree (Grossi, Gupta, and Vitter 2003). The discovery is first made by showing the feasibility of Reversed Indexes = Values: for integers…

Information Theory · Computer Science 2024-02-27 Xiangjun Peng

Motivation: Rapid technological progress in DNA sequencing has stimulated interest in compressing the vast datasets that are now routinely produced. Relatively little attention has been paid to compressing the quality scores that are…

Genomics · Quantitative Biology 2013-05-02 Lilian Janin , Giovanna Rosone , Anthony J. Cox

Non-confluent and non-terminating constructor-based term rewrite systems are useful for the purpose of specification and programming. In particular, existing functional logic languages use such kind of rewrite systems to define possibly…

Data structures used in software development have inbuilt redundancy to improve software reliability and to speed up performance. Examples include a Doubly Linked List which allows a faster deletion due to the presence of the previous…

Databases · Computer Science 2025-08-05 Pratyush Mahapatra , Mark D. Hill , Michael M. Swift

Scaling laws predict that the performance of large language models improves with increasing model size and data size. In practice, pre-training has been relying on massive web crawls, using almost all data sources publicly available on the…

Computation and Language · Computer Science 2025-09-16 Thao Nguyen , Yang Li , Olga Golovneva , Luke Zettlemoyer , Sewoong Oh , Ludwig Schmidt , Xian Li

In this paper, we introduce zip-tries, which are simple, dynamic, memory-efficient data structures for strings. Zip-tries support search and update operations for $k$-length strings in $\mathcal{O}(k+\log n)$ time in the standard RAM model…

Data Structures and Algorithms · Computer Science 2025-08-21 David Eppstein , Ofek Gila , Michael T. Goodrich , Ryuto Kitagawa

In this paper we study a variant of string pattern matching which deals with tuples of strings known as \textit{multi-track strings}. Multi-track strings are a generalisation of strings (or \textit{single-track strings}) that have primarily…

Data Structures and Algorithms · Computer Science 2019-12-02 Carl Barton , Ewan Birney , Tomas Fitzgerald

The integration of real-world data (RWD) and randomized controlled trials (RCT) is increasingly important for advancing causal inference in scientific research. This combination holds great promise for enhancing the efficiency of causal…

Methodology · Statistics 2024-07-02 Xi Lin , Jens Magelund Tarp , Robin J. Evans

We study how the application of injective morphisms affects the number $r$ of equal-letter runs in the Burrows-Wheeler Transform (BWT). This parameter has emerged as a key repetitiveness measure in compressed indexing. We focus on the…

Formal Languages and Automata Theory · Computer Science 2025-04-25 Gabriele Fici , Giuseppe Romana , Marinella Sciortino , Cristian Urbina

Exact string matching has been a fundamental problem in computer science for decades because of many practical applications. Some are related to common procedures, such as searching in files and text editors, or, more recently, to more…

Data Structures and Algorithms · Computer Science 2019-07-29 Konstantinos F. Xylogiannopoulos

We investigate symbolic sequences and in particular information carriers as e.g. books and DNA-strings. First the higher order Shannon entropies are calculated, a characteristic root law is detected. Then the algorithmic entropy is…

Disordered Systems and Neural Networks · Physics 2007-05-23 Werner Ebeling , Alexander Neiman , Thorsten Poeschel

In many modern applications, including analysis of gene expression and text documents, the data are noisy, high-dimensional, and unordered--with no particular meaning to the given order of the variables. Yet, successful learning is often…

Methodology · Statistics 2008-07-25 Ann B. Lee , Boaz Nadler , Larry Wasserman

We introduce a new family of compressed data structures to efficiently store and query large string dictionaries in main memory. Our main technique is a combination of hierarchical Front-coding with ideas from longest-common-prefix…

Data Structures and Algorithms · Computer Science 2019-11-20 Nieves R. Brisaboa , Ana Cerdeira-Pena , Guillermo de Bernardo , Gonzalo Navarro

Dedicated model transformation languages are claimed to provide many benefits over the use of general purpose languages for developing model transformations. However, the actual advantages associated with the use of MTLs are poorly…

Software Engineering · Computer Science 2023-05-12 Stefan Höppner , Matthias Tichy

In this article we extend the elegant in-place Burrows-Wheeler transform (BWT) algorithm proposed by Crochemore et al. (Crochemore et al., 2015). Our extension is twofold: we first show how to compute simultaneously the longest common…

Data Structures and Algorithms · Computer Science 2018-06-08 Felipe A. Louza , Travis Gagie , Guilherme P. Telles

We present RCT, a new compact data structure to represent trajectories of objects. It is based on a relative compression technique called Relative Lempel-Ziv (RLZ), which compresses sequences by applying an LZ77 encoding with respect to an…

Data Structures and Algorithms · Computer Science 2018-10-16 Nieves R. Brisaboa , Travis Gagie , Adrián Gómez-Brandón , Gonzalo Navarro , José R. Paramá

Evaluating whether large language models (LLMs) capture the structure of natural language beyond local fluency remains an open challenge. Existing evaluation methods, largely based on task performance or short-context behavior, provide…

Computation and Language · Computer Science 2026-05-26 Kumiko Tanaka-Ishii

So far, many network-structure-based link prediction methods have been proposed. However, these methods only highlight one or two structural features of networks, and then use the methods to predict missing links in different networks. The…

Physics and Society · Physics 2017-09-01 Chuang Ma , Zhong-Kui Bao , Hai-Feng Zhang