English
Related papers

Related papers: Teaching the Burrows-Wheeler Transform via the Pos…

200 papers

We show how to build several data structures of central importance to string processing, taking as input the Burrows-Wheeler transform (BWT) and using small extra working space. Let $n$ be the text length and $\sigma$ be the alphabet size.…

Data Structures and Algorithms · Computer Science 2019-08-14 Nicola Prezza , Giovanna Rosone

The Burrows-Wheeler Transform (BWT) moves characters with similar contexts in a text together, where a character's context consists of the characters immediately following it. We say that a property has contextual locality if characters…

Data Structures and Algorithms · Computer Science 2024-11-26 Travis Gagie

Detecting all the strings that occur in a text more frequently or less frequently than expected according to an IID or a Markov model is a basic problem in string mining, yet current algorithms are based on data structures that are either…

Data Structures and Algorithms · Computer Science 2015-08-13 Djamal Belazzougui , Fabio Cunial

In this paper, we consider the problem of compressing a trie while supporting the powerful \emph{locate} queries: to return the pre-order identifiers of all nodes reached by a path labeled with a given query pattern. Our result builds on…

Data Structures and Algorithms · Computer Science 2020-12-18 Nicola Prezza

In this paper we describe algorithms for computing the BWT and for building (compressed) indexes in external memory. The innovative feature of our algorithms is that they are lightweight in the sense that, for an input of size $n$, they use…

Data Structures and Algorithms · Computer Science 2009-09-25 Paolo Ferragina , Travis Gagie , Giovanni Manzini

Prefix-free parsing (PFP) was introduced by Boucher et al. (2019) as a preprocessing step to ease the computation of Burrows-Wheeler Transforms (BWTs) of genomic databases. Given a string $S$, it produces a dictionary $D$ and a parse $P$ of…

Data Structures and Algorithms · Computer Science 2020-06-23 Christina Boucher , Ondřej Cvacho , Travis Gagie , Jan Holub , Giovanni Manzini , Gonzalo Navarro , Massimiliano Rossi

Some recent results have introduced external-memory algorithms to compute self-indexes of a set of strings, mainly via computing the Burrows-Wheeler Transform (BWT) of the input strings. The motivations for those results stem from…

Data Structures and Algorithms · Computer Science 2015-06-12 Paola Bonizzoni , Gianluca Della Vedova , Yuri Pirola , Marco Previtali , Raffaella Rizzi

We investigate properties of the bijective Burrows-Wheeler transform (BBWT). We show that for any string $w$, a bidirectional macro scheme of size $O(r_B)$ can be induced from the BBWT of $w$, where $r_B$ is the number of maximal character…

Data Structures and Algorithms · Computer Science 2024-08-20 Golnaz Badkobeh , Hideo Bannai , Dominik Köppl

We present an algorithm for building the extended BWT (eBWT) of a string collection from its grammar-compressed representation. Our technique exploits the string repetitions captured by the grammar to boost the computation of the eBWT.…

Genomics · Quantitative Biology 2021-02-10 Diego Diaz-Dominguez annd Gonzalo Navarro

Until recently, most experts would probably have agreed we cannot backwards-step in constant time with a run-length compressed Burrows-Wheeler Transform (RLBWT), since doing so relies on rank queries on sparse bitvectors and those inherit…

Data Structures and Algorithms · Computer Science 2022-07-15 Nathaniel K. Brown , Travis Gagie , Massimiliano Rossi

We show that the Longest Common Prefix Array of a text collection of total size n on alphabet [1, {\sigma}] can be computed from the Burrows-Wheeler transformed collection in O(n log {\sigma}) time using o(n log {\sigma}) bits of working…

Data Structures and Algorithms · Computer Science 2019-01-23 Nicola Prezza , Giovanna Rosone

Modern genomic analyses increasingly rely on pangenomes, that is, representations of the genome of entire populations. The simplest representation of a pangenome is a set of individual genome sequences. Compared to e.g. sequence graphs,…

Genomics · Quantitative Biology 2025-11-25 Jannik Olbrich , Enno Ohlebusch

The compression of highly repetitive strings (i.e., strings with many repetitions) has been a central research topic in string processing, and quite a few compression methods for these strings have been proposed thus far. Among them, an…

Data Structures and Algorithms · Computer Science 2022-02-17 Takaaki Nishimoto , Shunsuke Kanda , Yasuo Tabei

Indexing highly repetitive texts - such as genomic databases, software repositories and versioned text collections - has become an important problem since the turn of the millennium. A relevant compressibility measure for repetitive texts…

Data Structures and Algorithms · Computer Science 2020-12-17 Travis Gagie , Gonzalo Navarro , Nicola Prezza

Advances in DNA sequencing technology have stimulated the development of algorithms and tools for processing very large collections of short strings (reads). Short-read alignment and assembly are among the most well-studied problems. Many…

Genomics · Quantitative Biology 2014-01-30 Chi-Man Liu , Ruibang Luo , Tak-Wah Lam

This paper presents the Bayesian Hierarchical Words Representation (BHWR) learning algorithm. BHWR facilitates Variational Bayes word representation learning combined with semantic taxonomy modeling via hierarchical priors. By propagating…

Computation and Language · Computer Science 2020-04-16 Oren Barkan , Idan Rejwan , Avi Caciularu , Noam Koenigstein

Ordering the collection of states of a given automaton starting from an order of the underlying alphabet is a natural move towards a computational treatment of the language accepted by the automaton. Along this path, Wheeler \emph{graphs}…

Formal Languages and Automata Theory · Computer Science 2021-06-14 Giovanna D'Agostino , Davide Martincigh , Alberto Policriti

Highly-repetitive collections of strings are increasingly being amassed by genome sequencing and genetic variation experiments, as well as by storing all versions of human-generated files, like webpages and source code. Existing indexes for…

Data Structures and Algorithms · Computer Science 2016-04-22 Djamal Belazzougui , Fabio Cunial , Travis Gagie , Nicola Prezza , Mathieu Raffinot

A bit catastrophe, loosely defined, is when a change in just one character of a string causes a significant change in the size of the compressed string. We study this phenomenon for the Burrows-Wheeler Transform (BWT), a string transform at…

Data Structures and Algorithms · Computer Science 2025-06-10 Sara Giuliani , Shunsuke Inenaga , Zsuzsanna Lipták , Giuseppe Romana , Marinella Sciortino , Cristian Urbina

A wavelet forest for a text $T [1..n]$ over an alphabet $\sigma$ takes $n H_0 (T) + o (n \log \sigma)$ bits of space and supports access and rank on $T$ in $O (\log \sigma)$ time. K\"arkk\"ainen and Puglisi (2011) implicitly introduced…

Data Structures and Algorithms · Computer Science 2023-08-16 Christina Boucher , Travis Gagie , Aaron Hong , Yansong Li , Norbert Zeh