English
Related papers

Related papers: Prefix-free parsing for building large tunnelled W…

200 papers

When building Burrows-Wheeler Transforms (BWTs) of truly huge datasets, prefix-free parsing (PFP) can use an unreasonable amount of memory. In this paper we show how if a dataset can be broken down into small datasets that are not very…

Data Structures and Algorithms · Computer Science 2025-06-09 Diego Diaz-Dominguez , Travis Gagie , Veronica Guerrini , Ben Langmead , Zsuzsanna Liptak , Giovanni Manzini , Francesco Masillo , Vikram Shivakumar

Prefix-free parsing (PFP) was introduced by Boucher et al. (2019) as a preprocessing step to ease the computation of Burrows-Wheeler Transforms (BWTs) of genomic databases. Given a string $S$, it produces a dictionary $D$ and a parse $P$ of…

Data Structures and Algorithms · Computer Science 2020-06-23 Christina Boucher , Ondřej Cvacho , Travis Gagie , Jan Holub , Giovanni Manzini , Gonzalo Navarro , Massimiliano Rossi

High-throughput sequencing technologies have led to explosive growth of genomic databases; one of which will soon reach hundreds of terabytes. For many applications we want to build and store indexes of these databases but constructing such…

Data Structures and Algorithms · Computer Science 2018-11-19 Christina Boucher , Travis Gagie , Alan Kuhnle , Ben Langmead , Giovanni Manzini , Taher Mun

Motivated by challenges in pangenomic read alignment, we propose a generalization of Wheeler graphs that we call Wheeler maps. A Wheeler map stores a text $T[1..n]$ and an assignment of tags to the characters of $T$ such that we can…

Data Structures and Algorithms · Computer Science 2023-08-22 Andrej Baláz , Travis Gagie , Adrián Goga , Simon Heumos , Gonzalo Navarro , Alessia Petescia , Jouni Sirén

A recent paradigm shift in bioinformatics from a single reference genome to a pangenome brought with it several graph structures. These graph structures must implement operations, such as efficient construction from multiple genomes and…

Data Structures and Algorithms · Computer Science 2023-06-27 Andrej Baláž , Alessia Petescia

In recent years several compressed indexes based on variants of the Burrows-Wheeler transformation have been introduced. Some of these index structures far more complex than a single string, as was originally done with the FM-index…

Computational Complexity · Computer Science 2019-02-27 Daniel Gibney , Sharma V. Thankachan

The Burrows-Wheeler Transform (BWT) is an important technique both in data compression and in the design of compact indexing data structures. It has been generalized from single strings to collections of strings and some classes of labeled…

Data Structures and Algorithms · Computer Science 2019-05-30 Jarno Alanko , Travis Gagie , Gonzalo Navarro , Louisa Seelbach Benkner

The positional Burrows-Wheeler Transform (PBWT) is commonly used to store haplotype panels compactly in such a way that, given a query haplotype, we can quickly find the set maximal exact matches (SMEMs) between the query and the haplotypes…

Data Structures and Algorithms · Computer Science 2026-05-26 Travis Gagie

The Burrows-Wheeler Transform (BWT) has been an essential tool in text compression and indexing. First introduced in 1994, it went on to provide the backbone for the first encoding of the classic suffix tree data structure in space close to…

Data Structures and Algorithms · Computer Science 2020-02-19 Jason Bentley , Daniel Gibney , Sharma V. Thankachan

The Positional Burrows--Wheeler Transform (PBWT) is a data structure designed for efficiently representing and querying large collections of sequences, such as haplotype panels in genomics. Forward and backward stepping operations --…

Data Structures and Algorithms · Computer Science 2026-02-17 Paola Bonizzoni , Davide Cozzi , Younan Gao

FM-indexes are a crucial data structure in DNA alignment, for example, but searching with them usually takes at least one random access per character in the query pattern. Ferragina and Fischer observed in 2007 that word-based indexes often…

Data Structures and Algorithms · Computer Science 2023-05-11 Aaron Hong , Marco Oliva , Dominik Köppl , Hideo Bannai , Christina Boucher , Travis Gagie

We propose algorithms that, given the input string of length $n$ over integer alphabet of size $\sigma$, construct the Burrows-Wheeler transform (BWT), the permuted longest-common-prefix (PLCP) array, and the LZ77 parsing in…

Data Structures and Algorithms · Computer Science 2020-12-09 Dominik Kempa

Prefix parsing asks whether an input prefix can be extended to a complete string generated by a given grammar. In the weighted setting, it also provides prefix probabilities, which are central to context-free language modeling,…

Computation and Language · Computer Science 2026-05-05 Clemente Pasti , Andreas Opedal , Timothy J. O'Donnell , Ryan Cotterell , Tim Vieira

Recently, Cenzato et al.\ proposed a new text index, called the \emph{suffixient array}, which is a subset of the suffix array and supports locating a single pattern occurrence or finding its maximal exact matches (MEMs), assuming random…

Data Structures and Algorithms · Computer Science 2026-05-07 Paola Bonizzoni , Younan Gao , Brian Riccardi

Indexing strings via prefix (or suffix) sorting is, arguably, one of the most successful algorithmic techniques developed in the last decades. Can indexing be extended to languages? The main contribution of this paper is to initiate the…

Data Structures and Algorithms · Computer Science 2020-12-17 Jarno Alanko , Giovanna D'Agostino , Alberto Policriti , Nicola Prezza

Ordering the collection of states of a given automaton starting from an order of the underlying alphabet is a natural move towards a computational treatment of the language accepted by the automaton. Along this path, Wheeler \emph{graphs}…

Formal Languages and Automata Theory · Computer Science 2021-06-14 Giovanna D'Agostino , Davide Martincigh , Alberto Policriti

Large graph datasets make training graph neural networks (GNNs) computationally costly. Graph condensation methods address this by generating small synthetic graphs that approximate the original data. However, existing approaches rely on…

Machine Learning · Computer Science 2026-01-16 Jay Nandy , Arnab Kumar Mondal , Anuj Rathore , Mahesh Chandran

Graph plays a vital role in representing entities and their relationships in a variety of fields, such as e-commerce networks, social networks and biological networks. Given two vertices s and t, one of the fundamental problems in graph…

Databases · Computer Science 2021-02-25 Zhengmin Lai , You Peng , Shiyu Yang , Xuemin Lin , Wenjie Zhang

Indexing labeled graphs for pattern matching is a central challenge of pangenomics. Equi et al. (Algorithmica, 2022) developed the Elastic Founder Graph ($\mathsf{EFG}$) representing an alignment of $m$ sequences of length $n$, drawn from…

Data Structures and Algorithms · Computer Science 2023-03-10 Nicola Rizzo , Massimo Equi , Tuukka Norri , Veli Mäkinen

Word sense induction (WSI), which addresses polysemy by unsupervised discovery of multiple word senses, resolves ambiguities for downstream NLP tasks and also makes word representations more interpretable. This paper proposes an accurate…

Computation and Language · Computer Science 2018-05-31 Haw-Shiuan Chang , Amol Agrawal , Ananya Ganesh , Anirudha Desai , Vinayak Mathur , Alfred Hough , Andrew McCallum
‹ Prev 1 2 3 10 Next ›