English
Related papers

Related papers: Computing Maximal Unique Matches with the r-index

200 papers

There now exist compact indexes that can efficiently list all the occurrences of a pattern in a dataset consisting of thousands of genomes, or even all the occurrences of all the pattern's maximal exact matches (MEMs) with respect to the…

Data Structures and Algorithms · Computer Science 2022-09-20 Adrián Goga , Andrej Baláž , Alessia Petescia , Travis Gagie

Exact Maximum Inner Product Search (MIPS) is an important task that is widely pertinent to recommender systems and high-dimensional similarity search. The brute-force approach to solving exact MIPS is computationally expensive, thus…

Information Retrieval · Computer Science 2019-03-18 Firas Abuzaid , Geet Sethi , Peter Bailis , Matei Zaharia

Indexing very large collections of strings, such as those produced by the widespread next generation sequencing technologies, heavily relies on multistring generalization of the Burrows-Wheeler Transform (BWT): large requirements of…

Data Structures and Algorithms · Computer Science 2020-12-07 Paola Bonizzoni , Gianluca Della Vedova , Yuri Pirola , Marco Previtali , Raffaella Rizzi

Bayesian inference for hierarchical models can be very challenging. MCMC methods have difficulty scaling to large models with many observations and latent variables. While variational inference (VI) and reweighted wake-sleep (RWS) can be…

Machine Learning · Statistics 2025-03-12 Thomas Heap , Sam Bowyer , Laurence Aitchison

Genome-to-genome comparisons require designating anchor points, which are given by Maximum Exact Matches (MEMs) between their sequences. For large genomes this is a challenging problem and the performance of existing solutions, even in…

Data Structures and Algorithms · Computer Science 2018-05-24 Szymon Grabowski , Wojciech Bieniecki

Suppose we are asked to index a text $T [0..n - 1]$ such that, given a pattern $P [0..m - 1]$, we can quickly report the maximal substrings of $P$ that each occur in $T$ at least $k$ times. We first show how we can add $O (r \log n)$ bits…

Data Structures and Algorithms · Computer Science 2022-12-22 Igor Tatarnikov , Ardavan Shahrabi Farahani , Sana Kashgouli , Travis Gagie

The Burrows-Wheeler Transform (BWT) is often taught in undergraduate courses on algorithmic bioinformatics, because it underlies the FM-index and thus important tools such as Bowtie and BWA. Its admirers consider the BWT a thing of beauty…

Data Structures and Algorithms · Computer Science 2022-08-23 Travis Gagie , Giovanni Manzini , Marinella Sciortino

Motivation: Burrows-Wheeler Transform (BWT) is a common component in full-text indices. Initially developed for data compression, it is particularly powerful for encoding redundant sequences such as pangenome data. However, BWT construction…

Genomics · Quantitative Biology 2025-09-10 Heng Li

For taxonomic classification, we are asked to index the genomes in a phylogenetic tree such that later, given a DNA read, we can quickly choose a small subtree likely to contain the genome from which that read was drawn. Although popular…

Data Structures and Algorithms · Computer Science 2024-04-08 Dominika Draesslerová , Omar Ahmed , Travis Gagie , Jan Holub , Ben Langmead , Giovanni Manzini , Gonzalo Navarro

Indexing of very large collections of strings such as those produced by the widespread sequencing technologies, heavily relies on multi-string generalizations of the Burrows-Wheeler Transform (BWT), and for this problem various in-memory…

Data Structures and Algorithms · Computer Science 2016-07-29 Paola Bonizzoni , Gianluca Della Vedova , Serena Nicosia , Marco Previtali , Raffaella Rizzi

GEneral Matrix Multiply (GEMM) is a central operation in deep learning and corresponds to the largest chunk of the compute footprint. Therefore, improving its efficiency is an active topic of ongoing research. A popular strategy is the use…

Machine Learning · Computer Science 2024-03-13 Zhanpeng Zeng , Karthikeyan Sankaralingam , Vikas Singh

Nishimoto and Tabei [CPM, 2021] proposed r-enum, an algorithm to enumerate various characteristic substrings, including maximal repeats, in a string $T$ of length $n$ in $O(r)$ words of compressed working space, where $r \le n$ is the…

Data Structures and Algorithms · Computer Science 2026-01-27 Kotaro Kimura , Tomohiro I

Mixture of Experts (MoE) are successful models for modeling heterogeneous data in many statistical learning problems including regression, clustering and classification. Generally fitted by maximum likelihood estimation via the well-known…

Machine Learning · Statistics 2018-10-30 Faicel Chamroukhi , Bao-Tuyen Huynh

Genomics is the foundation of precision medicine, global food security and virus surveillance. Exact-match is one of the most essential operations widely used in almost every step of genomics such as alignment, assembly, annotation, and…

Hardware Architecture · Computer Science 2021-01-15 Lei Jiang , Farzaneh Zokaee

In order to avoid the reference bias introduced by mapping reads to a reference genome, bioinformaticians are investigating reference-free methods for analyzing sequenced genomes. With large projects sequencing thousands of individuals,…

Data Structures and Algorithms · Computer Science 2016-01-15 Jouni Sirén

Modeling of high-dimensional data is very important to categorize different classes. We develop a new mixture model called Multinomial cluster-weighted model (MCWM). We derive the identifiability of a general class of MCWM. We estimate the…

Methodology · Statistics 2022-08-25 Kehinde Olobatuyi , Oludare Ariyo

With the recent advances in DNA sequencing, it is now possible to have complete genomes of individuals sequenced and assembled. This rich and focused genotype information can be used to do different population-wide studies, now first time…

Data Structures and Algorithms · Computer Science 2011-09-08 Jouni Sirén , Niko Välimäki , Veli Mäkinen

It is widely acknowledged that the performance of Transformer models is logarithmically related to their number of parameters and computational complexity. While approaches like Mixture of Experts (MoE) decouple parameter count from…

Machine Learning · Computer Science 2025-02-07 Zihao Huang , Qiyang Min , Hongzhi Huang , Defa Zhu , Yutao Zeng , Ran Guo , Xun Zhou

Packing several characters into one computer word is a simple and natural way to compress the representation of a string and to speed up its processing. Exploiting this idea, we propose an index for a packed string, based on a {\em sparse…

Data Structures and Algorithms · Computer Science 2015-03-19 Roman Kolpakov , Gregory Kucherov , Tatiana Starikovskaya

The Burrows-Wheeler transform (BWT) is integral to the FM-index, which is used extensively in text compression, indexing, pattern search, and bioinformatic problems as de novo assembly and read alignment. Thus, efficient construction of the…

Data Structures and Algorithms · Computer Science 2025-02-04 Enno Adler , Stefan Böttcher , Rita Hartel , Cederic Alexander Steininger