English
Related papers

Related papers: Indexing large genome collections on a PC

200 papers

Searching for similar genomic sequences is an essential and fundamental step in biomedical research and an overwhelming majority of genomic analyses. State-of-the-art computational methods performing such comparisons fail to cope with the…

Data Structures and Algorithms · Computer Science 2024-07-11 Mohammed Alser , Julien Eudine , Onur Mutlu

Next Generation Sequencing (NGS) platforms and, more generally, high-throughput technologies are giving rise to an exponential growth in the size of nucleotide sequence databases. Moreover, many emerging applications of nucleotide datasets…

Databases · Computer Science 2019-10-11 Ferdinando Montecuollo , Giovannni Schmid , Roberto Tagliaferri

Language models are trained mainly on massive text data from the Internet, and it becomes increasingly important to understand this data source. Exact-match search engines enable searching in large text corpora - counting string appearances…

Computation and Language · Computer Science 2026-01-07 Hao Xu , Jiacheng Liu , Yejin Choi , Noah A. Smith , Hannaneh Hajishirzi

Conjugated organic molecules represent an important area of materials chemistry for both fundamental scientific exploration and technological applications. Using a genetic algorithm to computationally screen up to ~25-50 million molecules…

Applied Physics · Physics 2017-07-14 Ilana Y. Kanal , Geoffrey R. Hutchison

Motivation: Building the histogram of occurrences of every $k$-symbol long substring of nucleotide data is a standard step in many bioinformatics applications, known under the name of $k$-mer counting. Its applications include developing de…

Data Structures and Algorithms · Computer Science 2017-03-03 Sebastian Deorowicz , Marek Kokot , Szymon Grabowski , Agnieszka Debudaj-Grabysz

Metagenomics offers a way to analyze biotopes at the genomic level and to reach functional and taxonomical conclusions. The bio-analyzes of large metagenomic projects face critical limitations: complex metagenomes cannot be assembled and…

Genomics · Quantitative Biology 2015-11-30 Maillet Nicolas , Collet Guillaume , Vanier Thomas , Lavenier Dominique , Pierre Peterlongo

De novo genome assembly, i.e., rebuilding the sequence of an unknown genome from redundant and erroneous short sequences, is a key but computationally intensive step in many genomics pipelines. The exponential growth of genomic data is…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-12 Giulia Guidi , Gabriel Raulet , Daniel Rokhsar , Leonid Oliker , Katherine Yelick , Aydin Buluc

DNA pattern matching is essential for many widely used bioinformatics applications. Disease diagnosis is one of these applications, since analyzing changes in DNA sequences can increase our understanding of possible genetic diseases. The…

Hardware Architecture · Computer Science 2022-06-01 Jinane Bazzi , Jana Sweidan , Mohammed E. Fouda , Rouwaida Kanj , Ahmed M. Eltawil

Genome-wide association studies generate very large datasets that require scalable analysis algorithms. In this report we describe the GEDI software package, which implements efficient algorithms for performing several common tasks in the…

Data Structures and Algorithms · Computer Science 2016-09-08 Justin Kennedy , Ion I. Mandoiu , Bogdan Pasaniuc

In recent years, pangenomes received increasing attention from the scientific community for their ability to incorporate population variation information and alleviate reference genome bias. Maximal Exact Matches (MEMs) and Maximal Unique…

Data Structures and Algorithms · Computer Science 2022-05-04 Sara Giuliani , Giuseppe Romana , Massimiliano Rossi

The task of understanding and interpreting the complex information encoded within genomic sequences remains a grand challenge in biological research and clinical applications. In this context, recent advancements in large language model…

Genomics · Quantitative Biology 2024-09-25 Qihang Zhao , Chi Zhang , Weixiong Zhang

Popularized by the Differentiable Search Index, the emerging paradigm of generative retrieval re-frames the classic information retrieval problem into a sequence-to-sequence modeling task, forgoing external indices and encoding an entire…

Information Retrieval · Computer Science 2023-05-22 Ronak Pradeep , Kai Hui , Jai Gupta , Adam D. Lelkes , Honglei Zhuang , Jimmy Lin , Donald Metzler , Vinh Q. Tran

An approach for approximately calculating the number of genes in a genome is presented, which takes into account the average protein length expected for the species. A number of virus, bacterial and eukaryotic genomes are scrutinized.…

Genomics · Quantitative Biology 2015-02-13 N. S. Santos-Magalhaes , H. M. de Oliveira

The two most common data-structures for genome indexing, FM-indices and hash-tables, exhibit a fundamental trade-off between memory footprint and performance. We present Ranger, a new indexing technique for nucleotide sequences that is both…

Data Structures and Algorithms · Computer Science 2023-08-09 Alon Rashelbach , Ori Rottensterich , Mark Silberstien

Multiple matching algorithms are used to locate the occurrences of patterns from a finite pattern set in a large input string. Aho-Corasick and Wu-Manber, two of the most well known algorithms for multiple matching require an increased…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-07-11 Charalampos S. Kouzinopoulos , John-Alexander M. Assael , Themistoklis K. Pyrgiotis , Konstantinos G. Margaritis

Computational complexity is a key limitation of genomic analyses. Thus, over the last 30 years, researchers have proposed numerous fast heuristic methods that provide computational relief. Comparing genomic sequences is one of the most…

This paper presents a new, parallel implementation of clustering and demonstrates its utility in greatly speeding up the process of identifying homologous proteins. Clustering is a technique to reduce the number of comparison needed to find…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-29 Stuart Byma , Akash Dhasade , Adrian Altenhoff , Christophe Dessimoz , James R. Larus

Relation of genome sizes to organisms complexity is still described rather equivocally. Neither the number of genes (G-value), nor the total amount of DNA (C-value) correlates consistently with phenotype complexity. Using information theory…

Genomics · Quantitative Biology 2007-05-23 Dmitri V. Parkhomchuk

Discovering genes with similar functions across diverse biomedical contexts poses a significant challenge in gene representation learning due to data heterogeneity. In this study, we resolve this problem by introducing a novel model called…

Machine Learning · Computer Science 2023-10-05 Tianyu Liu , Yuge Wang , Rex Ying , Hongyu Zhao

Genetic information is increasing exponentially, doubling every 18 months. Analyzing this information within a reasonable amount of time requires parallel computing resources. While considerable research has addressed DNA analysis using…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-30 Suejb Memeti , Sabri Pllana