English
Related papers

Related papers: Disk-based genome sequencing data compression

200 papers

The biochemical processes underlying DNA data storage, including synthesis, amplification, and sequencing, are inherently noisy. Consequently, base-level insertion, deletion, and substitution (IDS) errors, as well as sequence-level…

Information Theory · Computer Science 2026-03-17 Ramy Khabbaz , Jérémy Mateos , Marc Antonini , Serge Kas Hanna

We study the amount of reliable information that can be stored in a DNA-based storage system composed of short DNA molecules. In this regime, Shomorony and Heckel (2022) put forward a conjecture on the scaling of the number of information…

Information Theory · Computer Science 2025-11-19 Ran Tamir , Nir Weinberger , Albert Guillén i Fàbregas

We propose a novel coding scheme for DNA-based storage systems, called the shift-interleave (SI) coding, designed to correct insertion, deletion, and substitution (IDS) errors, as well as sequence losses. The SI coding scheme employs…

Information Theory · Computer Science 2024-01-29 Ryo Shibata , Haruhiko Kaneko

Accurate genome sequencing can improve our understanding of biology and the genetic basis of disease. The standard approach for generating DNA sequences from PacBio instruments relies on HMM-based models. Here, we introduce Distilled…

Metagenomics is an emerging field of molecular biology concerned with analyzing the genomes of environmental samples comprising many different diverse organisms. Given the nature of metagenomic data, one usually has to sequence the genomic…

Genomics · Quantitative Biology 2013-11-20 Jonathan G. Ligo , Minji Kim , Amin Emad , Olgica Milenkovic , Venugopal V. Veeravalli

We present a new semi-external algorithm that builds the Burrows--Wheeler transform variant of Bauer et al. (a.k.a., BCR BWT) in linear expected time. Our method uses compression techniques to reduce computational costs when the input is…

Data Structures and Algorithms · Computer Science 2023-08-15 Diego Díaz-Domínguez , Gonzalo Navarro

Product quantization-based approaches are effective to encode high-dimensional data points for approximate nearest neighbor search. The space is decomposed into a Cartesian product of low-dimensional subspaces, each of which generates a sub…

Computer Vision and Pattern Recognition · Computer Science 2014-05-19 Jianfeng Wang , Jingdong Wang , Jingkuan Song , Xin-Shun Xu , Heng Tao Shen , Shipeng Li

DNA computing, a nontraditional computing mechanism, provides a feasible and effective method for solving NP-hard problems because of the vast parallelism and high-density storage of DNA molecules. Although DNA computing has been exploited…

Molecular Networks · Quantitative Biology 2022-11-17 Enqiang Zhu , Xianhang Luo , Chanjuan Liu , Xiaolong Shi , Jin Xu

The last two decades have seen tremendous growth in data collections because of the realization of recent technologies, including the internet of things (IoT), E-Health, industrial IoT 4.0, autonomous vehicles, etc. The challenge of data…

Information Theory · Computer Science 2022-10-03 Vidhi Agrawal , Gajraj Kuldeep , Dhananjoy Dey

DNA based storage systems received attention by many researchers. This includes archival and re-writable random access DNA based storage systems. In this work, we have developed an efficient technique to encode the data into DNA sequence by…

Information Theory · Computer Science 2016-04-25 Dixita Limbachiya , Vijay Dhameliya , Madhav Khakhar , Manish K Gupta

Deep sequencing has become one of the most popular tools for transcriptome profiling in biomedical studies. While an abundance of computational methods exists for "normalizing" sequencing data to remove unwanted between-sample variations…

Genomics · Quantitative Biology 2022-01-14 Yannick Düren , Johannes Lederer , Li-Xuan Qin

Advances in DNA sequencing technology will soon result in databases of thousands of genomes. Within a species, individuals' genomes are almost exact copies of each other; e.g., any two human genomes are 99.9% the same. Relative Lempel-Ziv…

Data Structures and Algorithms · Computer Science 2011-11-08 Travis Gagie , Juha Kärkkäinen , Yakov Nekrich , Simon J. Puglisi

Technologies for sequencing (reading) and synthesizing (writing) DNA have progressed on a Moore's law-like trajectory over the last three decades. This has motivated the idea of using DNA for data storage. Theoretically, DNA-based storage…

Emerging Technologies · Computer Science 2023-07-07 Ajay Manicka , Andrew Stephan , Sriram Chari , Gemma Mendonsa , Peyton Okubo , John Stolzberg-Schray , Anil Reddy , Marc Riedel

Genome sequencing has become a central focus in computational biology. A genome study typically begins with sequencing, which produces millions to billions of short DNA fragments known as reads. Read mapping aligns these reads to a…

Data deduplication has gained wide acclaim as a mechanism to improve storage efficiency and conserve network bandwidth. Its most critical phase, data chunking, is responsible for the overall space savings achieved via the deduplication…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-28 Sreeharsha Udayashankar , Samer Al-Kiswany

The exponential growth of visual data in digital communications has intensified the need for efficient compression techniques that balance rate-distortion performance with computational feasibility. While recent neural compression…

Image and Video Processing · Electrical Eng. & Systems 2025-05-21 Karthik Sivakoti

A hypercomplex representation of DNA is proposed to facilitate comparison of DNA sequences with fuzzy composition. Using hypercomplex number representation, conventional sequence analysis method, such as, dot matrix analysis, dynamic…

Quantitative Methods · Quantitative Biology 2023-08-03 Jian-Jun Shu , Yajing Li

In this paper, we study achievable rates of concatenated coding schemes over a deoxyribonucleic acid (DNA) storage channel. Our channel model incorporates the main features of DNA-based data storage. First, information is stored on many,…

Information Theory · Computer Science 2020-05-04 Andreas Lenz , Lorenz Welter , Sven Puchinger

DNA sequences encode critical genetic information, yet their variable length and discrete nature impede direct utilization in deep learning models. Existing DNA representation schemes convert sequences into numerical vectors but fail to…

Genomics · Quantitative Biology 2025-12-16 Zhiyuan Peng , Naifan Zhang , Yuanbo Tang , Yang Li

In this paper, we consider the outer channel for DNA-based data storage. When transmitting over the outer channel, each DNA string is treated as a unit/symbol that would be either correctly received, or erased, or corrupted by uniformly…

Information Theory · Computer Science 2025-09-23 Xuan He , Yi Ding , Kui Cai , Guanghui Song , Bin Dai , Xiaohu Tang