English
Related papers

Related papers: Compression of next-generation sequencing reads ai…

200 papers

In federated learning, particularly in cross-device scenarios, secure aggregation has recently gained popularity as it effectively defends against inference attacks by malicious aggregators. However, secure aggregation often requires…

Cryptography and Security · Computer Science 2024-04-23 Xu Yang , Jiapeng Zhang , Qifeng Zhang , Zhuo Tang

As a signal recovery algorithm, compressed sensing is particularly useful when the data has low-complexity and samples are rare, which matches perfectly with the task of quantum phase estimation (QPE). In this work we present a new…

Quantum Physics · Physics 2025-01-01 Changhao Yi , Cunlu Zhou , Jun Takahashi

Sequential probability assignment and universal compression go hand in hand. We propose sequential probability assignment for non-binary (and large alphabet) sequences with empirical distributions whose parameters are known to be bounded…

Information Theory · Computer Science 2021-02-09 Michael Drmota , Gil Shamir , Wojciech Szpankowski

Genome sequencing is essential to decode genetic information, identify organisms, understand diseases and advance personalized medicine. A critical step in any genome sequencing technique is genome assembly. However, de novo genome…

De novo genome assembly, i.e., rebuilding the sequence of an unknown genome from redundant and erroneous short sequences, is a key but computationally intensive step in many genomics pipelines. The exponential growth of genomic data is…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-12 Giulia Guidi , Gabriel Raulet , Daniel Rokhsar , Leonid Oliker , Katherine Yelick , Aydin Buluc

Multimodal large language models suffer from severe computational and memory bottlenecks, as the number of visual tokens far exceeds that of textual tokens. While recent methods employ projector modules to align and compress visual tokens…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhongyang Li , Yaqian Li , Faming Fang , Rinyoichi Takezoe , Zi-Hao Bo , Cheng Qian , Mo Guang , Guixu Zhang , Kaiwen Long

High read depth can be used to assemble short sequence repeats. The existing genome assemblers fail in repetitive regions of longer than average read. I propose a new algorithm for a DNA assembly which uses the relative frequency of reads…

Genomics · Quantitative Biology 2015-01-08 Robert M. Nowak

De Bruijn graph is one of the most important data structures used in de-novo genome assembly algorithms, especially for NGS data. There is a growing need for parallel data structures and algorithms due to the increasing number of cores in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-08 Daniel Górniak , Robert Nowak

Unlike traditional distributed machine learning, federated learning stores data locally for training and then aggregates the models on the server, which solves the data security problem that may arise in traditional distributed machine…

Machine Learning · Computer Science 2023-01-02 Wan Jiang , Gang Liu , Xiaofeng Chen , Yipeng Zhou

The rapid growth of spatial data urges the research community to find efficient processing techniques for interactive queries on large volumes of data. Approximate Query Processing (AQP) is the most prominent technique that can provide…

Databases · Computer Science 2020-08-18 Tin Vu , Ahmed Eldawy

With small-scale quantum processors transitioning from experimental physics labs to industrial products, these processors allow us to efficiently compute important algorithms in various fields. In this paper, we propose a quantum algorithm…

Quantum Physics · Physics 2020-05-22 Aritra Sarkar , Zaid Al-Ars , Carmen G. Almudever , Koen Bertels

The recent super-exponential growth in the amount of sequencing data generated worldwide has put techniques for compressed storage into the focus. Most available solutions, however, are strictly tied to specific bioinformatics formats,…

Genomics · Quantitative Biology 2021-11-01 Łukasz Roguski , Paolo Ribeca

The paper introduces a new technique for compressing Binary Decision Diagrams in those cases where random access is not required. Using this technique, compression and decompression can be done in linear time in the size of the BDD and…

Artificial Intelligence · Computer Science 2008-12-18 Esben Rune Hansen , S. Srinivasa Rao , Peter Tiedemann

We present a new data structure called the \emph{Compressed Random Access Memory} (CRAM) that can store a dynamic string $T$ of characters, e.g., representing the memory of a computer, in compressed form while achieving asymptotically…

Data Structures and Algorithms · Computer Science 2015-03-17 Jesper Jansson , Kunihiko Sadakane , Wing-Kin Sung

Querying on big data is a challenging task due to the rapid growth of data amount. Approximate query processing (AQP) is a way to meet the requirement of fast response. In this paper, we propose a learning-based AQP method called the LAQP.…

Databases · Computer Science 2020-03-06 Meifan Zhang , Hongzhi Wang

Recent work identified the fundamental limits on the information requirements in terms of read length and coverage depth required for successful de novo genome reconstruction from shotgun sequencing data, based on the idealistic assumption…

Genomics · Quantitative Biology 2014-02-28 Ka-Kit Lam , Asif Khalak , David Tse

Motivation: Storage of genomic data is a major cost for the Life Sciences, effectively addressed mostly via specialized data compression methods. For the same reasons of abundance in data production, the use of Big Data technologies is seen…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-28 Umberto Ferraro Petrillo , Francesco Palini , Giuseppe Cattaneo , Raffaele Giancarlo

Compression techniques that support fast random access are a core component of any information system. Current state-of-the-art methods group documents into fixed-sized blocks and compress each block with a general-purpose adaptive…

Data Structures and Algorithms · Computer Science 2015-03-19 Christopher Hoobin , Simon J. Puglisi , Justin Zobel

The compression-complexity trade-off of lossy compression algorithms that are based on a random codebook or a random database is examined. Motivated, in part, by recent results of Gupta-Verd\'{u}-Weissman (GVW) and their underlying…

Information Theory · Computer Science 2009-04-23 Chris Gioran , Ioannis Kontoyiannis

In recent years, deep network pruning has attracted significant attention in order to enable the rapid deployment of AI into small devices with computation and memory constraints. Pruning is often achieved by dropping redundant weights,…

Machine Learning · Computer Science 2023-08-24 Enmao Diao , Ganghua Wang , Jiawei Zhan , Yuhong Yang , Jie Ding , Vahid Tarokh