English
Related papers

Related papers: Compression of next-generation sequencing reads ai…

200 papers

We introduce and analyze a dispersive qubit readout scheme where two-mode squeezing is generated directly in the measurement cavities. The resulting suppression of noise enables fast, high- fidelity readout of naturally weakly coupled…

Quantum Physics · Physics 2017-06-06 Luke C. G. Govia , Aashish A. Clerk

Motivation: High-throughput sequencing (HTS) enables population-scale genomics but generates massive datasets, creating bottlenecks in storage, transfer, and analysis. FASTQ, the standard format for over two decades, stores one byte per…

Aggregating data is fundamental to data analytics, data exploration, and OLAP. Approximate query processing (AQP) techniques are often used to accelerate computation of aggregates using samples, for which confidence intervals (CIs) are…

Error-bounded lossy compression has been a critical technique to significantly reduce the sheer amounts of simulation datasets for high-performance computing (HPC) scientific applications while effectively controlling the data distortion…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-23 Tripti Agarwal , Sheng Di , Jiajun Huang , Yafan Huang , Ganesh Gopalakrishnan , Robert Underwood , Kai Zhao , Xin Liang , Guanpeng Li , Franck Cappello

Relational datasets are being generated at an alarmingly rapid rate across organizations and industries. Compressing these datasets could significantly reduce storage and archival costs. Traditional compression algorithms, e.g., gzip, are…

Databases · Computer Science 2016-06-21 Yihan Gao , Aditya Parameswaran

Bit arrays, or bitmaps, are used to significantly speed up set operations in several areas, such as data warehousing, information retrieval, and data mining, to cite a few. However, bitmaps usually use a large storage space, thus requiring…

Data Structures and Algorithms · Computer Science 2015-03-14 Alessandro Colantonio , Roberto Di Pietro

Approximate query processing (AQP) is an interesting alternative for exact query processing. It is a tool for dealing with the huge data volumes where response time is more important than perfect accuracy (this is typically the case during…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-11 Witold Andrzejewski , Artur Gramacki , Jarosław Gramacki

We present simple and efficient algorithms for calculating $q$-gram frequencies on strings represented in compressed form, namely, as a straight line program (SLP). Given an SLP of size $n$ that represents string $T$, we present an $O(qn)$…

Data Structures and Algorithms · Computer Science 2011-07-14 Keisuke Goto , Hideo Bannai , Shunsuke Inenaga , Masayuki Takeda

We propose a new compression scheme for genomic data given as sequence fragments called reads. The scheme uses a reference genome at the decoder side only, freeing the encoder from the burdens of storing references and performing…

Information Theory · Computer Science 2023-02-10 Yotam Gershon , Yuval Cassuto

The paper introduces a new lossless, highly robust compression algorithm that similar with LZW algorithm, yet the algorithm discards dictionary processing and uses irregular sequences with massive, random information instead. Then the paper…

Signal Processing · Electrical Eng. & Systems 2020-06-24 Rui Zhu

In this work, we propose an extreme compression technique for Large Multimodal Models (LMMs). While previous studies have explored quantization as an efficient post-training compression method for Large Language Models (LLMs), low-bit…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Mohsen Gholami , Mohammad Akbari , Kevin Cannons , Yong Zhang

Motivation: High-coverage sequencing data have significant, yet hard to exploit, redundancy. Most FASTQ compressors cannot efficiently compress the DNA stream of large datasets, since the redundancy between overlapping reads cannot be…

Data Structures and Algorithms · Computer Science 2014-09-19 Szymon Grabowski , Sebastian Deorowicz , Łukasz Roguski

While neural lossy compression techniques have markedly advanced the efficiency of Channel State Information (CSI) compression and reconstruction for feedback in MIMO communications, efficient algorithms for more challenging and practical…

This thesis concerns sequential-access data compression, i.e., by algorithms that read the input one or more times from beginning to end. In one chapter we consider adaptive prefix coding, for which we must read the input character by…

Information Theory · Computer Science 2009-02-03 Travis Gagie

Deep sequencing has enabled the investigation of a wide range of environmental microbial ecosystems, but the high memory requirements for {\em de novo} assembly of short-read shotgun sequencing data from these complex populations are an…

Genomics · Quantitative Biology 2015-06-03 Jason Pell , Arend Hintze , Rosangela Canino-Koning , Adina Howe , James M. Tiedje , C. Titus Brown

We propose a novel method for compressed sensing recovery using untrained deep generative models. Our method is based on the recently proposed Deep Image Prior (DIP), wherein the convolutional weights of the network are optimized to match…

Superconducting qubits are among the most promising candidates for building quantum information processors. Yet, they are often limited by slow and error-prone qubit readout -- a critical factor in achieving high-fidelity operations. While…

Quantum Physics · Physics 2025-09-22 Xiaorang Guo , Tigran Bunarjyan , Dai Liu , Benjamin Lienhard , Martin Schulz

We examine information loss, resource costs, and run time from practical application of quantum data compression. Compressing quantum data to fewer qubits enables efficient use of resources, as well as applications for quantum communication…

We introduce collapsed compilation, a novel approximate inference algorithm for discrete probabilistic graphical models. It is a collapsed sampling algorithm that incrementally selects which variable to sample next based on the partial…

Artificial Intelligence · Computer Science 2018-06-01 Tal Friedman , Guy Van den Broeck

One of the most computationally intensive tasks in computational biology is de novo genome assembly, the decoding of the sequence of an unknown genome from redundant and erroneous short sequences. A common assembly paradigm identifies…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-21 Giulia Guidi , Oguz Selvitopi , Marquita Ellis , Leonid Oliker , Katherine Yelick , Aydin Buluc