English
Related papers

Related papers: FastqZip: An Improved Reference-Based Genome Seque…

200 papers

This thesis concerns sequential-access data compression, i.e., by algorithms that read the input one or more times from beginning to end. In one chapter we consider adaptive prefix coding, for which we must read the input character by…

Information Theory · Computer Science 2009-02-03 Travis Gagie

In order to overcome the limitations imposed by DNA barcoding when multiplexing a large number of samples in the current generation of high-throughput sequencing instruments, we have recently proposed a new protocol that leverages advances…

Quantitative Methods · Quantitative Biology 2013-08-02 Denisa Duma , Mary Wootters , Anna C. Gilbert , Hung Q. Ngo , Atri Rudra , Matthew Alpert , Timothy J. Close , Gianfranco Ciardo , Stefano Lonardi

While the language modeling objective has been shown to be deeply connected with compression, it is surprising that modern LLMs are not employed in practical text compression systems. In this paper, we provide an in-depth analysis of neural…

Computation and Language · Computer Science 2024-09-26 Fazal Mittu , Yihuan Bu , Akshat Gupta , Ashok Devireddy , Alp Eren Ozdarendeli , Anant Singh , Gopala Anumanchipalli

Quantum computing promises an effective way to solve targeted problems that are classically intractable. Among them, quantum computers built with superconducting qubits are considered one of the most advanced technologies, but they suffer…

Hardware Architecture · Computer Science 2024-01-03 Xiaorang Guo , Kun Qin , Martin Schulz

High throughput technologies have become the practice of choice for comparative studies in biomedical applications. Limited number of sample points due to sequencing cost or access to organisms of interest necessitates the development of…

Methodology · Statistics 2018-07-17 Ariana Broumand , Siamak Zamani Dadaneh

In scientific fields such as quantum computing, physics, chemistry, and machine learning, high dimensional data are typically represented using sparse tensors. Tensor contraction is a popular operation on tensors to exploit meaning or alter…

Data Structures and Algorithms · Computer Science 2024-10-15 Andrew Ensinger , Gabriel Kulp , Victor Agostinelli , Dennis Lyakhov , Lizhong Chen

Text retrieval using learned sparse representations of queries and documents has, over the years, evolved into a highly effective approach to search. It is thanks to recent advances in approximate nearest neighbor search-with the emergence…

Information Retrieval · Computer Science 2026-02-06 Sebastian Bruch , Martino Fontana , Franco Maria Nardini , Cosimo Rulli , Rossano Venturini

Error-bounded lossy compression is a critical technique for significantly reducing scientific data volumes. Compared to CPU-based compressors, GPU-based compressors exhibit substantially higher throughputs, fitting better for today's HPC…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-02 Jinyang Liu , Jiannan Tian , Shixun Wu , Sheng Di , Boyuan Zhang , Robert Underwood , Yafan Huang , Jiajun Huang , Kai Zhao , Guanpeng Li , Dingwen Tao , Zizhong Chen , Franck Cappello

This work focus on how to stabilize and lossless model compression, aiming to reduce model complexity and enhance efficiency without sacrificing performance due to compression errors. A key challenge is effectively leveraging compression…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Boyang Zhang , Daning Cheng , Yunquan Zhang , Fangming Liu , Wenguang Chen

The problem of fast items retrieval from a fixed collection is often encountered in most computer science areas, from operating system components to databases and user interfaces. We present an approach based on hash tables that focuses on…

Neural and Evolutionary Computing · Computer Science 2020-07-17 Dan Domnita , Ciprian Oprisa

The Lempel--Ziv 78 (LZ78) factorization is a well-studied technique for data compression. It and its derivatives are used in compression formats such as "compress" or "gif". Although most research focuses on the factorization of plain data,…

Data Structures and Algorithms · Computer Science 2025-12-22 Hiroki Shibata , Dominik Köppl

High-energy, large-scale particle colliders in nuclear and high-energy physics generate data at extraordinary rates, reaching up to $1$ terabyte and several petabytes per second, respectively. The development of real-time, high-throughput…

Artificial Intelligence · Computer Science 2024-12-03 Xihaier Luo , Samuel Lurvey , Yi Huang , Yihui Ren , Jin Huang , Byung-Jun Yoon

Grammar-based compression is a popular and powerful approach to compressing repetitive texts but until recently its relatively poor time-space trade-offs during real-life construction made it impractical for truly massive datasets such as…

Data Structures and Algorithms · Computer Science 2020-07-21 Travis Gagie , Tomohiro I , Giovanni Manzini , Gonzalo Navarro , Hiroshi Sakamoto , Louisa Seelbach Benkner , Yoshimasa Takabatake

Traditional lossless text compression preserves every byte, but its gains on natural language are often modest in realistic operating regimes. We study \emph{lossy semantic text compression}, where the encoder strategically deletes parts of…

Computation and Language · Computer Science 2026-05-29 Yuchun Zou , Junhong Tong , Jun Li

Quantization is a widely used technique to compress and accelerate deep neural networks. However, conventional quantization methods use the same bit-width for all (or most of) the layers, which often suffer significant accuracy degradation…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Weihan Chen , Peisong Wang , Jian Cheng

Increasing data volumes from scientific simulations and instruments (supercomputers, accelerators, telescopes) often exceed network, storage, and analysis capabilities. The scientific community's response to this challenge is scientific…

Research techniques in the last decade have improved lossless compression ratios by significantly increasing processing time. These techniques have remained obscure because production systems require high throughput and low resource…

Error-bounded lossy compression has been identified as a promising solution for significantly reducing scientific data volumes upon users' requirements on data distortion. For the existing scientific error-bounded lossy compressors, some of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-26 Jinyang Liu , Sheng Di , Kai Zhao , Xin Liang , Sian Jin , Zizhe Jian , Jiajun Huang , Shixun Wu , Zizhong Chen , Franck Cappello

Deep learning-based lossless compression methods offer substantial advantages in compressing medical volumetric images. Nevertheless, many learning-based algorithms encounter a trade-off between practicality and compression performance.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-29 Qianhao Chen , Jietao Chen

Model compression has emerged as a mainstream solution to reduce memory usage and computational overhead. This paper presents Group Quantization and Sparse Acceleration (GQSA), a novel compression technique tailored for LLMs. Traditional…

Machine Learning · Computer Science 2025-07-29 Chao Zeng , Songwei Liu , Shu Yang , Fangmin Chen , Lean Fu , Xing Mei