English
Related papers

Related papers: DZip: improved general-purpose lossless compressio…

200 papers

We propose a novel method for compressed sensing recovery using untrained deep generative models. Our method is based on the recently proposed Deep Image Prior (DIP), wherein the convolutional weights of the network are optimized to match…

In the field of biological research, it is essential to comprehend the characteristics and functions of molecular sequences. The classification of molecular sequences has seen widespread use of neural network-based techniques. Despite their…

Machine Learning · Computer Science 2024-02-14 Sarwan Ali , Tamkanat E Ali , Prakash Chourasia , Murray Patterson

We explore an error-bounded lossy compression approach for reducing scientific data associated with 2D/3D unstructured meshes. While existing lossy compressors offer a high compression ratio with bounded error for regular grid data,…

Graphics · Computer Science 2024-04-04 Congrong Ren , Xin Liang , Hanqi Guo

Today's HPC applications are producing extremely large amounts of data, such that data storage and analysis are becoming more challenging for scientific research. In this work, we design a new error-controlled lossy compression algorithm…

Information Theory · Computer Science 2017-06-14 Dingwen Tao , Sheng Di , Zizhong Chen , Franck Cappello

Federated Learning marks a turning point in the implementation of decentralized machine learning (especially deep learning) for wireless devices by protecting users' privacy and safeguarding raw data from third-party access. It assigns the…

One of the most famous and investigated lossless data-compression scheme is the one introduced by Lempel and Ziv about 40 years ago. This compression scheme is known as "dictionary-based compression" and consists of squeezing an input…

Data Structures and Algorithms · Computer Science 2008-02-07 Paolo Ferragina , Igor Nitto , Rossano Venturini

The rapid growth of high-resolution scientific simulations and observation systems is generating massive spatiotemporal datasets, making efficient, error-bounded compression increasingly important. Meanwhile, decoder-only large language…

Machine Learning · Computer Science 2025-11-06 Guozhong Li , Muhannad Alhumaidi , Spiros Skiadopoulos , Panos Kalnis

Today's scientific simulations require a significant reduction of data volume because of extremely large amounts of data they produce and the limited I/O bandwidth and storage space. Error-bounded lossy compressor has been considered one of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-15 Xin Liang , Kai Zhao , Sheng Di , Sihuan Li , Robert Underwood , Ali M. Gok , Jiannan Tian , Junjing Deng , Jon C. Calhoun , Dingwen Tao , Zizhong Chen , Franck Cappello

Storing and archiving data produced by next-generation sequencing (NGS) is a huge burden for research institutions. Reference-based compression algorithms are effective in dealing with these data. Our work focuses on compressing FASTQ…

Information Theory · Computer Science 2024-04-04 Yuanjian Liu , Huihao Luo , Zhijun Han , Yao Hu , Yehui Yang , Kyle Chard , Sheng Di , Ian Foster , Jiesheng Wu

There is a lot of ongoing research effort into developing different techniques for neural networks compression. However, the community lacks standardised evaluation metrics, which are key to identifying the most suitable compression…

Machine Learning · Computer Science 2023-10-04 Abanoub Ghobrial , Samuel Budgett , Dieter Balemans , Hamid Asgari , Phil Reiter , Kerstin Eder

Current network data telemetry pipelines consist of massive streams of fine-grained Key Performance Indicators (KPIs) from multiple distributed sources towards central aggregators, making data storage, transmission, and real-time analysis…

Machine Learning · Computer Science 2026-03-23 Pietro Talli , Qi Liao , Alessandro Lieto , Parijat Bhattacharjee , Federico Chiariotti , Andrea Zanella

Recent efforts in neural compression have focused on the rate-distortion-perception (RDP) tradeoff, where the perception constraint ensures the source and reconstruction distributions are close in terms of a statistical divergence.…

Information Theory · Computer Science 2025-05-21 Eric Lei , Hamed Hassani , Shirin Saeedi Bidokhti

As high-performance computing architectures evolve, more scientific computing workflows are being deployed on advanced computing platforms such as GPUs. These workflows can produce raw data at extremely high throughputs, requiring urgent…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-03 Shixun Wu , Jinwen Pan , Jinyang Liu , Jiannan Tian , Ziwei Qiu , Jiajun Huang , Kai Zhao , Xin Liang , Sheng Di , Zizhong Chen , Franck Cappello

Past work has established scaling laws that predict the performance of a neural language model (LM) as a function of its parameter count and the number of tokens it's trained on, enabling optimal allocation of a fixed compute budget. Are…

Computation and Language · Computer Science 2024-05-28 Rohan Pandey

The large memory requirements of deep neural networks limit their deployment and adoption on many devices. Model compression methods effectively reduce the memory requirements of these models, usually through applying transformations such…

Machine Learning · Computer Science 2017-11-15 Brandon Reagen , Udit Gupta , Robert Adolf , Michael M. Mitzenmacher , Alexander M. Rush , Gu-Yeon Wei , David Brooks

DNNs have been quickly and broadly exploited to improve the data analysis quality in many complex science and engineering applications. Today's DNNs are becoming deeper and wider because of increasing demand on the analysis quality and more…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Sian Jin , Sheng Di , Xin Liang , Jiannan Tian , Dingwen Tao , Franck Cappello

Deep learning networks have become the de-facto standard in Computer Vision for industry and research. However, recent developments in their cousin, Natural Language Processing (NLP), have shown that there are areas where parameter-less…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Marco Scilipoti , Marina Fuster , Rodrigo Ramele

Today's scientific high performance computing (HPC) applications or advanced instruments are producing vast volumes of data across a wide range of domains, which introduces a serious burden on data transfer and storage. Error-bounded lossy…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-01 Xiaodong Yu , Sheng Di , Kai Zhao , jiannan Tian , Dingwen Tao , Xin Liang , Franck Cappello

Lossless model compression holds tremendous promise for alleviating the memory and bandwidth bottlenecks in bit-exact Large Language Model (LLM) serving. However, existing approaches often result in substantial inference slowdowns due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-19 Ruibo Fan , Xiangrui Yu , Xinglin Pan , Zeyu Li , Weile Luo , Qiang Wang , Wei Wang , Xiaowen Chu

The rapid expansion of computational capabilities and the ever-growing scale of modern HPC systems present formidable challenges in managing exascale scientific data. Faced with such vast datasets, traditional lossless compression…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-23 Wenqi Jia , Sian Jin , Jinzhen Wang , Wei Niu , Dingwen Tao , Miao Yin