English
Related papers

Related papers: Optimizing Huffman Decoding for Error-Bounded Loss…

200 papers

Today's exponentially increasing data volumes and the high cost of storage make compression essential for the Big Data industry. Although research has concentrated on efficient compression, fast decompression is critical for analytics…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-03 Evangelia Sitaridi , Rene Mueller , Tim Kaldewey , Guy Lohman , Kenneth Ross

The JPEG compression format has been the standard for lossy image compression for over multiple decades, offering high compression rates at minor perceptual loss in image quality. For GPU-accelerated computer vision and deep learning tasks,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-18 André Weißenberger , Bertil Schmidt

Neural networks are both computationally intensive and memory intensive, making them difficult to deploy on embedded systems with limited hardware resources. To address this limitation, we introduce "deep compression", a three stage…

Computer Vision and Pattern Recognition · Computer Science 2016-02-16 Song Han , Huizi Mao , William J. Dally

The fast growth of computational power and scales of modern super-computing systems have raised great challenges for the management of exascale scientific data. To maintain the usability of scientific data, error-bound lossy compression is…

Machine Learning · Computer Science 2023-11-08 Jinyang Liu , Sheng Di , Sian Jin , Kai Zhao , Xin Liang , Zizhong Chen , Franck Cappello

Data compression and decompression have become vital components of big-data applications to manage the exponential growth in the amount of data collected and stored. Furthermore, big-data applications have increasingly adopted GPUs due to…

Modern scientific simulations and instruments generate data volumes that overwhelm memory and storage, throttling scalability. Lossy compression mitigates this by trading controlled error for reduced footprint and throughput gains, yet…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-26 Skyler Ruiter , Jiannan Tian , Fengguang Song

Hypergraphs provide a natural representation for many-to-many relationships in data-intensive applications, yet their scalability is often hindered by high memory consumption. While prior work has improved computational efficiency, reducing…

Data Structures and Algorithms · Computer Science 2025-06-23 Tianyu Zhao , Dongfang Zhao , Luanzheng Guo , Nathan Tallent

Lossy compression is one of the most important strategies to resolve the big science data issue, however, little work was done to make it resilient against silent data corruptions (SDC). In fact, SDC is becoming non-negligible because of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-08 Sihuan Li , Sheng Di , Kai Zhao , Xin Liang , Zizhong Chen , Franck Cappello

To help understand our universe better, researchers and scientists currently run extreme-scale cosmology simulations on leadership supercomputers. However, such simulations can generate large amounts of scientific data, which often result…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-06 Sian Jin , Pascal Grosset , Christopher M. Biwer , Jesus Pulido , Jiannan Tian , Dingwen Tao , James Ahrens

The torrential influx of floating-point data from domains like IoT and HPC necessitates high-performance lossless compression to mitigate storage costs while preserving absolute data fidelity. Leveraging GPU parallelism for this task…

Databases · Computer Science 2025-11-12 Zheng Li , Weiyan Wang , Ruiyuan Li , Chao Chen , Xianlei Long , Linjiang Zheng , Quanqing Xu , Chuanhui Yang

Compression is a technique to reduce the quantity of data without excessively reducing the quality of the multimedia data. The transition and storing of compressed multimedia data is much faster and more efficient than original uncompressed…

Information Theory · Computer Science 2011-09-02 Asadollah Shahbahrami , Ramin Bahrampour , Mobin Sabbaghi Rostami , Mostafa Ayoubi Mobarhan

Lossy compression, widely used by scientists to reduce data from simulations, experiments, and observations, can distort features of interest even under bounded error. Such distortions may compromise downstream analyses and lead to…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-06 Yuxiao Li , Mingze Xia , Xin Liang , Bei Wang , Robert Underwood , Sheng Di , Hemant Sharma , Dishant Beniwal , Franck Cappello , Hanqi Guo

The performance of the GMRES iterative solver on GPUs is limited by the GPU main memory bandwidth. Compressed Basis GMRES outperforms GMRES by storing the Krylov basis in low precision, thereby reducing the memory access. An open question…

Performance · Computer Science 2024-09-25 Thomas Grützmacher , Robert Underwood , Sheng Di , Franck Cappello , Hartwig Anzt

Lossy compression is one of the most efficient solutions to reduce storage overhead and improve I/O performance for HPC applications. However, existing parallel I/O libraries cannot fully utilize lossy compression to accelerate parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-30 Sian Jin , Dingwen Tao , Houjun Tang , Sheng Di , Suren Byna , Zarija Lukic , Franck Cappello

With endless amounts of data and very limited bandwidth, fast data compression is one solution for the growing datasharing problem. Compression helps lower transfer times and save memory, but if the compression takes too long, this no…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-21 David Noel , Elizabeth Graham , Liyuan Liu

Because of the vast volume of data being produced by today's scientific simulations, lossy compression allowing user-controlled information loss can significantly reduce the data size and the I/O burden. However, for large-scale cosmology…

Information Theory · Computer Science 2017-08-08 Dingewn Tao , Sheng Di , Zizhong Chen , Franck Cappello

This research explores a novel paradigm for preserving topological segmentations in existing error-bounded lossy compressors. Today's lossy compressors rarely consider preserving topologies such as Morse-Smale complexes, and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-08 Yuxiao Li , Xin Liang , Bei Wang , Yongfeng Qiu , Lin Yan , Hanqi Guo

With the promise of federated learning (FL) to allow for geographically-distributed and highly personalized services, the efficient exchange of model updates between clients and servers becomes crucial. FL, though decentralized, often faces…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-25 Grant Wilkins , Sheng Di , Jon C. Calhoun , Zilinghan Li , Kibaek Kim , Robert Underwood , Richard Mortier , Franck Cappello

As deep learning models grow and deployment becomes more widespread, reducing the storage and transmission costs of neural network weights has become increasingly important. While prior work such as ZipNN has shown that lossless compression…

Machine Learning · Computer Science 2025-08-28 Anat Heilper , Doron Singer

This paper presents a computationally efficient implementation of a Hamming code decoder on a graphics processing unit (GPU) to support real-time software-defined radio (SDR), which is a software alternative for realizing wireless…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-12-23 Shohidul Islam , Cheol-Hong Kim , Jong-Myon Kim