English
Related papers

Related papers: Lessons Learned on the Path to Guaranteeing the Er…

200 papers

Today's scientific simulations, for example in the high-performance exascale sector, produce huge amounts of data. Due to limited I/O bandwidth and available storage space, there is the necessity to reduce scientific data of high…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-25 N. Böing , J. Holke , C. Hergl , L. Spataro , G. Gassner , A. Basermann

As high-performance computing architectures evolve, more scientific computing workflows are being deployed on advanced computing platforms such as GPUs. These workflows can produce raw data at extremely high throughputs, requiring urgent…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-03 Shixun Wu , Jinwen Pan , Jinyang Liu , Jiannan Tian , Ziwei Qiu , Jiajun Huang , Kai Zhao , Xin Liang , Sheng Di , Zizhong Chen , Franck Cappello

The problem of lossless data compression with side information available to both the encoder and the decoder is considered. The finite-blocklength fundamental limits of the best achievable performance are defined, in two different versions…

Information Theory · Computer Science 2021-02-23 Lampros Gavalakis , Ioannis Kontoyiannis

Lossy compression is one of the most important strategies to resolve the big science data issue, however, little work was done to make it resilient against silent data corruptions (SDC). In fact, SDC is becoming non-negligible because of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-08 Sihuan Li , Sheng Di , Kai Zhao , Xin Liang , Zizhong Chen , Franck Cappello

Error-bounded lossy compression is becoming more and more important to today's extreme-scale HPC applications because of the ever-increasing volume of data generated because it has been widely used in in-situ visualization, data stream…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-24 Baodi Shan , Aabid Shamji , Jiannan Tian , Guanpeng Li , Dingwen Tao

Error-controlled lossy compression has been studied for years because of extremely large volumes of data being produced by today's scientific simulations. None of existing lossy compressors, however, allow users to fix the peak…

Information Theory · Computer Science 2018-07-17 Dingwen Tao , Sheng Di , Xin Liang , Zizhong Chen , Franck Cappello

A deep learning system typically suffers from a lack of reproducibility that is partially rooted in hardware or software implementation details. The irreproducibility leads to skepticism in deep learning technologies and it can hinder them…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jiahao Pang , Muhammad Asad Lodhi , Junghyun Ahn , Yuning Huang , Dong Tian

Lossy compression is one of the most effective methods for reducing the size of scientific data containing multiple data fields. It reduces information density through prediction or transformation techniques to compress the data. Previous…

Machine Learning · Computer Science 2024-09-30 Youyuan Liu , Wenqi Jia , Taolue Yang , Miao Yin , Sian Jin

The rapid growth of digital data has heightened the demand for efficient lossless compression methods. However, existing algorithms exhibit trade-offs: some achieve high compression ratios, others excel in encoding or decoding speed, and…

Information Theory · Computer Science 2025-10-01 Md. Atiqur Rahman , MM Fazle Rabbi

In scientific simulations, observations, and experiments, the cost of transferring data to and from disk and across networks has become a significant bottleneck that particularly impacts subsequent data analysis and visualization. To…

Databases · Computer Science 2023-08-24 Victor A. P. Magri , Peter Lindstrom

The so-called "threshold" theorem says that, once the error rate per qubit per gate is below a certain value, indefinitely long quantum computation becomes feasible, even if all of the qubits involved are subject to relaxation processes,…

Quantum Physics · Physics 2007-06-13 M. I. Dyakonov

We calculate the error threshold for the linear optics quantum computing proposal by Knill, Laflamme and Milburn [Nature 409, pp. 46--52 (2001)] under an error model where photon detectors have efficiency <100% but all other components --…

Quantum Physics · Physics 2023-11-27 Marcus Silva , Martin Roetteler , Christof Zalka

The growing popularity of Large Language Models has sparked interest in context compression for Large Language Models (LLMs). However, the performance of previous methods degrades dramatically as compression ratios increase, sometimes even…

Computation and Language · Computer Science 2024-06-18 Zhiwei Cao , Qian Cao , Yu Lu , Ningxin Peng , Luyang Huang , Shanbo Cheng , Jinsong Su

Error-bounded lossy compression is a critical technique for significantly reducing scientific data volumes. Compared to CPU-based compressors, GPU-based compressors exhibit substantially higher throughputs, fitting better for today's HPC…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-02 Jinyang Liu , Jiannan Tian , Shixun Wu , Sheng Di , Boyuan Zhang , Robert Underwood , Yafan Huang , Jiajun Huang , Kai Zhao , Guanpeng Li , Dingwen Tao , Zizhong Chen , Franck Cappello

Data compression is becoming critical for storing scientific data because many scientific applications need to store large amounts of data and post process this data for scientific discovery. Unlike image and video compression algorithms…

Machine Learning · Computer Science 2022-12-22 Tania Banerjee , Jong Choi , Jaemoon Lee , Qian Gong , Jieyang Chen , Scott Klasky , Anand Rangarajan , Sanjay Ranka

Fault-tolerant schemes can use error correction to make a quantum computation arbitrarily ac- curate, provided that errors per physical component are smaller than a certain threshold and in- dependent of the computer size. However in…

Quantum Physics · Physics 2022-02-24 Marco Fellous-Asiani , Jing Hao Chai , Robert S. Whitney , Alexia Auffèves , Hui Khoon Ng

Today's large-scale scientific applications running on high-performance computing (HPC) systems generate vast data volumes. Thus, data compression is becoming a critical technique to mitigate the storage burden and data-movement cost.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-04 Boyuan Zhang , Jiannan Tian , Sheng Di , Xiaodong Yu , Yunhe Feng , Xin Liang , Dingwen Tao , Franck Cappello

Understanding the power of quantum data in machine learning is central to many proposed applications of quantum technologies. While access to quantum data can offer exponential advantages for carefully designed learning tasks and often…

Quantum Physics · Physics 2026-02-24 Armando Angrisani , Brian Coyle , Elham Kashefi

Most data is automatically collected and only ever "seen" by algorithms. Yet, data compressors preserve perceptual fidelity rather than just the information needed by algorithms performing downstream tasks. In this paper, we characterize…

Machine Learning · Computer Science 2022-01-31 Yann Dubois , Benjamin Bloem-Reddy , Karen Ullrich , Chris J. Maddison

The inevitable accumulation of errors in near-future quantum devices represents a key obstacle in delivering practical quantum advantages, motivating the development of various quantum error-mitigation methods. Here, we derive fundamental…

Quantum Physics · Physics 2022-09-23 Ryuji Takagi , Suguru Endo , Shintaro Minagawa , Mile Gu