English
Related papers

Related papers: Enhancing ZFP: A Statistical Approach to Understan…

200 papers

Topological descriptors such as contour trees are widely utilized in scientific data analysis and visualization, with applications from materials science to climate simulations. It is desirable to preserve topological descriptors when data…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-13 Nathaniel Gorski , Xin Liang , Hanqi Guo , Lin Yan , Bei Wang

It is nontrivial to store rapidly growing big data nowadays, which demands high-performance lossless compression techniques. Likelihood-based generative models have witnessed their success on lossless compression, where flow based models…

Machine Learning · Computer Science 2021-11-02 Shifeng Zhang , Chen Zhang , Ning Kang , Zhenguo Li

The next-generation radio astronomy instruments are providing a massive increase in sensitivity and coverage, through increased stations in the array and frequency span. Two primary problems encountered when processing the resultant…

Instrumentation and Methods for Astrophysics · Physics 2025-07-30 Richard Dodson , Alex Williamson , Qian Gong , Pascal Elahi , Andreas Wicenec , Maria J. Rioja , Jieyang Chen , Norbert Podhorszki , Scott Klasky , Martin Meyer

Error-bounded lossy compression has been widely adopted in many scientific domains because it can address the challenges in storing, transferring, and analyzing unprecedented amounts of scientific data. Although error-bounded lossy…

Databases · Computer Science 2025-07-15 Jinyang Liu , Pu Jiao , Kai Zhao , Xin Liang , Sheng Di , Franck Cappello

Machine-generated data is rapidly growing and poses challenges for data-intensive systems, especially as the growth of data outpaces the growth of storage space. To cope with the storage issue, compression plays a critical role in storage…

Databases · Computer Science 2023-11-27 Jiujing Zhang , Zhitao Shen , Shiyu Yang , Lingkai Meng , Chuan Xiao , Wei Jia , Yue Li , Qinhui Sun , Wenjie Zhang , Xuemin Lin

While neural lossy compression techniques have markedly advanced the efficiency of Channel State Information (CSI) compression and reconstruction for feedback in MIMO communications, efficient algorithms for more challenging and practical…

Errors in floating-point programs can lead to severe consequences, particularly in critical domains such as military, aerospace, and financial systems, making their repair a crucial research problem. In practice, some errors can be fixed…

Software Engineering · Computer Science 2025-10-14 Youshuai Tan , Zishuo Ding , Jinfu Chen , Weiyi Shang

At the present scenario of the internet, there exist many optimization techniques to improve the Web speed but almost expensive in terms of bandwidth. So after a long investigation on different techniques to compress the data without any…

Information Theory · Computer Science 2014-05-20 Hemant Kumar Saini , Satpal Singh Kushwaha , C. Rama Krishna

Many information systems employ lossy compression as a crucial intermediate stage among other processing components. While the important distortion is defined by the system's input and output signals, the compression usually ignores the…

Information Theory · Computer Science 2018-05-14 Yehuda Dar , Michael Elad , Alfred M. Bruckstein

Lossless compression techniques are crucial in an era of rapidly growing data. Traditional universal compressors like gzip offer low computational overhead, high speed, and broad applicability across data distributions. However, they often…

Computation and Language · Computer Science 2025-11-17 Qihang Zhang , Muchen Li , Ziao Wang , Renjie Liao , Lele Wang

We study the problem of compressing a source sequence in the presence of side-information that is related to the source via insertions, deletions and substitutions. We propose a simple algorithm to compress the source sequence when the…

Information Theory · Computer Science 2016-11-15 Nan Ma , Kannan Ramchandran , David Tse

The task of compression of data -- as stated by the source coding theorem -- is one of the cornerstones of information theory. Data compression usually exploits statistical redundancies in the data according to its prior distribution.…

Quantum Physics · Physics 2021-01-08 Matheus Capela , Fabio Costa

The fast growth of computational power and scales of modern super-computing systems have raised great challenges for the management of exascale scientific data. To maintain the usability of scientific data, error-bound lossy compression is…

Machine Learning · Computer Science 2023-11-08 Jinyang Liu , Sheng Di , Sian Jin , Kai Zhao , Xin Liang , Zizhong Chen , Franck Cappello

Random Number Generators play a critical role in a number of important applications. In practice, statistical testing is employed to gather evidence that a generator indeed produces numbers that appear to be random. In this paper, we…

Computational Complexity · Computer Science 2010-03-25 Weiling Chang , Binxing Fang , Xiaochun Yun , Shupeng Wang , Xiangzhan Yu

Data is the cornerstone of large language models (LLMs), but not all data is useful for model learning. Carefully selected data can better elicit the capabilities of LLMs with much less computational overhead. Most methods concentrate on…

Machine Learning · Computer Science 2024-07-12 Mingjia Yin , Chuhan Wu , Yufei Wang , Hao Wang , Wei Guo , Yasheng Wang , Yong Liu , Ruiming Tang , Defu Lian , Enhong Chen

We consider a wireless node that randomly receives data from different sensor units. The arriving data must be compressed, stored, and transmitted over a wireless link, where both the compression and transmission operations consume power.…

Optimization and Control · Mathematics 2008-07-25 Michael J. Neely , Abhishek Sharma

Handling digital images is almost always accompanied by a lossy compression in order to facilitate efficient transmission and storage. This introduces an unavoidable tension between the allocated bit-budget (rate) and the faithfulness of…

Image and Video Processing · Electrical Eng. & Systems 2020-08-04 Xiyang Luo , Hossein Talebi , Feng Yang , Michael Elad , Peyman Milanfar

The modern practice of Radio Astronomy is characterized by extremes of data volume and rates, principally because of the direct relationship between the signal to noise ratio that can be achieved and the need to Nyquist sample the RF…

Information Theory · Computer Science 2014-05-23 Tim Natusch

In response to the rapidly escalating costs of computing with large matrices and tensors caused by data movement, several lossy compression methods have been developed to significantly reduce data volumes. Unfortunately, all these methods…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-18 Tripti Agarwal , Harvey Dam , Dorra Ben Khalifa , Matthieu Martel , P. Sadayappan , Ganesh Gopalakrishnan

We analyze the effect of lossy compression in the processing of sensor signals that must be used to detect anomalous events in the system under observation. The intuitive relationship between the quality loss at higher compression and the…

Information Theory · Computer Science 2024-10-28 Alex Marchioni , Andriy Enttsel , Mauro Mangia , Riccardo Rovatti , Gianluca Setti