English
Related papers

Related papers: A Prediction-Traversal Approach for Compressing Sc…

200 papers

Efficient lossless compression is essential for minimizing storage costs and transmission overhead while preserving data integrity. Traditional compression techniques, such as dictionary-based and statistical methods, often struggle to…

Artificial Intelligence · Computer Science 2026-02-13 Mahdi Khodabandeh , Ghazal Shabani , Arash Yousefi Jordehi , Seyed Abolghasem Mirroshandel

Data used for analytics and machine learning often take the form of tables with categorical entries. We introduce a family of lossless compression algorithms for such data that proceed in four steps: $(i)$ Estimate latent variables…

Information Theory · Computer Science 2023-02-21 Andrea Montanari , Eric Weiner

Deep learning accelerators efficiently train over vast and growing amounts of data, placing a newfound burden on commodity networks and storage devices. A common approach to conserve bandwidth involves resizing or compressing data prior to…

Machine Learning · Computer Science 2021-08-13 Michael Kuchnik , George Amvrosiadis , Virginia Smith

Nowadays, with the rapid development of the Internet, the era of big data has come. The Internet generates huge amounts of data every day. However, extracting meaningful information from massive data is like looking for a needle in a…

Artificial Intelligence · Computer Science 2022-12-21 Xinhong Chen , Wensheng Gan , Shicheng Wan , Tianlong Gu

This paper introduces a novel technique to preserve spectral features in lossy compression based on a novel fast Fourier correction algorithm\added{ for regular-grid data}. Preserving both spatial and frequency representations of data is…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-06 Congrong Ren , Robert Underwood , Sheng Di , Emrecan Kutay , Zarija Lukic , Aylin Yener , Franck Cappello , Hanqi Guo

Modern data analyses frequently encounter settings where samples of variables are contaminated by measurement error. Ignoring measurement noise can substantially degrade statistical inference, while existing correction techniques are often…

Methodology · Statistics 2026-04-15 Ritwik Vashistha , Jeff M. Phillips , Abhra Sarkar , Arya Farahi

Magnetic Resonance Spectroscopic Imaging (MRSI) is a powerful tool for non-invasive mapping of brain metabolites, providing critical insights into neurological conditions. However, its utility is often limited by missing or corrupted data…

Image and Video Processing · Electrical Eng. & Systems 2025-05-13 Tan-Hanh Pham , Ovidiu C. Andronesi , Xianqi Li , Kim-Doang Nguyen

A new approach to data compression is developed and applied to multimedia content. This method separates messages into components suitable for both lossless coding and 'lossy' or statistical coding techniques, compressing complex objects by…

Information Theory · Computer Science 2011-12-26 John Scoville

Lossy compression, widely used by scientists to reduce data from simulations, experiments, and observations, can distort features of interest even under bounded error. Such distortions may compromise downstream analyses and lead to…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-06 Yuxiao Li , Mingze Xia , Xin Liang , Bei Wang , Robert Underwood , Sheng Di , Hemant Sharma , Dishant Beniwal , Franck Cappello , Hanqi Guo

Error-bounded lossy compression has been regarded as a promising way to address the ever-increasing amount of scientific data in today's high-performance computing systems. Pre-quantization, a critical technique to remove sequential…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-24 Pu Jiao , Sheng Di , Jiannan Tian , Mingze Xia , Xuan Wu , Yang Zhang , Xin Liang , Franck Cappello

The evolution of parallel I/O library as well as new concepts such as 'in transit' and 'in situ' visualization and analysis have been identified as key technologies to circumvent I/O bottleneck in pre-exascale applications. Nevertheless,…

Instrumentation and Methods for Astrophysics · Physics 2022-09-13 Loïc Strafella , Damien Chapon

The extensive adoption of Deep Neural Networks has led to their increased utilization in challenging scientific visualization tasks. Recent advancements in building compressed data models using implicit neural representations have shown…

Machine Learning · Computer Science 2025-10-20 Abhay Kumar Dwivedi , Shanu Saklani , Soumya Dutta

Overparameterized models have proven to be powerful tools for solving various machine learning tasks. However, overparameterization often leads to a substantial increase in computational and memory costs, which in turn requires extensive…

Machine Learning · Computer Science 2024-03-13 Soo Min Kwon , Zekai Zhang , Dogyoon Song , Laura Balzano , Qing Qu

Machine Learning models should ideally be compact and robust. Compactness provides efficiency and comprehensibility whereas robustness provides resilience. Both topics have been studied in recent years but in isolation. Here we present a…

Machine Learning · Computer Science 2021-03-16 Omri Armstrong , Ran Gilad-Bachrach

The ever-increasing parameter counts of deep learning models necessitate effective compression techniques for deployment on resource-constrained devices. This paper explores the application of information geometry, the study of…

Machine Learning · Computer Science 2025-07-15 Zakhar Shumaylov , Vasileios Tsiaras , Yannis Stylianou

This work considers an estimation task in compressive sensing, where the goal is to estimate an unknown signal from compressive measurements that are corrupted by additive pre-measurement noise (interference, or clutter) as well as…

Machine Learning · Statistics 2013-11-25 Swayambhoo Jain , Akshay Soni , Jarvis Haupt

Over the last few years, machine learning unlocked previously infeasible features for compression, such as providing guarantees for users' privacy or tailoring compression to specific data statistics (e.g., satellite images or audio…

Information Theory · Computer Science 2026-03-25 Gergely Flamich

Storage-efficient privacy-preserving learning is crucial due to increasing amounts of sensitive user data required for modern learning tasks. We propose a framework for reducing the storage cost of user data while at the same time providing…

Information Theory · Computer Science 2023-03-23 Berivan Isik , Tsachy Weissman

Lossless compression techniques are crucial in an era of rapidly growing data. Traditional universal compressors like gzip offer low computational overhead, high speed, and broad applicability across data distributions. However, they often…

Computation and Language · Computer Science 2025-11-17 Qihang Zhang , Muchen Li , Ziao Wang , Renjie Liao , Lele Wang

Most of the world's digital data is currently encoded in a sequential form, and compression methods for sequences have been studied extensively. However, there are many types of non-sequential data for which good compression techniques are…

Information Theory · Computer Science 2016-01-15 Christian Steinruecken