English
Related papers

Related papers: TopoSZp: Lightweight Topology-Aware Error-controll…

200 papers

Lossy compression is one of the most efficient solutions to reduce storage overhead and improve I/O performance for HPC applications. However, existing parallel I/O libraries cannot fully utilize lossy compression to accelerate parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-30 Sian Jin , Dingwen Tao , Houjun Tang , Sheng Di , Suren Byna , Zarija Lukic , Franck Cappello

In the last few decades, research techniques have improved lossless compression ratios by significantly increasing processing time. However, these techniques have not gained popularity in industry because production systems require high…

The implementation of modern monitoring systems for power quality disturbances have the potential to generate substantial amounts of data, reaching a point where transmission and storage of high-frequency measurements become impractical.…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Markus Stroot , Stefan Seiler , Philipp Lutat , Andreas Ulbig

Light-field fluorescence microscopy (LFM) is a powerful elegant compact method for long-term high-speed imaging of complex biological systems, such as neuron activities and rapid movements of organelles. LFM experiments typically generate…

Image and Video Processing · Electrical Eng. & Systems 2023-10-17 Changqing Su , Zihan Lin , You Zhou , Shuai Wang , Yuhan Gao , Chenggang Yan , Bo Xiong

Statistical procedures rarely retain all features of the observed data. A sufficient statistic removes information irrelevant to a parameter; a maximum likelihood estimate compresses an empirical objective into an optimizing point; and a…

Methodology · Statistics 2026-05-27 Yuan-chin Ivan Chang

Geometric data pruning methods, while practical for leveraging pretrained models, are fundamentally unstable. Their reliance on extrinsic geometry renders them highly sensitive to latent space perturbations, causing performance to degrade…

Machine Learning · Computer Science 2026-05-11 Arjun Roy , Prajna G. Malettira , Manish Nagaraj , Kaushik Roy

This paper introduces matrix product state (MPS) decomposition as a new and systematic method to compress multidimensional data represented by higher-order tensors. It solves two major bottlenecks in tensor compression: computation and…

Machine Learning · Statistics 2017-08-02 Johann A. Bengua , Ho N. Phien , Hoang D. Tuan , Minh N. Do

Floating-point data is widely used across various domains. Depending on the required precision, each floating-point value can occupy several bytes. Lossless storage of this information is crucial due to its critical accuracy, as seen in…

Databases · Computer Science 2025-08-11 Samirasadat Jamalidinan , Kazem Cheshmi

Toeplitz matrices are abundant in computational mathematics, and there is a rich literature on the development of fast and superfast algorithms for solving linear systems involving such matrices. Any Toeplitz matrix can be transformed into…

Numerical Analysis · Mathematics 2025-06-27 Bernhard Beckermann , Daniel Kressner , Heather Wilber

In the past few years, lossy compression has been widely applied in the field of wireless sensor networks (WSN), where energy efficiency is a crucial concern due to the constrained nature of the transmission devices. Often, the common…

Networking and Internet Architecture · Computer Science 2012-06-12 Davide Zordan , Borja Martinez , Ignasi Vilajosana , Michele Rossi

Communication has emerged as a critical bottleneck in the distributed training of large language models (LLMs). While numerous approaches have been proposed to reduce communication overhead, the potential of lossless compression has…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-01 Wenxiang Lin , Xinglin Pan , Ruibo Fan , Shaohuai Shi , Xiaowen Chu

Modern scientific instruments produce vast amounts of data, which can overwhelm the processing ability of computer systems. Lossy compression of data is an intriguing solution, but comes with its own drawbacks, such as potential signal…

Many wireless vision applications, such as autonomous driving, require preservation of global structural information rather than only per-pixel fidelity. However, existing Deep joint source-channel coding (DeepJSCC) schemes mainly optimize…

Machine Learning · Computer Science 2026-03-19 Omar Erak , Omar Alhussein , Fang Fang , Sami Muhaidat

Error-bounded lossy compression is one of the most effective techniques for scientific data reduction. However, the traditional trial-and-error approach used to configure lossy compressors for finding the optimal trade-off between…

Databases · Computer Science 2022-05-09 Sian Jin , Sheng Di , Jiannan Tian , Suren Byna , Dingwen Tao , Franck Cappello

Compressing massive LiDAR point clouds in real-time is critical to autonomous machines such as drones and self-driving cars. While most of the recent prior work has focused on compressing individual point cloud frames, this paper proposes a…

Image and Video Processing · Electrical Eng. & Systems 2020-08-18 Yu Feng , Shaoshan Liu , Yuhao Zhu

Data compression is a popular technique for improving the efficiency of data processing workloads such as SQL queries and more recently, machine learning (ML) with classical batch gradient methods. But the efficacy of such ideas for…

Machine Learning · Computer Science 2019-01-23 Fengan Li , Lingjiao Chen , Yijing Zeng , Arun Kumar , Jeffrey F. Naughton , Jignesh M. Patel , Xi Wu

Federated Learning marks a turning point in the implementation of decentralized machine learning (especially deep learning) for wireless devices by protecting users' privacy and safeguarding raw data from third-party access. It assigns the…

A new approach to data compression is developed and applied to multimedia content. This method separates messages into components suitable for both lossless coding and 'lossy' or statistical coding techniques, compressing complex objects by…

Information Theory · Computer Science 2011-12-26 John Scoville

With the growth of model sizes and the scale of their deployment, their sheer size burdens the infrastructure requiring more network and more storage to accommodate these. While there is a vast model compression literature deleting parts of…

In the context of Intelligent Transportation Systems (ITS), efficient data compression is crucial for managing large-scale point cloud data acquired by roadside LiDAR sensors. The demand for efficient storage, streaming, and real-time…

Image and Video Processing · Electrical Eng. & Systems 2024-10-30 Walter Zimmer , Ramandika Pranamulia , Xingcheng Zhou , Mingyu Liu , Alois C. Knoll