English
Related papers

Related papers: Change a Bit to save Bytes: Compression for Floati…

200 papers

With ever-increasing volumes of scientific floating-point data being produced by high-performance computing applications, significantly reducing scientific floating-point data size is critical, and error-controlled lossy compressors have…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-20 Robert Underwood , Sheng Di , Jon C. Calhoun , Franck Cappello

The rise of integer-valued data, partly driven by the Internet of Things (IoT), has increased demand for efficient compression methods to reduce storage and transmission costs. Existing, speed-oriented methods rely on the…

Data Structures and Algorithms · Computer Science 2025-01-23 Jonas G. Matt

Learning and Artificial Intelligence (ML/AI) techniques have become increasingly prevalent in high performance computing (HPC). However, these methods depend on vast volumes of floating point data for training and validation which need…

Machine Learning · Computer Science 2024-03-26 Robert Underwood , Jon C. Calhoun , Sheng Di , Franck Cappello

Age of information (AoI), a notion that measures the information freshness, is an essential performance measure for time-critical applications in Internet of Things (IoT). With the surge of computing resources at the IoT devices, it is…

Information Theory · Computer Science 2021-08-10 Xijun Wang , Minghao Fang , Chao Xu , Howard H. Yang , Xinghua Sun , Xiang Chen , Tony Q. S. Quek

Monitoring medical data, e.g., Electrocardiogram (ECG) signals, is a common application of Internet of Things (IoT) devices. Compression methods are often applied on the massive amounts of sensor data generated prior to sending it to the…

Signal Processing · Electrical Eng. & Systems 2022-04-05 Eli Brosh , Elad Wasserstein , Anat Bremler-Barr

Today's HPC applications are producing extremely large amounts of data, such that data storage and analysis are becoming more challenging for scientific research. In this work, we design a new error-controlled lossy compression algorithm…

Information Theory · Computer Science 2017-06-14 Dingwen Tao , Sheng Di , Zizhong Chen , Franck Cappello

The distributed data infrastructure in Internet of Things (IoT) ecosystems requires efficient data-series compression methods, along with the ability to feed different accuracy demands. However, the compression performance of existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-25 Guoyou Sun , Panagiotis Karras , Qi Zhang

With the increasing scale of machine learning tasks, it has become essential to reduce the communication between computing nodes. Early work on gradient compression focused on the bottleneck between CPUs and GPUs, but…

Optimization and Control · Mathematics 2020-06-18 Sarit Khirirat , Sindri Magnússon , Arda Aytekin , Mikael Johansson

We present a new lossy compression algorithm for statistical floating-point data through a representation learning with binary variables. The algorithm finds a set of basis vectors and their binary coefficients that precisely reconstruct…

Quantum Physics · Physics 2022-03-10 Boram Yoon , Nga T. T. Nguyen , Chia Cheng Chang , Ermal Rrapaj

The Internet of Things paradigm envisages the presence of many battery-powered sensors and this entails the design of energy-aware protocols. Source coding techniques allow to save some energy by compressing the packets sent over the…

Information Theory · Computer Science 2017-02-14 Alessandro Biason , Chiara Pielli , Andrea Zanella , Michele Zorzi

In the era of the Internet of Things (IoT), where smartphones, built-in systems, wireless sensors, and nearly every smart device connect through local networks or the internet, billions of smart things communicate with each other and…

Machine Learning · Computer Science 2024-10-28 Duygu Altunkaya , Feyza Yildirim Okay , Suat Ozdemir

Recent developments in hardware and information technology have enabled the emergence of billions of connected, intelligent devices around the world exchanging information with minimal human involvement. This paradigm, known as the Internet…

Cryptography and Security · Computer Science 2025-05-29 Jaydip Sen , Subhasis Dasgupta

In the era of Internet of Things (IoT) and with the explosive worldwide growth of electronic data volume, and associated need of processing, analysis, and storage of such humongous volume of data, several new challenges are faced in…

A new approach to data compression is developed and applied to multimedia content. This method separates messages into components suitable for both lossless coding and 'lossy' or statistical coding techniques, compressing complex objects by…

Information Theory · Computer Science 2011-12-26 John Scoville

During the initial years of its inception, the Internet was widely used for transferring data packets between users and respective data sources by using IP addresses. With the advancements in technology, the Internet has been used to share…

Networking and Internet Architecture · Computer Science 2021-05-18 Abhiram Bhaskar Kakarla

In the burgeoning realm of Internet of Things (IoT) applications on edge devices, data stream compression has become increasingly pertinent. The integration of added compression overhead and limited hardware resources on these devices calls…

Databases · Computer Science 2024-06-18 Xianzhi Zeng , Shuhao Zhang

A data compression system capable of providing real-time streaming of high-resolution continuous point-on-wave (CPOW) and phasor measurement unit (PMU) measurements is proposed. Referred to as adaptive subband compression (ASBC), the…

Signal Processing · Electrical Eng. & Systems 2024-05-01 Xinyi Wang , Yilu Liu , Lang Tong

Compression algorithms reduce the redundancy in data representation to decrease the storage required for that data. Data compression offers an attractive approach to reducing communication costs by using available bandwidth effectively.…

Information Theory · Computer Science 2007-07-13 B. S. Shajee Mohan , V. K. Govindan

Federated data analytics is a framework for distributed data analysis where a server compiles noisy responses from a group of distributed low-bandwidth user devices to estimate aggregate statistics. Two major challenges in this framework…

Machine Learning · Computer Science 2022-06-10 Kamalika Chaudhuri , Chuan Guo , Mike Rabbat

Data compression plays a key role in reducing storage and I/O costs. Traditional lossy methods primarily target data on rectilinear grids and cannot leverage the spatial coherence in unstructured mesh data, leading to suboptimal compression…