English
Related papers

Related papers: Change a Bit to save Bytes: Compression for Floati…

200 papers

Time series data from a variety of sensors and IoT devices need effective compression to reduce storage and I/O bandwidth requirements. While most time series databases and systems rely on lossless compression, lossy techniques offer even…

Databases · Computer Science 2025-01-27 Carlos Enrique Muñiz-Cuza , Matthias Boehm , Torben Bach Pedersen

As Internet of Things (IoT) devices become both cheaper and more powerful, researchers are increasingly finding solutions to their scientific curiosities both financially and computationally feasible. When operating with restricted power or…

Signal Processing · Electrical Eng. & Systems 2022-06-16 Gary Koplik , Nathan Borggren , Sam Voisin , Gabrielle Angeloro , Jay Hineman , Tessa Johnson , Paul Bendich

Currently, the dominating constraint in many high performance computing applications is data capacity and bandwidth, in both inter-node communications and even more-so in on-node data motion. A new approach to address this limitation is to…

Numerical Analysis · Mathematics 2024-07-03 Alyson Fox , James Diffenderfer , Jeffrey Hittinger , Geoffrey Sanders , Peter Lindstrom

Network traffic analysis increasingly relies on feature-based representations to support monitoring and security in the presence of pervasive encryption. Although features are more compact than raw packet traces, their storage has become a…

Networking and Internet Architecture · Computer Science 2026-02-26 Fabio Palmese , Gabriele Merlach , Damiano Ravalico , Martino Trevisan , Alessandro E. C. Redondi

Our increasingly digital and connected world has led to the generation of unprecedented amounts of data. This data must be efficiently managed, transmitted, and stored to preserve resources and allow scalability. Data compression has…

Information Theory · Computer Science 2025-10-09 Jonas G. Matt , Pengcheng Huang , Balz Maag

Exponential growth in the amount of data generated by the Internet of Things currently pose significant challenges for data communication, storage and analytics and leads to high costs for organisations hoping to leverage their data. Novel…

Databases · Computer Science 2023-04-17 Aaron Hurst , Daniel E. Lucani , Qi Zhang

Resource allocation is a fundamental problem in Industrial Internet of Things (IIoT) systems, in which devices work together under limited communication bandwidth to complete diverse tasks. This paper proposes a communication-efficient…

Optimization and Control · Mathematics 2026-05-26 Yuzhu Duan , Ziwen Yang , Xiaoming Duan , Shanying Zhu

Error-controlled lossy compressors have been widely used in scientific applications to reduce the unprecedented size of scientific data while keeping data distortion within a user-specified threshold. While they significantly mitigate the…

Databases · Computer Science 2026-03-27 Xuan Wu , Sheng Di , Tripti Agarwal , Kai Zhao , Xin Liang , Franck Cappello

Large-scale simulations of time-dependent problems generate a massive amount of data and with the explosive increase in computational resources the size of the data generated by these simulations has increased significantly. This has…

Computational Engineering, Finance, and Science · Computer Science 2022-01-19 Shaghayegh Zamani Ashtiani , Mujeeb R. Malik , Hessam Babaee

Compression of floating-point data will play an important role in high-performance computing as data bandwidth and storage become dominant costs. Lossy compression of floating-point data is powerful, but theoretical results are needed to…

Numerical Analysis · Mathematics 2024-07-03 James Diffenderfer , Alyson Fox , Jeffrey Hittinger , Geoffrey Sanders , Peter Lindstrom

Implementing machine learning algorithms on Internet of things (IoT) devices has become essential for emerging applications, such as autonomous driving, environment monitoring. But the limitations of computation capability and energy…

Information Theory · Computer Science 2020-05-26 Xiufeng Huang , Sheng Zhou

New directions in computing and algorithms has lead to some new applications that have tolerance to imprecision. Although, These applications are creating large volumes of data which exceeds the capability of today's computing systems.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-16 Navid Mirnouri

We consider a wireless node that randomly receives data from different sensor units. The arriving data must be compressed, stored, and transmitted over a wireless link, where both the compression and transmission operations consume power.…

Optimization and Control · Mathematics 2008-07-25 Michael J. Neely , Abhishek Sharma

We present a record-breaking result and lessons learned in practicing TPCx-IoT benchmarking for a real-world use case. We find that more system characteristics need to be benchmarked for its application to real-world use cases. We introduce…

Databases · Computer Science 2021-12-30 Yuqing Zhu , Yanzhe An , Yuan Zi , Yu Feng , Jianmin Wang

Data compression techniques are characterized by four key performance indices which are (i) associated accuracy, (ii) compression ratio, (iii) computational work, and (iv) degree of freedom. The method of data compression developed in this…

Signal Processing · Electrical Eng. & Systems 2021-11-15 Anatoli Torokhti

This paper presents error-bounded lossy compression tailored for particle datasets from diverse scientific applications in cosmology, fluid dynamics, and fusion energy sciences. As today's high-performance computing capabilities advance,…

Information Theory · Computer Science 2024-04-05 Congrong Ren , Sheng Di , Longtao Zhang , Kai Zhao , Hanqi Guo

Several data compressors have been proposed in distributed optimization frameworks of network systems to reduce communication overhead in large-scale applications. In this paper, we demonstrate that effective information compression may…

Systems and Control · Electrical Eng. & Systems 2025-07-22 Zihao Ren , Lei Wang , Xinlei Yi , Xi Wang , Deming Yuan , Tao Yang , Zhengguang Wu , Guodong Shi

The Internet of Things (IoT) refers to a pervasive presence of interconnected and uniquely identifiable physical devices. These devices' goal is to gather data and drive actions in order to improve productivity, and ultimately reduce or…

Other Computer Science · Computer Science 2018-02-22 Tosiron Adegbija , Anita Rogacs , Chandrakant Patel , Ann Gordon-Ross

Frugal computing is becoming an important topic for environmental reasons. In this context, several techniques have been proposed to reduce the storage of scientific data by dedicated compression methods specially tailored for arrays of…

Data Structures and Algorithms · Computer Science 2022-03-01 Matthieu Martel

Data compression has become a necessity not only the in the field of communication but also in various scientific experiments. The data that is being received is more and the processing time required has also become more. A significant…

Information Theory · Computer Science 2016-07-29 Gautam R , S Murali