English
Related papers

Related papers: Lossless Compression of Time Series Data: A Compar…

200 papers

The escalating surge in data generation presents formidable challenges to information technology, necessitating advancements in storage, retrieval, and utilization. With the proliferation of artificial intelligence and big data, the "Data…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-19 Xinzhe Chen , Jianjiang Li

In the last years there has been a considerable increase in the availability of continuous sensor measurements in a wide range of application domains, such as Location-Based Services (LBS), medical monitoring systems, manufacturing plants…

Databases · Computer Science 2015-03-20 Michele Dallachiesa , Besmira Nushi , Katsiaryna Mirylenka , Themis Palpanas

One of the most important reasons of the existence of different types of files with media (audio or video) content, is achieving compression and less size, while preserving quality. In terms of fast transportation of files between equipment…

Image and Video Processing · Electrical Eng. & Systems 2021-01-08 Abbas Mirzaei Somarin , Mohammad Reza Deldadeh Shirin

The expanding instrumentation of processes throughout society with sensors yields a proliferation of time series data that may in turn enable important applications, e.g., related to transportation infrastructures or power grids.…

Databases · Computer Science 2024-10-29 Hao Miao , Ziqiao Liu , Yan Zhao , Chenjuan Guo , Bin Yang , Kai Zheng , Christian S. Jensen

Most data is automatically collected and only ever "seen" by algorithms. Yet, data compressors preserve perceptual fidelity rather than just the information needed by algorithms performing downstream tasks. In this paper, we characterize…

Machine Learning · Computer Science 2022-01-31 Yann Dubois , Benjamin Bloem-Reddy , Karen Ullrich , Chris J. Maddison

Data compression plays a key role in reducing storage and I/O costs. Traditional lossy methods primarily target data on rectilinear grids and cannot leverage the spatial coherence in unstructured mesh data, leading to suboptimal compression…

The federated analysis of sensitive time series has huge potential in various domains, such as healthcare or manufacturing. Yet, to fully unlock this potential, requirements imposed by various stakeholders must be fulfilled, regarding,…

Cryptography and Security · Computer Science 2024-08-29 Daniel Bachlechner , Ruben Hetfleisch , Stephan Krenn , Thomas Lorünser , Michael Rader

Many applications such as scientific simulation, sensing, and power grid monitoring tend to generate massive amounts of data, which should be compressed first prior to storage and transmission. These data, mostly comprised of floating-point…

Databases · Computer Science 2019-11-19 Dongeun Lee , Alex Sim , Jaesik Choi , Kesheng Wu

Modern graphics processors provide exceptional computa- tional power, but only for certain computational models. While they have revolutionized computation in many fields, compression has been largely unnaffected. This paper aims to explain…

Data Structures and Algorithms · Computer Science 2011-09-13 Axel Eirola

Many scientific codes and instruments generate large amounts of floating-point data at high rates that must be compressed before they can be stored. Typically, only lossy compression algorithms deliver high-enough compression ratios.…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-31 Alex Fallin , Nathaniel Gorski , Tripti Agarwal , Bei Wang , Ganesh Gopalakrishnan , Martin Burtscher

Data used for analytics and machine learning often take the form of tables with categorical entries. We introduce a family of lossless compression algorithms for such data that proceed in four steps: $(i)$ Estimate latent variables…

Information Theory · Computer Science 2023-02-21 Andrea Montanari , Eric Weiner

This paper addresses about various image compression techniques. On the basis of analyzing the various image compression techniques this paper presents a survey of existing research papers. In this paper we analyze different types of…

Information Theory · Computer Science 2013-11-28 Gaurav Vijayvargiya , Sanjay Silakari , Rajeev Pandey

Data is essential to performing time series analysis utilizing machine learning approaches, whether for classic models or today's large language models. A good time-series dataset is advantageous for the model's accuracy, robustness, and…

Machine Learning · Computer Science 2024-04-29 Chenxi Sun , Hongyan Li , Yaliang Li , Shenda Hong

For storing a word or the whole text segment, we need a huge storage space. Typically a character requires 1 Byte for storing it in memory. Compression of the memory is very important for data management. In case of memory requirement…

Information Theory · Computer Science 2010-09-28 Md. Abul Kalam Azad , Rezwana Sharmeen , Shabbir Ahmad , S. M. Kamruzzaman

Today's exponentially increasing data volumes and the high cost of storage make compression essential for the Big Data industry. Although research has concentrated on efficient compression, fast decompression is critical for analytics…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-03 Evangelia Sitaridi , Rene Mueller , Tim Kaldewey , Guy Lohman , Kenneth Ross

The volume of data and the velocity with which it is being generated by com- putational experiments on high performance computing (HPC) systems is quickly outpacing our ability to effectively store this information in its full fidelity.…

Computation · Statistics 2014-07-14 Henry Scharf , Ryan Elmore , Kenny Gruchalla

In the past few years, lossy compression has been widely applied in the field of wireless sensor networks (WSN), where energy efficiency is a crucial concern due to the constrained nature of the transmission devices. Often, the common…

Networking and Internet Architecture · Computer Science 2012-06-12 Davide Zordan , Borja Martinez , Ignasi Vilajosana , Michele Rossi

Emerging Big Data analytics and machine learning applications require a significant amount of computational power. While there exists a plethora of large-scale data processing frameworks which thrive in handling the various complexities of…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-26 Jan S. Rellermeyer , Sobhan Omranian Khorasani , Dan Graur , Apourva Parthasarathy

Flow records, that summarize the characteristics of traffic flows, represent a practical and powerful way to monitor a network. While they already offer significant compression compared to full packet captures, their sheer volume remains…

Networking and Internet Architecture · Computer Science 2025-04-30 Gabriele Merlach , Damiano Ravalico , Martino Trevisan , Fabio Palmese , Giovanni Baccichet , Alessandro E. C. Redondi

The continued digitization of societal processes translates into a proliferation of time series data that cover applications such as fraud detection, intrusion detection, and energy management, where anomaly detection is often essential to…