English
Related papers

Related papers: Application of data compression techniques to time…

200 papers

The predictive advantage of combining several different predictive models is widely accepted. Particularly in time series forecasting problems, this combination is often dynamic to cope with potential non-stationary sources of variation…

Machine Learning · Statistics 2021-04-06 Vitor Cerqueira , Luis Torgo , Carlos Soares , Albert Bifet

Weather and climate simulations produce petabytes of high-resolution data that are later analyzed by researchers in order to understand climate change or severe weather. We propose a new method of compressing this multidimensional weather…

Machine Learning · Computer Science 2023-04-17 Langwen Huang , Torsten Hoefler

Today's HPC applications are producing extremely large amounts of data, such that data storage and analysis are becoming more challenging for scientific research. In this work, we design a new error-controlled lossy compression algorithm…

Information Theory · Computer Science 2017-06-14 Dingwen Tao , Sheng Di , Zizhong Chen , Franck Cappello

Thanks to the rapid proliferation of connected devices, sensor-generated time series constitute a large and growing portion of the world's data. Often, this data is collected from distributed, resource-constrained devices and centralized at…

Performance · Computer Science 2018-08-09 Davis Blalock , Samuel Madden , John Guttag

As an alternative to variable selection or shrinkage in high dimensional regression, we propose to randomly compress the predictors prior to analysis. This dramatically reduces storage and computational bottlenecks, performing well when the…

Machine Learning · Statistics 2013-03-26 Rajarshi Guhaniyogi , David B. Dunson

Time series forecasting plays an increasingly important role in modern business decisions. In today's data-rich environment, people often aim to choose the optimal forecasting model for their data. However, identifying the optimal model…

Applications · Statistics 2021-12-17 Xixi Li , Fotios Petropoulos , Yanfei Kang

The presence of smart objects is increasingly widespread and their ecosystem, also known as Internet of Things, is relevant in many different application scenarios. The huge amount of temporally annotated data produced by these smart…

Databases · Computer Science 2022-09-21 Giacomo Chiarot , Claudio Silvestri

This paper considers application of the SALSA algorithm as a method of forecasting and applies it to simulated electrical signal, temperature recording from the Australian Bureau of Meteorology and stock prices from the Australian stock…

Methodology · Statistics 2019-07-29 Nicholas Rowe

Suppose there is a large file which should be transmitted (or stored) and there are several (say, m) admissible data-compressors. It seems natural to try all the compressors and then choose the best, i.e. the one that gives the shortest…

Information Theory · Computer Science 2018-09-11 Boris Ryabko

A popular approach to sentence compression is to formulate the task as a constrained optimization problem and solve it with integer linear programming (ILP) tools. Unfortunately, dependence on ILP may make the compressor prohibitively slow,…

Computation and Language · Computer Science 2015-10-29 Katja Filippova , Enrique Alfonseca

Scientific applications typically generate large volumes of floating-point data, making lossy compression one of the most effective methods for data reduction, thereby lowering storage requirements and improving performance in large-scale…

Performance · Computer Science 2024-12-11 Youyuan Liu , Taolue Yang , Sian Jin

The geomagnetic Kp index is derived from the K index measurements obtained from thirteen stations located around the Earth geomagnetic latitudes between $48^\circ$ and $63^\circ$. This index is processed every three hours, is…

Implementing insect monitoring systems provides an excellent opportunity to create accurate interventions for insect control. However, selecting the appropriate time for an intervention is still an open question due to the inherent…

Quantitative Methods · Quantitative Biology 2023-12-29 Gabriel R. Palma , Rodrigo F. Mello , Wesley A. C. Godoy , Eduardo Engel , Douglas Lau , Charles Markham , Rafael A. Moral

Time series data compression is emerging as an important problem with the growth in IoT devices and sensors. Due to the presence of noise in these datasets, lossy compression can often provide significant compression gains without impacting…

Signal Processing · Electrical Eng. & Systems 2020-01-14 Shubham Chandak , Kedar Tatwawadi , Chengtao Wen , Lingyun Wang , Juan Aparicio , Tsachy Weissman

Linear models are used in online decision making, such as in machine learning, policy algorithms, and experimentation platforms. Many engineering systems that use linear models achieve computational efficiency through distributed systems…

Machine Learning · Computer Science 2021-03-04 Jeffrey Wong , Eskil Forsell , Randall Lewis , Tobias Mao , Matthew Wardrop

Real-world multichannel time series prediction faces growing demands for efficiency across edge and cloud environments, making channel compression a timely and essential problem. Motivated by the success of Multiple-Input Multiple-Output…

Machine Learning · Computer Science 2026-01-30 Ziqi Liu , Pei Zeng , Yi Ding

We address the problem of nonparametric estimation of characteristics for stationary and ergodic time series. We consider finite-alphabet time series and real-valued ones and the following four problems: i) estimation of the (limiting)…

Information Theory · Computer Science 2007-11-01 Boris Ryabko

Recent deep learning models for Long-term Time Series Forecasting (LTSF) often emphasize complex, handcrafted designs, while simpler architectures like linear models or MLPs have often outperformed these intricate solutions. In this paper,…

Machine Learning · Computer Science 2025-05-26 Yihang Lu , Yangyang Xu , Qitao Qing , Xianwei Meng

The paper is focused on the forecasting method for time series groups with the use of algorithms for cluster analysis. $K$-means algorithm is suggested to be a basic one for clustering. The coordinates of the centers of clusters have been…

Machine Learning · Computer Science 2015-09-17 N. N. Astakhova , L. A. Demidova , E. V. Nikulchev

Scientists conduct large-scale simulations to compute derived quantities-of-interest (QoI) from primary data. Often, QoI are linked to specific features, regions, or time intervals, such that data can be adaptively reduced without…

Machine Learning · Computer Science 2024-05-03 Xiao Li , Qian Gong , Jaemoon Lee , Scott Klasky , Anand Rangarajan , Sanjay Ranka
‹ Prev 1 2 3 10 Next ›