English
Related papers

Related papers: Time Series Data Cleaning with Regular and Irregul…

200 papers

The continuous advances in data collection and storage techniques allow us to observe and record real-life processes in great detail. Examples include financial transaction data, fMRI images, satellite photos, earths pollution distribution…

Methodology · Statistics 2015-02-26 Łukasz Kidziński

Human activity recognition (HAR) ideally relies on data from wearable or environment-instrumented sensors sampled at regular intervals, enabling standard neural network models optimized for consistent time-series data as input. However,…

Signal Processing · Electrical Eng. & Systems 2025-01-28 Mengxi Liu , Daniel Geißler , Sizhen Bian , Bo Zhou , Paul Lukowicz

Recent state-of-the-art forecasting methods are trained on collections of time series. These methods, often referred to as global models, can capture common patterns in different time series to improve their generalization performance.…

Machine Learning · Computer Science 2024-04-30 Vitor Cerqueira , Nuno Moniz , Ricardo Inácio , Carlos Soares

We propose a method for filling gaps and removing interferences in time series for applications involving continuous monitoring of environmental variables. The approach is non-parametric and based on an iterative pattern-matching between…

Geophysics · Physics 2015-08-11 Gregoire Mariethoz , Niklas Linde , Damien Jougnot , Hassan Rezaee

Internet-based services have seen remarkable success, generating vast amounts of monitored key performance indicators (KPIs) as univariate or multivariate time series. Monitoring and analyzing these time series are crucial for researchers,…

Machine Learning · Computer Science 2023-08-02 Zhenyu Zhong , Qiliang Fan , Jiacheng Zhang , Minghua Ma , Shenglin Zhang , Yongqian Sun , Qingwei Lin , Yuzhi Zhang , Dan Pei

The process of collecting and organizing sets of observations represents a common theme throughout the history of science. However, despite the ubiquity of scientists measuring, recording, and analyzing the dynamics of different processes,…

Data Analysis, Statistics and Probability · Physics 2013-05-23 Ben D. Fulcher , Max A. Little , Nick S. Jones

Irregularly-sampled time series occur in many domains including healthcare. They can be challenging to model because they do not naturally yield a fixed-dimensional representation as required by many standard machine learning models. In…

Machine Learning · Computer Science 2020-08-19 Steven Cheng-Xian Li , Benjamin M. Marlin

Streaming data can arise from a variety of contexts. Important use cases are continuous sensor measurements such as temperature, light or radiation values. In the process, streaming data may also contain data errors that should be cleaned…

Databases · Computer Science 2025-07-29 Valerie Restat , Niklas Rodenhausen , Carina Antonin , Uta Störl

Irregularly sampled time series are increasingly prevalent, particularly in medical domains. While various specialized methods have been developed to handle these irregularities, effectively modeling their complex dynamics and pronounced…

Machine Learning · Computer Science 2023-11-01 Zekun Li , Shiyang Li , Xifeng Yan

In recent years, more and more large data sets have become available. Data accuracy, the absence of verifiable errors in data, is crucial for these large materials to enable high-quality research, downstream applications, and model…

Methodology · Statistics 2025-10-27 Väinö Yrjänäinen , Johan Jonasson , Måns Magnusson

With the latest advances in Deep Learning-based generative models, it has not taken long to take advantage of their remarkable performance in the area of time series. Deep neural networks used to work with time series heavily depend on the…

Machine Learning · Computer Science 2024-02-19 Guillermo Iglesias , Edgar Talavera , Ángel González-Prieto , Alberto Mozo , Sandra Gómez-Canaval

We consider the limitations of two techniques for detecting nonlinearity in time series. The first technique compares the original time series to an ensemble of surrogate time series that are constructed to mimic the linear properties of…

comp-gas · Physics 2008-02-03 James Theiler , Paul S. Linsay , David M. Rubin

Data errors are widespread in real-world databases and severely impact downstream applications, such as machine learning pipelines or business analytics reports. Causes of such errors are manifold and can arise during both the design phase…

Databases · Computer Science 2026-04-13 Divya Bhadauria , Hazar Harmouch , Felix Naumann , Divesh Srivastava , Lisa Ehrlinger

For a long time, research on time series anomaly detection has mainly focused on finding outliers within a given time series. Admittedly, this is consistent with some practical problems, but in other practical application scenarios, people…

Machine Learning · Computer Science 2024-02-06 Hanxu Zhou , Yuan Zhang , Guangjie Leng , Ruofan Wang , Zhi-Qin John Xu

Using a time series model to mimic an observed time series has a long history. However, with regard to this objective, conventional estimation methods for discrete-time dynamical models are frequently found to be wanting. In fact, they are…

Statistics Theory · Mathematics 2015-03-19 Yingcun Xia , Howell Tong

Current research in time-series anomaly detection is using definitions that miss critical aspects of how anomaly detection is commonly used in practice. We list several areas that are of practical relevance and that we believe are either…

Machine Learning · Computer Science 2025-02-11 Andreas Mueller

Traditional machine learning methods face two main challenges in dealing with healthcare predictive analytics tasks. First, the high-dimensional nature of healthcare data needs labor-intensive and time-consuming processes to select an…

Machine Learning · Computer Science 2022-09-16 Mohammad Amin Morid , Olivia R. Liu Sheng , Joseph Dunbar

The Industrial Internet of Things drastically increases connectivity of devices in industrial applications. In addition to the benefits in efficiency, scalability and ease of use, this creates novel attack surfaces. Historically, industrial…

Machine Learning · Computer Science 2019-06-11 Simon Duque Anton , Lia Ahrens , Daniel Fraunholz , Hans Dieter Schotten

Deep learning promises performant anomaly detection on time-variant datasets, but greatly suffers from low availability of suitable training datasets and frequently changing tasks. Deep transfer learning offers mitigation by letting…

Machine Learning · Computer Science 2021-06-10 Benjamin Maschler , Tim Knodel , Michael Weyrich

Real-world datasets are dirty and contain many errors. Examples of these issues are violations of integrity constraints, duplicates, and inconsistencies in representing data values and entities. Learning over dirty databases may result in…

Databases · Computer Science 2020-04-07 Jose Picado , John Davis , Arash Termehchy , Ga Young Lee