English
Related papers

Related papers: ExSEnt: Extrema-Segmented Entropy Analysis of Time…

200 papers

Entropy has been a common index to quantify the complexity of time series in a variety of fields. Here, we introduce increment entropy to measure the complexity of time series in which each increment is mapped into a word of two letters,…

Data Analysis, Statistics and Probability · Physics 2016-01-20 Xiaofeng Liu , Aimin Jiang , Ning Xu , Jianru Xue

Entropy measures are effective features for time series classification problems. Traditional entropy measures, such as Shannon entropy, use probability distribution function. However, for the effective separation of time series, new entropy…

Machine Learning · Computer Science 2023-05-19 Andrei Velichko , Maksim Belyaev , Yuriy Izotov , Murugappan Murugappan , Hanif Heidari

In this paper, we developed a novel method of nonparametric relative entropy (RlEn) for modelling loss of complexity in intermittent time series. The method consists of two steps. We first fit a nonlinear autoregressive model to each…

Methodology · Statistics 2025-01-08 Jie Li , Jian Zhang , Samantha L. Winter , Mark Burnley

The characterisation of time-series data via their most salient features is extremely important in a range of machine learning task, not least of all with regards to classification and clustering. While there exist many feature extraction…

Machine Learning · Computer Science 2015-07-28 Duncan Barrack , James Goulding , Keith Hopcraft , Simon Preston , Gavin Smith

Here, we propose a new tool to estimate the complexity of a time series: the entropy of difference (ED). The method is based solely on the sign of the difference between neighboring values in a time series. This makes it possible to…

Data Analysis, Statistics and Probability · Physics 2014-11-05 Pasquale Nardone

This work presents a novel framework for time series analysis using entropic measures based on the kernel density estimate (KDE) of the time series' Takens' embeddings. Using this framework we introduce two distinct analytical tools: (1) a…

Information Theory · Computer Science 2025-12-05 Audun Myers , Bill Kay , Iliana Alvarez , Michael Hughes , Cameron Mackenzie , Carlos Ortiz Marrero , Emily Ellwein , Erik Lentz

Decomposing complex time series into trend, seasonality, and remainder components is an important task to facilitate time series anomaly detection and forecasting. Although numerous methods have been proposed, there are still many time…

Machine Learning · Computer Science 2018-12-06 Qingsong Wen , Jingkun Gao , Xiaomin Song , Liang Sun , Huan Xu , Shenghuo Zhu

Patch-based transformers have emerged as efficient and improved long-horizon modeling architectures for time series modeling. Yet, existing approaches rely on temporally-agnostic patch construction, where arbitrary starting positions and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Sachith Abeywickrama , Emadeldeen Eldele , Min Wu , Xiaoli Li , Chau Yuen

We propose utilizing entropy as a diagnostic tool to distinguish between constant and dynamical dark energy models. Entropy, a measure of the system's disorder or information content, captures the complexity and evolution of the universe.…

General Relativity and Quantum Cosmology · Physics 2025-07-16 Tanisha Joshi

The search for patterns in time series is a very common task when dealing with complex systems. This is usually accomplished by employing a complexity measure such as entropies and fractal dimensions. However, such measures usually only…

Data Analysis, Statistics and Probability · Physics 2017-06-13 Haroldo V. Ribeiro , Max Jauregui , Luciano Zunino , Ervin K. Lenzi

We discuss how maximum entropy methods may be applied to the reconstruction of Markov processes underlying empirical time series and compare this approach to usual frequency sampling. It is shown that, at least in low dimension, there…

Risk Management · Quantitative Finance 2015-06-23 Gregor Chliamovitch , Alexandre Dupuis , Bastien Chopard , Anton Golub

We propose a new type of entropic descriptor that is able to quantify the statistical complexity (a measure of complex behaviour) by taking simultaneously into account the average departures of a system's entropy S from both its maximum…

Statistical Mechanics · Physics 2015-05-13 R. Piasecki , A. Plastino

Extracting informative and meaningful temporal segments from high-dimensional wearable sensor data, smart devices, or IoT data is a vital preprocessing step in applications such as Human Activity Recognition (HAR), trajectory prediction,…

Machine Learning · Computer Science 2020-08-10 Shohreh Deldari , Daniel V. Smith , Amin Sadri , Flora D. Salim

Temporal non-stationarity, the phenomenon that time series distributions change over time, poses fundamental challenges to reliable time series forecasting. Intuitively, the complex time series can be decomposed into two factors, \ie…

Machine Learning · Computer Science 2025-10-21 Mingyuan Xia , Chunxu Zhang , Zijian Zhang , Hao Miao , Qidong Liu , Yuanshao Zhu , Bo Yang

Permutation patterns-based approaches, such as permutation entropy (PerEn), have been widely and successfully used to analyze data. However, these methods have two main shortcomings. First, when a series is symbolized based on permutation…

Information Theory · Computer Science 2017-08-04 Hamed Azami , Javier Escudero

The problem of defining and studying complexity of a time series has interested people for years. In the context of dynamical systems, Grassberger has suggested that a slow approach of the entropy to its extensive asymptotic limit is a sign…

Data Analysis, Statistics and Probability · Physics 2009-11-07 William Bialek , Ilya Nemenman , Naftali Tishby

Complexity is an important metric for appropriate characterization of different classes of irregular signals, observed in the laboratory or in nature. The literature is already rich in the description of such measures using a variety of…

In most data-scientific approaches, the principle of Maximum Entropy (MaxEnt) is used to a posteriori justify some parametric model which has been already chosen based on experience, prior knowledge or computational simplicity. In a…

Methodology · Statistics 2022-06-29 Orestis Loukas , Ho Ryun Chung

Approximate entropy (ApEn) and sample entropy (SampEn) are widely used for temporal complexity analysis of real-world phenomena. However, their relationship with the Hurst exponent as a measure of self-similarity is not widely studied.…

Computational Physics · Physics 2018-12-17 Amir Omidvarnia , Mostefa Mesbah , Mangor Pedersen , Graeme Jackson

Entropy rate of sequential data-streams naturally quantifies the complexity of the generative process. Thus entropy rate fluctuations could be used as a tool to recognize dynamical perturbations in signal sources, and could potentially be…

Information Theory · Computer Science 2014-03-24 Ishanu Chattopadhyay , Hod Lipson
‹ Prev 1 2 3 10 Next ›