English
Related papers

Related papers: Using conditional entropy to identify periodicity

200 papers

Recent theoretical advancement of information density in natural language has brought the following question on desk: To what degree does natural language exhibit periodicity pattern in its encoded information? We address this question by…

Computation and Language · Computer Science 2026-04-27 Yulin Ou , Yu Wang , Yang Xu , Hendrik Buschmeier

Many scientific problems involve data that is embedded in a space with periodic boundary conditions. This can for instance be related to an inherent cyclic or rotational symmetry in the data or a spatially extended periodicity. When…

Machine Learning · Computer Science 2025-10-08 Xander M. de Wit , Alessandro Gabbana

Here, we propose a new tool to estimate the complexity of a time series: the entropy of difference (ED). The method is based solely on the sign of the difference between neighboring values in a time series. This makes it possible to…

Data Analysis, Statistics and Probability · Physics 2014-11-05 Pasquale Nardone

Time series analysis finds wide applications in fields such as weather forecasting, anomaly detection, and behavior recognition. Previous methods attempted to model temporal variations directly using 1D time series. However, this has been…

Machine Learning · Computer Science 2024-11-08 Qiang Wu , Gechang Yao , Zhixi Feng , Shuyuan Yang

Estimating causal interactions in complex dynamical systems is an important problem encountered in many fields of current science. While a theoretical solution for detecting the causal interactions has been previously formulated in the…

Data Analysis, Statistics and Probability · Physics 2020-01-20 Jakub Kořenek , Jaroslav Hlinka

In this paper we present a novel algorithm and efficient data structure for anomaly detection based on temporal data. Time-series data are represented by a sequence of symbolic time intervals, describing increasing and decreasing trends, in…

Data Structures and Algorithms · Computer Science 2019-11-05 Roni Mateless , Michael Segal , Robert Moskovitch

To process data obtained during interference experiments in high-energy physics, methods of spectral analysis are employed. Methods of spectral analysis, in which an autoregression model of experimental data is used, such as the maximum…

High Energy Physics - Experiment · Physics 2009-09-25 B. Z. Belashev , M. K. Suleymanov

The detection of periodic signals in irregularly-sampled time series is a problem commonly encountered in astronomy. Traditional tools used for periodic searches, such as the periodogram, have poorly defined statistical properties under…

Instrumentation and Methods for Astrophysics · Physics 2025-01-13 A. Gúrpide , M. Middleton

For many real time applications, it is important to validate the information received from the sensors before entering higher levels of reasoning. This paper presents an any time probabilistic algorithm for validating the information…

Artificial Intelligence · Computer Science 2013-02-01 Pablo H. Ibarguengoytia , Luis Enrique Sucar , Sunil Vadera

The rate of entropy production provides a useful quantitative measure of a non-equilibrium system and estimating it directly from time-series data from experiments is highly desirable. Several approaches have been considered for stationary…

Statistical Mechanics · Physics 2022-02-21 Shun Otsubo , Sreekanth K Manikandan , Takahiro Sagawa , Supriya Krishnamurthy

Time-varying non-Euclidean random objects are playing a growing role in modern data analysis, and periodicity is a fundamental characteristic of time-varying data. However, quantifying periodicity in general non-Euclidean random objects…

Methodology · Statistics 2025-10-22 Jiazhen Xu , Andrew T. A. Wood , Tao Zou

This study addresses the problem of learning a summary causal graph on time series with potentially different sampling rates. To do so, we first propose a new causal temporal mutual information measure for time series. We then show how this…

Artificial Intelligence · Computer Science 2023-11-03 Charles K. Assaad , Emilie Devijver , Eric Gaussier

Uncertain data streams have been widely generated in many Web applications. The uncertainty in data streams makes anomaly detection from sensor data streams far more challenging. In this paper, we present a novel framework that supports…

Artificial Intelligence · Computer Science 2016-07-21 Jiangang Ma , Le Sun , Hua Wang , Yanchun Zhang , Uwe Aickelin

A general input-output modelling technique for aperiodic-sampling linear systems has been developed. The procedure describes the dynamics of the system and includes the sequence of sampling periods among the variables to be handled. Some…

Discrete Mathematics · Computer Science 2016-08-14 Amparo Fúster-Sabater , J. M. Guillén

While it is tempting in experimental practice to seek as high a data rate as possible, oversampling can become an issue if one takes measurements too densely. These effects can take many forms, some of which are easy to detect: e.g., when…

Information Theory · Computer Science 2021-03-03 Michael Neuder , Elizabeth Bradley , Edward Dlugokencky , James W. C. White , Joshua Garland

The problems of conditional entropy's definition and the formula to compute conditional entropy are analyzed from various perspectives, and the corrected computing formula is presented. Examples are given to prove the conclusion that…

Information Theory · Computer Science 2007-08-24 Wang Yong

The problem of estimating entropy production from incomplete information in stochastic thermodynamics is essential for theory and experiments. Whereas a considerable amount of work has been done on this topic, arguably, most of it is…

Statistical Mechanics · Physics 2024-12-17 Pedro E. Harunari , Carlos E. Fiore , Andre C. Barato

We present a new automated method to identify instrumental features masquerading as small, long period planets in the \kepler\ planet candidate catalog. These systematics, mistakenly identified as planet transits, can have a strong impact…

The following note proves that conditional entropy of a sequence is almost time-reversal invariant, specifically they only differ by a small constant factor dependent only upon the forward and backward models that the entropies are being…

Information Theory · Computer Science 2024-04-04 Adam Wang

Causal discovery problems use a set of observations to deduce causality between variables in the real world, typically to answer questions about biological or physical systems. These observations are often recorded at regular time…

Signal Processing · Electrical Eng. & Systems 2026-02-24 Kurt Butler , Damian Machlanski , Panagiotis Dimitrakopoulos , Sotirios A. Tsaftaris