English
Related papers

Related papers: Generalized Weighted Permutation Entropy

200 papers

We extend previously proposed measures of complexity, emergence, and self-organization to continuous distributions using differential entropy. This allows us to calculate the complexity of phenomena for which distributions are known. We…

Adaptation and Self-Organizing Systems · Physics 2016-04-01 Guillermo Santamaría-Bonfil , Nelson Fernández , Carlos Gershenson

A powerful tool is developed for the characterization of chaotic signals. The approach is based on the symbolic encoding of time series (according to their ordinal patterns) combined with the ensuing characterization of the corresponding…

Chaotic Dynamics · Physics 2017-04-12 Antonio Politi

We deal here with the issue of determinism versus randomness in time series. One wishes to identify their relative weights in a given time series. Two different tools have been advanced in the literature to such effect, namely, i) the…

Systematic generalization remains challenging for current language models, which are known to be both sensitive to semantically similar permutations of the input and to struggle with known concepts presented in novel contexts. Although…

Computation and Language · Computer Science 2025-05-28 Sondre Wold , Lucas Georges Gabriel Charpentier , Étienne Simon

Time-series analysis in terms of ordinal patterns is revisited by introducing a generalized permutation entropy $H_p(w,L)$, which depends on two different window lengths: $w$, implicitly defining the resolution of the underlying partition;…

Chaotic Dynamics · Physics 2019-02-20 Stuart J Watt , Antonio Politi

We derive the asymptotic distribution of ordinal-pattern frequencies under weak dependence conditions and investigate the long-run covariance matrix not only analytically for moving-average, Gaussian, and the novel generalized coin-tossing…

Statistics Theory · Mathematics 2025-07-24 Angelika Silbernagel , Christian Weiß

A generalization of Gy's theory for the variance of the fundamental sampling error is reviewed. Practical situations where the generalized model potentially leads to more accurate variance estimates are identified as: clustering of…

Applications · Statistics 2009-11-10 Bastiaan Geelhoed

Weighted extropy has recently emerged as a flexible information measure for quantifying uncertainty, with particular relevance to order statistics. In this paper, we introduce and study a weighted cumulative analogue of extropy, extending…

Statistics Theory · Mathematics 2026-04-17 Santosh Kumar Chaudhary , Sarikul Islam , Nitin Gupta

Entropy is useful in statistical problems as a measure of irreversibility, randomness, mixing, dispersion, and number of microstates. However, there remains ambiguity over the precise mathematical formulation of entropy, generalized beyond…

Statistical Mechanics · Physics 2023-08-21 Vladimir Zhdankin

This article presents a new class of generalized transmuted lifetime distributions which includes a large number of lifetime distributions as sub-family. Several important mathematical quantities such as density function, distribution…

Methodology · Statistics 2024-05-21 Alok Kumar Pandey , Alam Ali , Ashok Kumar Pathak

Ordinal Patterns are a time-series data analysis tool used as a preliminary step to construct the Permutation Entropy which itself allows the same characterization of dynamics as chaotic or regular as more theoretical constructs such as the…

Adaptation and Self-Organizing Systems · Physics 2021-02-24 I. Gunther , Arjendu K. Pattanayak , Andrés Aragoneses

Neural networks have dramatically increased our capacity to learn from large, high-dimensional datasets across innumerable disciplines. However, their decisions are not easily interpretable, their computational costs are high, and building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mackenzie J. Meni , Ryan T. White , Michael Mayo , Kevin Pilkiewicz

Permutation entropy and its associated frameworks are remarkable examples of physics-inspired techniques adept at processing complex and extensive datasets. Despite substantial progress in developing and applying these tools, their use has…

Data Analysis, Statistics and Probability · Physics 2024-08-14 Leonardo G. J. M. Voltarelli , Arthur A. B. Pessa , Luciano Zunino , Rafael S. Zola , Ervin K. Lenzi , Matjaz Perc , Haroldo V. Ribeiro

We study an entropy measure for quantum systems that generalizes the von Neumann entropy as well as its classical counterpart, the Gibbs or Shannon entropy. The entropy measure is based on hypothesis testing and has an elegant formulation…

Quantum Physics · Physics 2014-02-19 F. Dupuis , L. Kraemer , P. Faist , J. M. Renes , R. Renner

In 2002, in a seminal article, Christoph Bandt and Bernd Pompe proposed a new methodology for the analysis of complex time series, now known as Ordinal Analysis. The ordinal methodology is based on the computation of symbols (known as…

Data Analysis, Statistics and Probability · Physics 2022-06-07 Inmaculada Leyva , Johann Martinez , Cristina Masoller , Osvaldo A. Rosso , Massimiliano Zanin

Shannon Entropy is the preeminent tool for measuring the level of uncertainty (and conversely, information content) in a random variable. In the field of communications, entropy can be used to express the information content of given…

Information Theory · Computer Science 2024-11-06 Bill Kay , Audun Myers , Thad Boydston , Emily Ellwein , Cameron Mackenzie , Iliana Alvarez , Erik Lentz

The search for patterns in time series is a very common task when dealing with complex systems. This is usually accomplished by employing a complexity measure such as entropies and fractal dimensions. However, such measures usually only…

Data Analysis, Statistics and Probability · Physics 2017-06-13 Haroldo V. Ribeiro , Max Jauregui , Luciano Zunino , Ervin K. Lenzi

Many multivariate time series anomaly detection frameworks have been proposed and widely applied. However, most of these frameworks do not consider intrinsic relationships between variables in multivariate time series data, thus ignoring…

Machine Learning · Computer Science 2025-08-11 Falih Gozi Febrinanto , Kristen Moore , Chandra Thapa , Mujie Liu , Vidya Saikrishna , Jiangang Ma , Feng Xia

This paper provides insight into when, why, and how forecast strategies fail when they are applied to complicated time series. We conjecture that the inherent complexity of real-world time-series data---which results from the dimension,…

Information Theory · Computer Science 2014-11-24 Joshua Garland , Ryan James , Elizabeth Bradley

While it is tempting in experimental practice to seek as high a data rate as possible, oversampling can become an issue if one takes measurements too densely. These effects can take many forms, some of which are easy to detect: e.g., when…

Information Theory · Computer Science 2021-03-03 Michael Neuder , Elizabeth Bradley , Edward Dlugokencky , James W. C. White , Joshua Garland