English
Related papers

Related papers: Permutation Entropy for Graph Signals

200 papers

Ordinal Patterns are a time-series data analysis tool used as a preliminary step to construct the Permutation Entropy which itself allows the same characterization of dynamics as chaotic or regular as more theoretical constructs such as the…

Adaptation and Self-Organizing Systems · Physics 2021-02-24 I. Gunther , Arjendu K. Pattanayak , Andrés Aragoneses

Transitivity, the existence of periodic points and positive topological entropy can be used to characterize complexity in dynamical systems. It is known that for graphs that are not trees, for every $\varepsilon>0,$ there exist (complicate)…

Dynamical Systems · Mathematics 2018-07-05 Lluís Alsedà , Liane Bordignon , Jorge Groisman

In estimating the complexity of objects, in particular of graphs, it is common practice to rely on graph- and information-theoretic measures. Here, using integer sequences with properties such as Borel normality, we explain how these…

Information Theory · Computer Science 2017-07-12 Hector Zenil , Narsis Kiani , Jesper Tegnér

Here we present the entropic dynamics formalism for networks. That is, a framework for the dynamics of graphs meant to represent a network derived from the principle of maximum entropy and the rate of transition is obtained taking into…

Physics and Society · Physics 2021-04-29 Felipe Xavier Costa , Pedro Pessoa

Entropy and information can be considered dual: entropy is a measure of the subspace defined by the information constraining the given ambient space. Negative entropies, arising in na\"ive extensions of the definition of entropy from…

Probability · Mathematics 2023-03-06 Daniel Lazarev

To quantify the complexity of a system, entropy-based methods have received considerable critical attentions in real-world data analysis. Among numerous entropy algorithms, amplitude-based formulas, represented by Sample Entropy, suffer…

Signal Processing · Electrical Eng. & Systems 2022-01-12 Hongjian Xiao , Danilo P. Mandic

In this article, we discuss the problem of establishing relations between information measures assessed for network structures. Two types of entropy based measures namely, the Shannon entropy and its generalization, the R\'{e}nyi entropy…

Information Theory · Computer Science 2013-01-24 Lavanya Sivakumar , Matthias Dehmer

The entropy of a graph is an information-theoretic quantity which expresses the complexity of a graph \cite{DM1,M}. After Shannon introduced the definition of entropy to information and communication, many generalizations of the entropy…

Combinatorics · Mathematics 2014-11-26 Xueliang Li , Zhongmei Qin , Meiqin Wei , Ivan Gutman , Matthias Dehmer

Structural Entropy (SE) measures the structural information contained in a graph. Minimizing or maximizing SE helps to reveal or obscure the intrinsic structural patterns underlying graphs in an interpretable manner, finding applications in…

Social and Information Networks · Computer Science 2024-05-14 Yuwei Cao , Hao Peng , Angsheng Li , Chenyu You , Zhifeng Hao , Philip S Yu

We characterize different cell states, related to cancer and ageing phenotypes, by a measure of entropy of network ensembles, integrating gene expression values and protein interaction networks. The entropy measure estimates the parameter…

Molecular Networks · Quantitative Biology 2013-05-24 G. Menichetti , G. Bianconi , E. Giampieri , G. Castellani , D. Remondini

Using a graph-based approach, we propose a multiscale permutation entropy to explore the complexity of multivariate time series over multiple time scales. This multivariate multiscale permutation entropy (MPEG) incorporates the interaction…

Data Analysis, Statistics and Probability · Physics 2022-10-18 John Stewart Fabila-Carrasco , Chao Tan , Javier Escudero

Subshifts of deterministic substitutions are ubiquitous objects in dynamical systems and aperiodic order (the mathematical theory of quasicrystals). Two of their most striking features are that they have low complexity (zero topological…

Dynamical Systems · Mathematics 2026-01-14 Philipp Gohlke , Andrew Mitchell , Dan Rust , Tony Samuel

Entropy has been a common index to quantify the complexity of time series in a variety of fields. Here, we introduce increment entropy to measure the complexity of time series in which each increment is mapped into a word of two letters,…

Data Analysis, Statistics and Probability · Physics 2016-01-20 Xiaofeng Liu , Aimin Jiang , Ning Xu , Jianru Xue

Information entropy is applied to the analysis of time series generated by dynamical systems. Complexity of a temporal or spatio-temporal signal is defined as the difference between the sum of entropies of the local linear regions of the…

Chaotic Dynamics · Physics 2009-11-10 Milan Rajkovic

Transfer entropy is used to establish a measure of causal relationships between two variables. Symbolic transfer entropy, as an estimation method for transfer entropy, is widely applied due to its robustness against non-stationarity. This…

Computational Complexity · Computer Science 2024-09-24 Dian Jin

To quantify the fundamental evolution of time-varying networks, and detect abnormal behavior, one needs a notion of temporal difference that captures significant organizational changes between two successive instants. In this work, we…

Social and Information Networks · Computer Science 2017-08-17 Nathan D Monnig , Francois G Meyer

Graph compression is a data analysis technique that consists in the replacement of parts of a graph by more general structural patterns in order to reduce its description length. It notably provides interesting exploration tools for the…

Data Structures and Algorithms · Computer Science 2018-07-19 Robin Lamarche-Perrin

Finding patterns in graphs is a fundamental problem in databases and data mining. In many applications, graphs are temporal and evolve over time, so we are interested in finding durable patterns, such as triangles and paths, which persist…

Databases · Computer Science 2024-03-26 Pankaj K. Agarwal , Xiao Hu , Stavros Sintos , Jun Yang

Entropy is a classical measure to quantify the amount of information or complexity of a system. Various entropy-based measures such as functional and spectral entropies have been proposed in brain network analysis. However, they are less…

Neurons and Cognition · Quantitative Biology 2018-03-08 Hyekyoung Lee , Eunkyung Kim , Hyejin Kang , Youngmin Huh , Youngjo Lee , Seonhee Lim , Dong Soo Lee

Neural networks have dramatically increased our capacity to learn from large, high-dimensional datasets across innumerable disciplines. However, their decisions are not easily interpretable, their computational costs are high, and building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mackenzie J. Meni , Ryan T. White , Michael Mayo , Kevin Pilkiewicz