Related papers: Dynamic Entropies, Long--Range Correlations and Fl…
We report direct observation of the development of long-range spatial intensity correlations and the growth of intensity fluctuations inside the random media. We fabricated quasi-two-dimensional disordered photonic structures and probed the…
We study how the Shannon entropy of sequences produced by an information source converges to the source's entropy rate. We synthesize several phenomenological approaches to applying information theoretic measures of randomness and memory to…
We study electronic transport in long DNA chains using the tight-binding approach for a ladder-like model of DNA. We find insulating behavior with localizaton lengths xi ~ 25 in units of average base-pair seperation. Furthermore, we observe…
We introduce distance entropy as a measure of homogeneity in the distribution of path lengths between a given node and its neighbours in a complex network. Distance entropy defines a new centrality measure whose properties are investigated…
In many problems in data mining and machine learning, data items that need to be clustered or classified are not points in a high-dimensional space, but are distributions (points on a high dimensional simplex). For distributions, natural…
In many complex molecular systems, the macroscopic ensemble's properties are controlled by microscopic dynamic events (or fluctuations) that are often difficult to detect via pattern-recognition approaches. Discovering the relationships…
Approximation of entropies of various types using machine learning (ML) regression methods are shown for the first time. The ML models presented in this study define the complexity of the short time series by approximating dissimilar…
The refined composite multiscale-entropy algorithm was applied to the time-dependent behavior of the Weierstrass functions, colored noise, and Logistic map to provide fresh insight into the dynamics of these fluctuating phenomena. For the…
Given a sequence composed of a limit number of characters, we try to "read" it as a "text". This involves to segment the sequence into "words". The difficulty is to distinguish good segmentation from enormous number of random ones.Aiming at…
The study of particle correlations is an important instrument to understand the nature of relativistic heavy ion collisions. Using a wealth of new data available from the recent heavy ion runs of Large Hadron Collider at CERN it becomes…
Most of animal and human behavior occurs on time scales much longer than the response times of individual neurons. In many cases, it is plausible that these long time scales emerge from the recurrent dynamics of electrical activity in…
We estimate the $n$-gram entropies of natural language texts in word-length representation and find that these are sensitive to text language and genre. We attribute this sensitivity to changes in the probability distribution of the lengths…
The aim of this paper is to investigate various information-theoretic measures, including entropy, mutual information, and some systematic measures that based on mutual information, for a class of structured spiking neuronal network. In…
In one dimension very general results from conformal field theory and exact calculations for certain quantum spin systems have established universal scaling properties of the entanglement entropy between two parts of a critical system.…
Permutation entropy quantifies the diversity of possible orderings of the values a random or deterministic system can take, as Shannon entropy quantifies the diversity of values. We show that the metric and permutation entropy…
We use statistical estimates of the entropy rate of spike train data in order to make inferences about the underlying structure of the spike train itself. We first examine a number of different parametric and nonparametric estimators (some…
Information flow analysis is a powerful technique for reasoning about the sensitive information exposed by a program during its execution. While past work has proposed information theoretic metrics (e.g., Shannon entropy, min-entropy,…
In many real-world database systems, a large fraction of the data is represented by strings: sequences of letters over some alphabet. This is because strings can easily encode data arising from different sources. It is often crucial to…
The exact expression for the density matrix of the kink ground state of the ferromagnetic XXZ chain is obtained. Utilizing this, we exactly calculate various correlation functions such as the longitudinal and transverse spin-spin…
Labeled infinite trees provide combinatorial interpretations for many integer sequences generated by nested recurrence relations. Typically, such sequences are monotone increasing. Several of these sequences also have straightforward…