Related papers: Information-theoretic analysis of the directional …
We analyze the effects of noise on the permutation entropy of dynamical systems. We take as numerical examples the logistic map and the R\"ossler system. Upon varying the noise strengthfaster, we find a transition from an…
We define the concept of dependence among multiple variables using maximum entropy techniques and introduce a graphical notation to denote the dependencies. Direct inference of information theoretic quantities from data uncovers…
The fluctuation relations have received considerable attention since their emergence and development in the 1990s. We present a summary of the main results and suggest ways to interpret this material. Starting with a consideration of the…
In nervous system information is conveyed by sequence of action potentials (spikes-trains). As MacKay and McCulloch proposed, spike-trains can be represented as bits sequences coming from Information Sources. Previously, we studied…
We define a new measure of causation from a fluctuation-response theorem for Kullback-Leibler divergences, based on the information-theoretic cost of perturbations. This information response has both the invariance properties required for…
Information theoretic measures (entropies, entropy rates, mutual information) are nowadays commonly used in statistical signal processing for real-world data analysis. The present work proposes the use of Auto Mutual Information (Mutual…
We study full counting statistics for transferred heat and entropy production between multi-terminal systems in absence of a finite junction. The systems are modelled as collections of coupled harmonic oscillators which are kept at…
We apply information theoretic entropies of coordinate and velocity distributions in quantum mechanics for the description of the strong field ionization process. The approach is based on the properties of the entropies used in the…
How does the information flow between different brain regions during various stimuli? This is the question we aim to address by studying complex cognitive paradigms in terms of Information Theory. To assess creativity and the emergence of…
We analyze the probability distribution for entropy production rates of trajectories evolving on a class of out-of-equilibrium kinetic networks. These networks can serve as simple models for driven dynamical systems, which are of particular…
Elucidating principles that underlie computation in neural networks is currently a major research topic of interest in neuroscience. Transfer Entropy (TE) is increasingly used as a tool to bridge the gap between network structure, function,…
Fluctuations play a central role in many fields of physics, from quantum electrodynamics to statistical mechanics. In active matter physics, most models focus on thermal fluctuations due to a surrounding solvent. An alternative but much…
We experimentally demonstrate that highly structured distributions of work emerge during even the simple task of erasing a single bit. These are signatures of a refined suite of time-reversal symmetries in distinct functional classes of…
We have studied the entropy-driven mechanism leading to stationary patterns formation in stochastic systems with local dynamics and non-Fickian diffusion. We have shown that a multiplicative noise fulfilling a fluctuation-dissipation…
Typical experimental measurement is set up as a study of the system's response to a stationary external excitation. This approach considers any random fluctuation of the signal as spurious contribution which is to be eliminated via…
We consider the asymptotic behaviour of the fluctuation process for large stochastic systems of interacting particles driven by both idiosyncratic and common noise with an interaction kernel \(k \in L^2(\R^d) \cap L^\infty(\R^d)\). Our…
The myriad microscopic interactions among the individual organisms that constitute an ecological system collectively give rise, at the macroscopic scale, to evolutionary trends. The ability to detect the directionality of such trends is…
Collective behavior, both in real biological systems as well as in theoretical models, often displays a rich combination of different kinds of order. A clear-cut and unique definition of "phase" based on the standard concept of order…
Transfer entropy, an information-theoretic measure of time-directed information transfer between joint processes, has steadily gained popularity in the analysis of complex stochastic dynamics in diverse fields, including the neurosciences,…
Quantitative single cell measurements have shown that cell cycle duration (the time between cell divisions) for diverse cell types is a noisy variable. The underlying distribution is mean scalable with a universal shape for many cell types…