Related papers: Differential Properties of Information in Jump-dif…
This thesis uses a quantity that is defined and justified by information theory -- mutual information -- to examine models of condensed matter systems. More precisely, it studies models which are made up out of ferromagnetically interacting…
The brain works as a dynamic system to process information. Various challenges remain in understanding the connection between information and dynamics attributes in the brain. The present research pursues exploring how the characteristics…
This paper proposes a unifying variational approach for proving and extending some fundamental information theoretic inequalities. Fundamental information theory results such as maximization of differential entropy, minimization of Fisher…
The Tsallis entropy and Fisher information entropy (matrix) are very important quantities expressing information measures in nonextensive systems. Stationary and dynamical properties of the information entropies have been investigated in…
Mutual information is a theoretically grounded metric for quantifying cellular signaling pathways. However, its measurement demands characterization of both input and output distributions, limiting practical applications. Here, we present…
We present a diffeomorphism-invariant formulation of differential entropy for Riemannian spaces, providing a fine-grained, coordinate-independent notion of quantum information for continuous variables in physical space. To this end, we…
In the recent years, information theory of quantum-mechanical systems have aroused the interest of many Theoretical Physicist. This due to the fact that it provides a deeper insight into the internal structure of the systems. Also, It is…
For one-dimensional Jump-Drift and Jump-Diffusion processes converging towards some steady state, the large deviations of a long dynamical trajectory are described from two perspectives. Firstly, the joint probability of the empirical…
In this communication, we describe some interrelations between generalized $q$-entropies and a generalized version of Fisher information. In information theory, the de Bruijn identity links the Fisher information and the derivative of the…
Diffusive approximations of Markov jump processes often fail to accurately capture large fluctuations. This is confounding, as the rare events triggered by these large fluctuations, such as the failure of electronic memories, are often the…
Modeling communication channels as thermal systems results in Hamiltonians which are an explicit function of the temperature. The first two authors have recently generalized the second thermodynamic law to encompass systems with…
In this paper, we study Sibson's $\alpha$-mutual information in the context of the additive Gaussian noise channel. While the classical case $\alpha = 1$ is well understood and admits deep connections to estimation-theoretic quantities,…
We present a generalized linear response theory for mixed jump-diffusion models -- combining Gaussian and L\'evy noise interacting with nonlinear dynamics -- by deriving comprehensive response formulas accounting for perturbations to both…
Hidden information emerges under impulse interactions with Markov diffusion process modeling interactive random environment. Impulse yes no action cuts Markov correlations revealing Bit of hidden information connected correlated states.…
The information-theoretic representation of quantum systems, which complements the familiar energy description of the density-functional and wave-function-based theories, is here discussed. According to it, the internal disorder of the…
We estimate a general mixture of Markov jump processes. The key novel feature of the proposed mixture is that the transition intensity matrices of the Markov processes comprising the mixture are entirely unconstrained. The Markov processes…
We propose to use the quantum Fisher information in characterizing the information flow of open quantum systems. This information-theoretic approach provides a quantitative measure to statistically distinguish Markovian and non-Markovian…
We consider two non-Markovian models: Random Telegraph Noise (RTN) and non-Markovian dephasing (NMD). The memory in these models is studied from the perspective of quantum Fisher information flow. This is found to be consistent with the…
Besides mimicking bio-chemical and multi-scale communication mechanisms, molecular communication forms a theoretical framework for virus infection processes. Towards this goal, aerosol and droplet transmission has recently been modeled as a…
We develop an information-theoretic approach to isoperimetric inequalities based on entropy dissipation under heat flow. By viewing diffusion as a noisy information channel, we measure how mutual information about set membership decays over…