Related papers: R\'enyi Information flow in the Ising model with s…
Information dynamics is an emerging description of information processing in complex systems which describes systems in terms of intrinsic computation, identifying computational primitives of information storage and transfer. In this paper…
Configurational entropy, or complexity, plays a critical role in characterizing disordered systems such as glasses, yet its measurement often requires significant computational resources. Recently, R\'enyi entropy, a one-parameter…
We extend the principles of information thermodynamics to study energy and information exchanges between coupled systems composed of one part undergoing a Markov jump process and another underdamped diffusion. We derive integral fluctuation…
The scaling of entanglement with subsystem size encodes key information about phases and criticality, but the von Neumann entropy is costly to access in experiments and simulations, often requiring full state tomography. The second R\'enyi…
We study mutual information for Renyi entropy of arbitrary index n, in interacting quantum systems at finite-temperature critical points, using high-temperature expansion, quantum Monte Carlo simulations and scaling theory. We find that for…
We propose and experimentally measure an entropy that quantifies the volume of correlations among qubits. The experiment is carried out on a nearly isolated quantum system composed of a central spin coupled and initially uncorrelated with…
The $q$-neighbor Ising model is investigated on homogeneous random graphs with a fraction of edges associated randomly with antiferromagnetic exchange integrals and the remaining edges with ferromagnetic ones. It is a nonequilibrium model…
We consider a bipartite quantum conductor and analyze fluctuations of heat quantity in a subsystem as well as self-information associated with the reduced-density matrix of the subsystem. By exploiting the multi-contour Keldysh technique,…
Fluctuations in biochemical networks, e.g., in a living cell, have a complex origin that precludes a description of such systems in terms of bipartite or multipartite processes, as is usually done in the framework of stochastic and/or…
Using the formalism of information theory, we analyze the mechanism of information transduction in a simple one-step signaling cascade S$\rightarrow$X representing the gene regulatory network. Approximating the signaling channel to be…
We consider a chain of spin-half particles of a finite length, evolved with the mixed-field Ising Hamiltonian and impose open boundary condition. We simulate the time evolution of entanglement entropy and mutual information following quench…
Shannon Information theory has achieved great success in not only communication technology where it was originally developed for but also many other science and engineering fields such as machine learning and artificial intelligence.…
The R\'enyi entanglement entropy is calculated exactly for mode-partitioned isolated systems such as the two-mode squeezed state and the multi-mode Silbey-Harris polaron ansatz state. Effective thermodynamic descriptions of the correlated…
Renyi entropy with multiple disjoint intervals are computed from the improved swapping operations by two methods: one is from the direct diagonalization of the Hamiltonian and the other one is from the state-of-the-art machine learning…
The de Bruijn identity states that Fisher information is equal to a half of the time-derivative of Shannon differential entropy along heat flow. In the same spirit, a generalized version of Fisher information, which we term the…
In this paper, we calculate the R\'enyi entropy of one single interval on a circle at finite temperature in 2D CFT. In the low temperature limit, we expand the thermal density matrix level by level in the vacuum Verma module, and calculate…
We study nonequilibrium thermodynamics of complex information flows induced by interactions between multiple fluctuating systems. Characterizing nonequilibrium dynamics by causal networks (i.e., Bayesian networks), we obtain novel…
For sensory networks, we determine the rate with which they acquire information about the changing external conditions. Comparing this rate with the thermodynamic entropy production that quantifies the cost of maintaining the network, we…
We present simple and computationally efficient nonparametric estimators of R\'enyi entropy and mutual information based on an i.i.d. sample drawn from an unknown, absolutely continuous distribution over $\R^d$. The estimators are…
R\'enyi entropies are conceptually valuable and experimentally relevant generalisations of the celebrated von Neumann entanglement entropy. After a quantum quench in a clean quantum many-body system they generically display a universal…