Related papers: Fluctuation-response theorem for Kullback-Leibler …
We investigate the problem of estimating the causal effect of a treatment on individual subjects from observational data, this is a central problem in various application domains, including healthcare, social sciences, and online…
For thermostatted dissipative systems the Fluctuation Theorem gives an analytical expression for the ratio of probabilities that the time averaged entropy production in a finite system observed for a finite time, takes on a specified value…
We analyze dynamical properties of the Shannon information entropy of a continuous probability distribution, which is driven by a standard diffusion process. This entropy choice is confronted with another option, employing the conditional…
A derivation of the Fluctuation-Dissipation Theorem for the microcanonical ensemble is presented using linear response theory. The theorem is stated as a relation between the frequency spectra of the symmetric correlation and response…
Multivariate datasets are common in various real-world applications. Recently, copulas have received significant attention for modeling dependencies among random variables. A copula-based information measure is required to quantify the…
This paper addresses the problem of distributed detection in fixed and switching networks. A network of agents observe partially informative signals about the unknown state of the world. Hence, they collaborate with each other to identify…
We study the response of dynamical systems to finite amplitude perturbation. A generalized Fluctuation-Response relation is derived, which links the average relaxation toward equilibrium to the invariant measure of the system and points out…
We discuss a system of a nonlinear Kerr-like oscillator externally pumped by ultra-short, external, coherent pulses. For such a system, we analyse the application of the Kullback-Leibler quantum divergence $K[\rho||\sigma]$ to the detection…
We derive an exact expression of the response function to an infinitesimal magnetic field for the Ising-Glauber model with arbitrary exchange couplings.nThe result is expressed in terms of thermodynamic averages and does not depend on…
This work outlines the novel application of the empirical analysis of causation, presented by Kutach, to the study of information theory and its role in physics. The central thesis of this paper is that causation and information are…
Landauer's principle states that the erasure of one bit of information requires the free energy kT ln 2. We argue that the reliability of the bit erasure process is bounded by the accuracy inherent in the statistical state of the energy…
We introduce an information-theoretic method for quantifying causality in chaotic systems. The approach, referred to as IT-causality, quantifies causality by measuring the information gained about future events conditioned on the knowledge…
Information theory is a practical and theoretical framework developed for the study of communication over noisy channels. Its probabilistic basis and capacity to relate statistical structure to function make it ideally suited for studying…
For non-equilibrium systems of interacting particles and for interacting diffusions in d dimensions, a novel fluctuation relation is derived. The theorem establishes a quantitative relation between the probabilities of observing two current…
Nonequilibrium systems exchange the energy with an environment in the form of work and heat. The work done on a system obeys the fluctuation theorem, while the dissipated heat which differs from the work by the internal energy change does…
Understanding a complex system entails capturing the non-trivial collective phenomena that arise from interactions between its different parts. Information theory is a flexible and robust framework to study such behaviours, with several…
Accurately determining dependency structure is critical to discovering a system's causal organization. We recently showed that the transfer entropy fails in a key aspect of this---measuring information flow---due to its conflation of dyadic…
The fluctuation-dissipation theorem requires the presence of thermal noise in viscous fluids. The time and length scales of heavy ion collisions are small enough so that the thermal noise can have a measurable effect on observables. Thermal…
In this Article we review some recent progresses in the field of non-equilibrium linear response theory. We show how a generalization of the fluctuation-dissipation theorem can be derived for Markov processes, and discuss the…
Transient phenomena play a key role in coordinating brain activity at multiple scales, however,their underlying mechanisms remain largely unknown. A key challenge for neural data science is thus to characterize the network interactions at…