Related papers: Conjecture of an information-response inequality
We present a dynamical theory of statistical convergence in which the law of large numbers arises from outcome-outcome feedback rather than assumed independence. Defining the convergence field and its derivative, we show that empirical…
A new measure of information in quantum mechanics is proposed which takes into account that for quantum systems the only feature known before an experiment is performed are the probabilities for various events to occur. The sum of the…
An information theoretic measure is derived that quantifies the statistical coherence between systems evolving in time. The standard time delayed mutual information fails to distinguish information that is actually exchanged from shared…
We define the concept of dependence among multiple variables using maximum entropy techniques and introduce a graphical notation to denote the dependencies. Direct inference of information theoretic quantities from data uncovers…
Some general considerations on the notion of entropy in physics are presented. An attempt is made to clarify the question of the differentiation between physical entropy (the Clausius-Boltzmann one) and quantities called entropies…
We study the problem of data integration from sources that contain probabilistic uncertain information. Data is modeled by possible-worlds with probability distribution, compactly represented in the probabilistic relation model. Integration…
We study the informational underpinnings of thermodynamics and statistical mechanics, using an abstract framework, general probabilistic theories, capable of describing arbitrary physical theories. This allows one to abstract the…
This note studies the exponential convergence of input-output signals of discrete-time nonlinear systems composed of a feedback interconnection of a linear time-invariant system and a nonlinear uncertainty. Both the open-loop subsystems are…
In mathematics information is a number that measures uncertainty (entropy) based on a probabilistic distribution, often of an obscure origin. In real life language information is a datum, a statement, more precisely, a formula. But such a…
A fluctuation theorem is proved for the macroscopic currents of a system in a nonequilibrium steady state, by using Schnakenberg network theory. The theorem can be applied, in particular, in reaction systems where the affinities or…
The paper deals with the order statistics and empirical mathematical expectation (which is also called the estimate of mathematical expectation in the literature) in the case of infinitely increasing random variables. The Kolmogorov concept…
The form and justification of inductive inference rules depend strongly on the representation of uncertainty. This paper examines one generic representation, namely, incomplete information. The notion can be formalized by presuming that the…
The Fluctuation Theorem describes the probability ratio of observing trajectories that satisfy or violate the second law of thermodynamics. It has been proved in a number of different ways for thermostatted deterministic nonequilibrium…
The mutual information is bounded from above by a decreasing affine function of the square of the distance between the input distribution and the set of all capacity-achieving input distributions $\Pi_{\mathcal{A}}$, on small enough…
Most psychophysical experiments discard half the data collected. Specifically, experiments discard reaction time data, and use binary responses (e.g. yes/no) to measure performance. Here, Shannon's information theory is used to define…
The study of inter-human communication requires a more complex framework than Shannon's (1948) mathematical theory of communication because "information" is defined in the latter case as meaningless uncertainty. Assuming that meaning cannot…
We consider a particle dragged through a medium at constant temperature as described by a Langevin equation with a time-dependent potential. The time-dependence is specified by an external protocol. We give conditions on potential and…
This article deals with plausible reasoning from incomplete knowledge about large-scale spatial properties. The availableinformation, consisting of a set of pointwise observations,is extrapolated to neighbour points. We make use of belief…
So far, the theory of equilibrium selection in the infinitely repeated prisoner's dilemma is insensitive to communication possibilities. To address this issue, we incorporate the assumption that communication reduces -- but does not…
Using the linearized version of the time dependent Gross-Pitaevskii equation we calculate the dynamic response of a Bose-Einstein condensed gas to periodic density and particle perturbations. The zero temperature limit of the…