相关论文: Role of sufficient statistics in stochastic thermo…
For a general sensory system following an external stochastic signal, we introduce the sensory capacity. This quantity characterizes the performance of a sensor: sensory capacity is maximal if the instantaneous state of the sensor has as…
Biological systems process information under noisy environment. Sensory adaptation model of E. coli is suitable for investigation because of its simplicity. To understand the adaptation processing quantitatively, stochastic thermodynamic…
Adaptation is used by biological sensory systems to respond to a wide range of environmental signals, by adapting their response properties to the statistics of the stimulus in order to maximize information transmission. We derive rules of…
The deep connection between thermodynamics, computation, and information is now well established both theoretically and experimentally. Here, we extend these ideas to show that thermodynamics also places fundamental constraints on…
A system responding to a stochastic driving signal can be interpreted as computing, by means of its dynamics, an implicit model of the environmental variables. The system's state retains information about past environmental fluctuations,…
Statistical divergences are important tools in data analysis, information theory, and statistical physics, and there exist well known inequalities on their bounds. However, in many circumstances involving temporal evolution, one needs…
The incomplete nonextensive statistics in the canonical and microcanonical ensembles is explored in the general case and in a particular case for the ideal gas. By exact analytical results for the ideal gas it is shown that taking the…
In this work we explore encoding strategies learned by statistical models of sensory coding in noisy spiking networks. Early stages of sensory communication in neural systems can be viewed as encoding channels in the information-theoretic…
Formalism based on equilibrium statistical thermodynamics is applied to communication networks of decision making individuals. It is shown that in statistical ensembles for choice models, properly defined disutility can play the same role…
Statistical analysis is used throughout biomedical research and elsewhere to assess strength of evidence. We have previously argued that typical outcome statistics (including p-values and maximum likelihood ratios) have poor…
Equilibrium statistical mechanics is intended to link the microscopic dynamics of particles to the thermodynamic laws for macroscopic quantities. However, the modern statistical theory is faced with significant difficulties, as applied to…
We expand upon a natural analogy between Bayesian statistics and statistical physics in which sample size corresponds to inverse temperature. This analogy motivates the definition of two novel statistical quantities: a learning capacity and…
The reliable detection of environmental molecules in the presence of noise is an important cellular function, yet the underlying computational mechanisms are not well understood. We introduce a model of two interacting sensors which allows…
Adaptive physical and biological systems continually process fluctuating information from their environments. When the environment is nonstationary, inference itself becomes a nonequilibrium process with thermodynamic cost. We analyse a…
Statistical mechanics relies on the complete though probabilistic description of a system in terms of all the microscopic variables. Its object is to derive therefrom static and dynamic properties involving some reduced set of variables.…
A sufficient statistic is a deterministic function that captures an essential property of a probabilistic function (channel, kernel). Being a sufficient statistic can be expressed nicely in terms of string diagrams, as Tobias Fritz showed…
In view of the relation between information and thermodynamics we investigate how much information about an external protocol can be stored in the memory of a stochastic measurement device given an energy budget. We consider a layered…
Within both slightly non--extensive statistics and related numerical model, a picture is elaborated to treat self--similar time series as a thermodynamic system. Thermodynamic--type characteristics relevant to temperature, pressure,…
Conventional thermo-statistics address infinite homogeneous systems within the canonical ensemble. (Only in this case this is equivalent to the fundamental microcanonical ensemble.) However, some 170 years ago the original motivation of…
Statistical modeling often involves identifying an optimal estimate to some underlying probability distribution known to satisfy some given constraints. I show here that choosing as estimate the centroid, or center of mass, of the set…