Related papers: Information theory approach (extensive and nonexte…
By a natural nonextensive generalization of the conservation of energy in the q-kinetic theory, we study the nonextensivity and the power-law distributions for the many-body systems with the self-gravitating long-range interactions. It is…
The problem of separating structured information representing phenomena of differing natures is considered. A structure is assumed to be independent of the others if can be represented in a complementary subspace. When the concomitant…
We propose predictive information, that is information between a long past of duration T and the entire infinitely long future of a time series, as a universal order parameter to study phase transitions in physical systems. It can be used,…
We pedagogically present the information theory as originally established, explaining its essential ideas and paying attention to the expression employed to measure the amount of information. Also we discussed relationships between…
Processes with multiparticle final states in weakly coupled theories, both with and without instantons, cannot be studied perturbatively at most interesting energies and multiplicities. Semiclassical approaches to the calculation of their…
While information theory has been introduced to characterize the fundamental limitations of control and filtering for a few decades, the existing information-theoretic methods are indirect and cumbersome for analyzing the limitations of…
(abridged) In this paper, we present the issues we consider as essential as far as the statistical mechanics of finite systems is concerned. In particular, we emphasis our present understanding of phase transitions in the framework of…
We argue that specific fluctuations observed in high-energy nuclear collisions can be attributed to intrinsic fluctuations of temperature of the hadronizing system formed in such processes and therefore can be described by the same…
The general theory of the branching processes is used for establishing the relation between the parameters $k$ and $\bar n$ of the negative binomial distribution. This relation gives the possibility to describe the overall data on…
Integrated information theory (IIT) has established itself as one of the leading theories for the study of consciousness. IIT essentially proposes that quantitative consciousness is identical to maximally integrated conceptual information,…
This is an attempt to address diffusion phenomena from the point of view of information theory. We imagine a regular hamiltonian system under the random perturbation of thermal (molecular) noise and chaotic instability. The irregularity of…
Many quantum chemical similarity measures have been derived and substantiated by applying concepts and quantities from information theory to the electron density. To justify the use of information theory, the electron density is usually…
Jaynes' information theory formalism of statistical mechanics is applied to the stationary states of open, non-equilibrium systems. The key result is the construction of the probability distribution for the underlying microscopic phase…
We deal with the power-law q-distribution functions, so-called q-exponentials in nonextensive statistics. The system considered is a many-body Hamiltonian system with arbitrary interacting potentials. We find that the usual form of…
It is well known that entropy production is a proxy to the detection of non-equilibrium, i.e. of the absence of detailed balance; however, due to the global character of this quantity, its knowledge does not allow to identify spatial…
We obtain generalizations of the Kelvin-Planck, Clausius, and Carnot statements of the second law of thermodynamics, for situations involving information processing. To this end, we consider an information reservoir (representing, e.g. a…
We consider a generalization of an important class of high-dimensional inference problems, namely spiked symmetric matrix models, often used as probabilistic models for principal component analysis. Such paradigmatic models have recently…
Information plays a pivotal role in the thermodynamics of nonequilibrium processes with feedback. However, much remains to be learned about the nature of information fluctuations in small scale devices and their relation with fluctuations…
This thesis uses a quantity that is defined and justified by information theory -- mutual information -- to examine models of condensed matter systems. More precisely, it studies models which are made up out of ferromagnetically interacting…
We will discuss the maximum entropy production (MaxEP) principle based on Jaynes' information theoretical arguments, as was done by Dewar (2003, 2005). With the help of a simple mathematical model of a non-equilibrium system, we will show…