Related papers: Entropy, Macroscopic Information, and Phase Transi…
We review with a tutorial scope the information theory foundations of quantum statistical physics. Only a small proportion of the variables that characterize a system at the microscopic scale can be controlled, for both practical and…
Information dynamics is an emerging description of information processing in complex systems which describes systems in terms of intrinsic computation, identifying computational primitives of information storage and transfer. In this paper…
Information entropic measures such as Fisher information, Shannon entropy, Onicescu energy and Onicescu Shannon entropy of a symmetric double-well potential are calculated in both position and momentum space. Eigenvalues and eigenvectors of…
We make some observations regarding string/black hole correspondence with a view to understanding the nature of the quantum degrees of freedom of a black hole in string theory. In particular, we compare entropy change in analogous string…
In this paper, we present some results on information, complexity and entropy as defined below and we discuss their relations with the Kolmogorov-Sinai entropy which is the most important invariant of a dynamical system. These results have…
The interactions between three or more random variables are often nontrivial, poorly understood, and yet, are paramount for future advances in fields such as network information theory, neuroscience, genetics and many others. In this work,…
First, the relation between black holes and limitations on information of other systems is developed. After reviewing the relation of entropy to information, we derive the entropy bound, review its applications to cosmology and its…
Dynamical aspects of information-theoretic and entropic measures of quantum systems are studied. First, we show that for the time-dependent harmonic oscillator, as well as for the charged particle in certain time-varying electromagnetic…
We study the change in topological entanglement entropy that occurs when a two-dimensional system in a topologically ordered phase undergoes a transition to another such phase due to the formation of a Bose condensate. We also consider the…
We introduce the concept of {\em information compressibility}, $K_I$, which measures the relative change of number of available microstates of an open system in response to an energy variation. We then prove that at the time in which the…
We study an opinion formation model by the means of a co-evolving complex network where the vertices represent the individuals, characterised by their evolving opinions, and the edges represent the interactions among them. The network…
Geometric phases and information flows of a two-level system coupled to its environment are calculated and analyzed. The information flow is defined as a cumulant of changes in trace distance between two quantum states, which is similar to…
The thermodynamic definition of entropy can be extended to nonequilibrium systems based on its relation to information. To apply this definition in practice requires access to the physical system's microstates, which may be prohibitively…
We introduce an axiomatic approach to entropies and relative entropies that relies only on minimal information-theoretic axioms, namely monotonicity under mixing and data-processing as well as additivity for product distributions. We find…
This work explores entropy analysis as a tool for probing information distribution within Transformer-based architectures. By quantifying token-level uncertainty and examining entropy patterns across different stages of processing, we aim…
Conditional mutual information is important in the selection and interpretation of graphical models. Its empirical version is well known as a generalised likelihood ratio test and that it may be represented as a difference in entropy. We…
The criteria determining the sign of entropy change in the open system are formulated. The concepts of entrostat, degree of openness, critical level of ordering are entered. The opportunity of occurrence of entropy oscillations in a…
Maximum entropy estimation is of broad interest for inferring properties of systems across many different disciplines. In this work, we significantly extend a technique we previously introduced for estimating the maximum entropy of a set of…
Life is fundamentally a scientific enigma. The interplay between chaos, entropy dynamics, and Prigogine's dissipative systems offers profound insights into the emergence, stabilization, and eventual collapse of far-from-equilibrium systems.…
We show that using nonextensive entropy can lead to spontaneous symmetry breaking when a parameter changes its value from that applicable for a symmetric domain, as in field theory. We give the physical reasons and also show that even for…