Related papers: A Dynamic Theory of Information and Entropy
Many biological phenomena or social events critically depend on how information evolves in complex networks. However, a general theory to characterize information evolution is yet absent. Consequently, numerous unknowns remain about the…
Entropy is a famous and well established concept in physics and engineering that can be used for explanation of basic fundamentals as well it finds applications in several areas, from quantum physics to astronomy, from network communication…
We consider discrete stochastic processes, modeled by classical master equations, on networks. The temporal growth of the lack of information about the system is captured by its non-equilibrium entropy, defined via the transition…
We study the approach to equilibrium of systems of gas particles in terms of relative entropy. The systems are modeled by the Kac master equation in arbitrary dimensions. First, we study the Kac system coupled to a thermostat, and secondly…
The thermodynamic entropy of an isolated system is given by its von Neumann entropy. Over the last few years, there is an intense activity to understand thermodynamic entropy from the principles of quantum mechanics. More specifically, is…
We introduce the concept of {\em information compressibility}, $K_I$, which measures the relative change of number of available microstates of an open system in response to an energy variation. We then prove that at the time in which the…
The black-hole information paradox has fueled a fascinating effort to reconcile the predictions of general relativity and those of quantum mechanics. Gravitational considerations teach us that black holes must trap everything that falls…
This study explores the role of information entropy in understanding nuclear density distributions, including both stable configurations and non-traditional structures such as neutron halos and $\alpha$-clustering. By quantifying the…
We revisit in detail the paradox of black hole information loss due to Hawking radiation as tunneling. We compute the amount of information encoded in correlations among Hawking radiations for a variety of black holes, including the…
There is natural association of entropy with gravitational systems on one hand and partition of natural numbers on the other hand. We show that given a partition of natural numbers, it is possible to directly associate a metric with it.…
A unified combinatorial definition of the information content and entropy of different types of patterns, compatible with the traditional concepts of information and entropy, going beyond the limitations of Shannon information interpretable…
This paper is devoted to the mathematical study of some divergences based on the mutual information well-suited to categorical random vectors. These divergences are generalizations of the "entropy distance" and "information distance". Their…
We investigate how undecidability enters into computations of classical physical systems and contributes to the increase of entropy and loss of information. In actual computation with finite bit of information capacity we accept…
When the difference between changes in energy and entropy at a given temperature is correlated with the ratio between the same changes in energy and entropy at zero average free energy of an ensemble of similar but distinct molecule-sized…
A possible mechanism of time is formulated by developing an idea of time replaced by quantum correlations, with the aid of modern quantum information theory. We invent a microscopic model, where correlations of a closed system are steadily…
Recent hints from observations of distant supernovae of a positive cosmological constant with magnitude comparable to the average density of matter seem to point in the direction of a two fluid model for spacetime; where the "normal"…
The aim of this chapter is twofold. First, we introduce the information loss problem; second, we provide a critical assessment by thoroughly inspecting the assumptions underlying its formulations. In particular, we argue that if we work in…
Shannon information entropy is a natural measure of probability (de)localization and thus (un)predictability in various procedures of data analysis for model systems. We pay particular attention to links between the Shannon entropy and the…
Information (I) is defined as the amount of the data after data compression. The first law of information theory: the total amount of data L (the sum of entropy S and information I) of an isolated system remains unchanged. The second law of…
We propose an information theoretic model for sociological networks. The model is a microcanonical ensemble of states and particles. The states are the possible pairs of nodes (i.e. people, sites and alike) which exchange information. The…