Related papers: Boltzmann Entropy : Probability and Information
A definition of the thermodynamic entropy based on the time-dependent probability distribution of the macroscopic variables is developed. When a constraint in a composite system is released, the probability distribution for the new…
Entropy is one of the key thermodynamic variables reflecting changes in the state of matter. Unlike other thermodynamic variables, it is well-defined also for nonequilibrium steady states through its relation to information. Applying this…
In this work we study the evolution of Boltzmann's entropy in the context of free expansion of a one dimensional interacting gas inside a box. Boltzmann's entropy is defined for single microstates and is given by the phase-space volume…
In quantum information theory, von Neumann entropy plays an important role. The entropies can be obtained analytically only for a few states. In continuous variable system, even evaluating entropy numerically is not an easy task since the…
In statistical mechanics, measuring the number of available states and their probabilities, and thus the system's entropy, enables the prediction of the macroscopic properties of a physical system at equilibrium. This predictive capacity…
The possible distinction between inanimate and living matter has been of interest to humanity since thousands of years. Clearly, such a rich question can not be answered in a single manner, and a plethora of approaches naturally do exist.…
We argue that the entanglement entropy for a very small subsystem obeys a property which is analogous to the first law of thermodynamics when we excite the system. In relativistic setups, its effective temperature is proportional to the…
A restricted Boltzmann machine is a generative probabilistic graphic network. A probability of finding the network in a certain configuration is given by the Boltzmann distribution. Given training data, its learning is done by optimizing…
We give meaning to the first and second laws of thermodynamics in case of mesoscopic out-of-equilibrium systems which are driven by diffusion processes. The notion of the entropy production is analyzed. The role of the Helmholtz extremum…
In these decades, it has been revealed that there is rich information-theoretic structure in thermodynamics of out-of-equilibrium systems in both the classical and quantum regimes. This has led to the fruitful interplay among statistical…
Superstatistics generalizes Boltzmann statistics by assuming spatio-temporal fluctuations of the intensive variables. It has many applications in the analysis of experimental and simulated data. The fluctuation of the intensity variable is…
Entropy concept was introduced by Clausius 160 years ago, and has been continually enriched, developed and interpreted by the researchers in many different scientific disciplines ever since. Thermodynamics and other scientific disciplines…
Boltzmann's Principle S = k ln W was repeatedly criticized by Einstein since it lacked a proper dynamical foundation in view of the thermal motion of the particles, out of which a physical system consists. This suggests, in particular, that…
There are three ways to conceptualize entropy: entropy as an extensive thermodynamic quantity of physical systems (Clausius, Boltzmann, Gibbs), entropy as a measure for information production of ergodic sources (Shannon), and entropy as a…
This article introduces the physics of information in the context of molecular biology and genomics. Entropy and information, the two central concepts of Shannon's theory of information and communication, are often confused with each other…
In this paper, we investigate and compare two well-developed definitions of entropy relevant for describing the dynamics of isolated quantum systems: bipartite entanglement entropy and observational entropy. In a model system of interacting…
A thermodynamic-like formalism is developed for superstatistical systems based on conditional entropies. This theory takes into account large-scale variations of intensive variables of systems in nonequilibrium stationary states. Ordinary…
We numerically determine the entropy for heat-conducting states, which is connected to the so-called excess heat considered as a basic quantity for steady-state thermodynamics in nonequilibrium. We adopt an efficient method to estimate the…
The Boltzmann and Gibbs approaches to statistical mechanics have very different definitions of equilibrium and entropy. The problems associated with this are discussed and it is suggested that they can be resolved, to produce a version of…
A colloquial interpretation of entropy is that it is the knowledge gained upon learning the outcome of a random experiment. Conditional entropy is then interpreted as the knowledge gained upon learning the outcome of one random experiment…