Related papers: Entropy methods in random motion
Convergence properties of Shannon Entropy are studied. In the differential setting, it is shown that weak convergence of probability measures, or convergence in distribution, is not enough for convergence of the associated differential…
We explore the measurement problem in the entropic dynamics approach to quantum theory. The dual modes of quantum evolution---either continuous unitary evolution or abrupt wave function collapse during measurement---are unified by virtue of…
A quantum statistical expression for the entropy of a nonequilibrium system is defined so as to be consistent with Gibbs' relation, and is shown to corresponds to dynamical variable by introducing analogous to the Heisenberg picture in…
In this paper we apply the entropy principle to the relativistic version of the differential equations describing a standard fluid flow, that is, the equations for mass, momentum, and a system for the energy matrix. These are the second…
Formalising the confrontation of opinions (models) to observations (data) is the task of Inferential Statistics. Information Theory provides us with a basic functional, the relative entropy (or Kullback-Leibler divergence), an asymmetrical…
Some general considerations on the notion of entropy in physics are presented. An attempt is made to clarify the question of the differentiation between physical entropy (the Clausius-Boltzmann one) and quantities called entropies…
Many thermodynamic relations involve inequalities, with equality if a process does not involve dissipation. In this article we provide equalities in which the dissipative contribution is shown to involve the relative entropy (a.k.a.…
Gathering the most information by picking the least amount of data is a common task in experimental design or when exploring an unknown environment in reinforcement learning and robotics. A widely used measure for quantifying the…
Entropic uncertainty relations for the position and momentum within the generalized uncertainty principle are examined. Studies of this principle are motivated by the existence of a minimal observable length. Then the position and momentum…
We study the entropy production of Gibbs (equilibrium) measures for chaotic dynamical systems with folding of the phase space. The dynamical chaotic model is that generated by a hyperbolic non-invertible map $f$ on a general basic (possibly…
We develop the argument that the Gibbs-von Neumann entropy is the appropriate statistical mechanical generalisation of the thermodynamic entropy, for macroscopic and microscopic systems, whether in thermal equilibrium or not, as a…
Systems with long-range interactions display a short-time relaxation towards Quasi Stationary States (QSS) whose lifetime increases with the system size. In the paradigmatic Hamiltonian Mean-field Model (HMF) out-of-equilibrium phase…
An information theory description of finite systems explicitly evolving in time is presented for classical as well as quantum mechanics. We impose a variational principle on the Shannon entropy at a given time while the constraints are set…
In this paper we develop a general formalism of a path approach for non-equilibrium statistical mechanics. Firstly, we consider the classical Gibbs approach for states and find that this formalism is ineffective for non-equilibrium…
Let $\mathcal{F}$ be a $C^2$ random partially hyperbolic dynamical system. For the unstable foliation, the corresponding unstable metric entropy, unstable topological entropy and unstable pressure via the dynamics of $\mathcal{F}$ on the…
Filyokov and Karpov [Inzhenerno-Fizicheskii Zhurnal 13, 624 (1967)] have proposed a theory of non-equilibrium steady states in direct analogy with the theory of equilibrium states : the principle is to maximize the Shannon entropy…
Statistical thermodynamics is valuable as a conceptual structure that shapes our thinking about equilibrium thermodynamic states. A cloud of unresolved questions surrounding the foundations of the theory could lead an impartial observer to…
The Boltzmann and Gibbs approaches to statistical mechanics have very different definitions of equilibrium and entropy. The problems associated with this are discussed and it is suggested that they can be resolved, to produce a version of…
The new estimates of the conditional Shannon entropy are introduced in the framework of the model describing a discrete response variable depending on a vector of d factors having a density w.r.t. the Lebesgue measure in R^d. Namely, the…
The Shannon based conditional entropy that underlies five-dimensional Einstein-Hilbert gravity coupled to a dilaton field is investigated in the context of dynamical holographic AdS/QCD models. Considering the UV and IR dominance limits of…