English
Related papers

Related papers: The Renyi entropy as a "free entropy" for complex …

200 papers

By using the Jacobi metric of the configuration space, and assuming ergodicity, we calculate the Boltzmann entropy $S$ of a finite-dimensional system around a non-degenerate critical point of its potential energy $V$. We compare $S$ with…

Mathematical Physics · Physics 2009-11-11 Nikos Kalogeropoulos

We consider the meta-equilibrium state of a composite system made up of independent subsystems satisfying the additive form of external constraints, as recently discussed by Abe [Phys. Rev. E {\bf 63}, 061105 (2001)]. We derive the additive…

Statistical Mechanics · Physics 2009-11-10 Ramandeep S. Johal

Hierarchical structures, which include multiple levels, are prevalent in statistical and machine-learning models as well as physical systems. Extending the foundational result that the maximum entropy distribution under mean constraints is…

Information Theory · Computer Science 2025-09-03 Amir R. Asadi

Regardless of studies and debates over a century, the statistical origin of the second law of thermodynamics still remains illusive. One essential obstacle is the lack of a proper theoretical formalism for non-equilibrium entropy. Here I…

Statistical Mechanics · Physics 2017-10-18 Xiangjun Xing

Probabilistic reasoning systems combine different probabilistic rules and probabilistic facts to arrive at the desired probability values of consequences. In this paper we describe the MESA-algorithm (Maximum Entropy by Simulated Annealing)…

Artificial Intelligence · Computer Science 2013-03-25 Gerhard Paaß

We shall prove that the celebrated R\'enyi entropy is the first example of a new family of infinitely many multi-parametric entropies. We shall call them the $Z$-entropies. Each of them, under suitable hypotheses, generalizes the celebrated…

Mathematical Physics · Physics 2017-02-07 Piergiulio Tempesta

For open systems described by the quantum master equation (QME), we investigate the excess entropy production under quasistatic operations between nonequilibrium steady states. The average entropy production is composed of the time integral…

Statistical Mechanics · Physics 2017-11-06 Satoshi Nakajima , Yasuhiro Tokura

Superstatistics describes statistical systems that behave like superpositions of different inverse temperatures $\beta$, so that the probability distribution is $p(\epsilon_i) \propto \int_{0}^{\infty} f(\beta) e^{-\beta \epsilon_i}d\beta$,…

Statistical Mechanics · Physics 2016-10-03 Rudolf Hanel , Stefan Thurner , Murray Gell-Mann

Traditionally, the Method of (Shannon-Kullback's) Relative Entropy Maximization (REM) is considered with linear moment constraints. In this work, the method is studied under frequency moment constraints which are non-linear in…

Data Analysis, Statistics and Probability · Physics 2012-08-27 M. Grendar, , M. Grendar

For an isolated assembly that comprises a system and its surrounding reservoirs, the total entropy ($S_{a}$) always monotonically increases as time elapses. This phenomenon is known as the second law of thermodynamics ($S_{a}\geq0$). Here…

Computational Physics · Physics 2014-10-22 T. M. Shih , Z. J. Gao , H. Merlitz , L. Rondoni , P. J. Pagni , Z. Chen

Several approaches were used to proof the assumption that an universal upper bound on the entropy to energy ratio (S/E) exists in bounded systems. In 1981 Jacob D. Bekenstein published his findings that S/E is limited by the effective…

High Energy Physics - Theory · Physics 2009-01-26 Franz-Josef Schmitt

We show that there exists a natural way to define a condition of generalized thermal equilibrium between systems governed by Tsallis thermostatistics, under the hypotheses that i) the coupling between the systems is weak, ii) the structure…

Statistical Mechanics · Physics 2007-09-17 Massimo Marino

R\'enyi transfer entropy (RTE) is a generalization of classical transfer entropy that replaces Shannon's entropy with R\'enyi's information measure. This, in turn, introduces a new tunable parameter $\alpha$, which accounts for sensitivity…

Pattern Formation and Solitons · Physics 2026-01-06 Zlata Tabachová , Petr Jizba , Hynek Lavička , Milan Paluš

A complete mathematical theory of nonequilibrium thermodynamics of stochastic systems in terms of master equations is presented. As generalizations of isothermal entropy and free energy, two functions of states play central roles: the Gibbs…

Statistical Mechanics · Physics 2010-05-28 Hao Ge , Hong Qian

On a fine grained scale the Gibbs entropy of an isolated system remains constant throughout its dynamical evolution. This is a consequence of Liouville's theorem for Hamiltonian systems and appears to contradict the second law of…

Statistical Mechanics · Physics 2017-07-05 Renato Pakter , Yan Levin

In this work, we study the Renyi-alpha entropies S_{alpha}(\hat{rho}) = (1 - alpha)^{-1} \ln{Tr(\hat{rho}^{alpha})} of quantum states for N bosons in the phase-space representation. With the help of the Bopp rule, we derive the entropies of…

Statistical Mechanics · Physics 2019-04-09 Ilki Kim

We conjecture a universal upper bound to the entropy of a rotating system. The entropy bound follows from application of the generalized second law of thermodynamics to an idealized gedanken experiment in which an entropy-bearing rotating…

General Relativity and Quantum Cosmology · Physics 2009-10-31 Shahar Hod

In this work, we establish an exact relation which connects the heat exchange between two systems initialized in their thermodynamic equilibrium states at different temperatures and the R\'{e}nyi divergences between the initial…

Quantum Physics · Physics 2018-05-07 Bo-Bo Wei

Statistical properties of coupled dynamic-stochastic systems are studied within a combination of the maximum information principle and the superstatistical approach. The conditions at which the Shannon entropy functional leads to a…

Statistical Mechanics · Physics 2009-11-11 E. V. Vakarin , J. P. Badiali

Maximum entropy principle does not seem to distinguish between the use of Tsallis and Renyi entropies as either of them may be used to derive similar power-law distributions. In this paper, we address the question whether the Renyi entropy…

Statistical Mechanics · Physics 2007-05-23 Ramandeep S. Johal , Ugur Tirnakli