Related papers: The Renyi entropy as a "free entropy" for complex …
The entropic form $S_q$ is, for any $q \neq 1$, {\it nonadditive}. Indeed, for two probabilistically independent subsystems, it satisfies $S_q(A+B)/k=[S_q(A)/k]+[S_q(B)/k]+(1-q)[S_q(A)/k][S_q(B)/k] \ne S_q(A)/k+S_q(B)/k$. This form will…
One of the outstanding problems in non-equilibrium physics is to precisely understand when and how physically relevant observables in many-body systems equilibrate under unitary time evolution. General equilibration results show that…
We study the validity of Bekenstein's entropy bound for a charged black hole in the context of nonlinear electrodynamics. Bekenstein's inequalities are commonly understood as universal relations between the entropy, the charge, the…
We use rigorous non-equilibrium thermodynamic arguments to prove (i) the residual entropy of any system is bounded below by the experimentally (calorimetrically) determined absolute temperature entropy, which itself is bounded below by the…
A central concept in the connection between physics and information theory is entropy, which represents the amount of information extracted from the system by the observer performing measurements in an experiment. Indeed, Jaynes' principle…
A way to construct Boltzmann entropy, i.e., the entropy as a function of a microscopic pure state, for quantum field systems is proposed. Operators that shift the field in wavevector space are used in the construction. By employing an…
We introduce R\'enyi entropy of a subsystem energy as a natural quantity which closely mimics the behavior of the entanglement entropy and can be defined for all the quantum many body systems. For this purpose, consider a quantum chain in…
The limit of small entropy production is reached in relaxing systems long after preparation, and in stationary driven systems in the limit of small driving power. Surprisingly, for extended systems this limit is not in general the…
We consider the problem of approximating the empirical Shannon entropy of a high-frequency data stream under the relaxed strict-turnstile model, when space limitations make exact computation infeasible. An equivalent measure of entropy is…
In this study we apply the maximum entropy principle to derive the properly scaled velocity distribution function of Boltzmann equations for mixtures, which leads to a non-isothermal Maxwell-Stefan diffusion model. We also analyze the…
We developed a perturbative calculation for entropy dynamics considering a sudden coupling between a system and a bath. The theory we developed can work in general environment without Markovian approximation. A perturbative formula is given…
In this paper we review various information-theoretic characterizations of the approach to equilibrium in biological systems. The replicator equation, evolutionary game theory, Markov processes and chemical reaction networks all describe…
We ask the question whether entropy accumulates, in the sense that the operationally relevant total uncertainty about an $n$-partite system $A = (A_1, \ldots A_n)$ corresponds to the sum of the entropies of its parts $A_i$. The Asymptotic…
Entropy production (EP) is known as a fundamental quantity for measuring the irreversibility of processes in thermal equilibrium and states far from equilibrium. In stochastic thermodynamics, the EP becomes more visible in terms of the…
Boltzmann defined the entropy of a macroscopic system in a macrostate $M$ as the $\log$ of the volume of phase space (number of microstates) corresponding to $M$. This agrees with the thermodynamic entropy of Clausius when $M$ specifies the…
Configurational entropy, or complexity, plays a critical role in characterizing disordered systems such as glasses, yet its measurement often requires significant computational resources. Recently, R\'enyi entropy, a one-parameter…
A novel definition of the conditional smooth Renyi entropy, which is different from that of Renner and Wolf, is introduced. It is shown that our definition of the conditional smooth Renyi entropy is appropriate to give lower and upper…
Boltzmann's principle is used to select the "most probable" realization (macrostate) of an isolated or closed thermodynamic system, containing a small number of particles ($N \llsp \infty$), for both classical and quantum statistics. The…
Recent work emphasizes that the maximum entropy principle provides a bridge between statistical mechanics models for collective behavior in neural networks and experiments on networks of real neurons. Most of this work has focused on…
The Random Permutation Set (RPS) is a new type of set proposed recently, which can be regarded as the generalization of evidence theory. To measure the uncertainty of RPS, the entropy of RPS and its corresponding maximum entropy have been…