Related papers: Entropy NAND: Early Functional Completeness in Ent…
We review recent progress in understanding certain aspects of the thermodynamics of black holes and other horizons. Our discussion centers on various ``entropy bounds'' which have been proposed in the literature and on the current…
The two key characteristics of a normalizing flow is that it is invertible (in particular, dimension preserving) and that it monitors the amount by which it changes the likelihood of data points as samples are propagated along the network.…
Entropy production (EP) is known as a fundamental quantity for measuring the irreversibility of processes in thermal equilibrium and states far from equilibrium. In stochastic thermodynamics, the EP becomes more visible in terms of the…
There are three ways to conceptualize entropy: entropy as an extensive thermodynamic quantity of physical systems (Clausius, Boltzmann, Gibbs), entropy as a measure for information production of ergodic sources (Shannon), and entropy as a…
Entropy is a fundamental concept in quantum information theory that allows to quantify entanglement and investigate its properties, for example its monogamy over multipartite systems. Here, we derive variational formulas for relative…
Spectral properties of an arbitrary matrix can be characterized by the entropy of its rescaled singular values. Any quantum operation can be described by the associated dynamical matrix or by the corresponding superoperator. The entropy of…
We consider a simplified version of a solvable model by Mandal and Jarzynski, which constructively demonstrates the interplay between work extraction and the increase of the Shannon entropy of an information reservoir which is in contact…
We study the hydrodynamic description of collective dynamics driven by velocity {\it alignment}. It is known that such Euler alignment systems must flock towards a limiting ``flocking'' velocity, provided their solutions remain globally…
The property of Tsallis entropy is examined when considering tow systems with different temperatures to be in contact with each other and to reach the thermal equilibrium. It is verified that the total Tsallis entropy of the two systems…
Transfer entropy is capable of capturing nonlinear source-destination relations between multi-variate time series. It is a measure of association between source data that are transformed into destination data via a set of linear…
We compute the entropy of a Rindler particle-detector (observer) in the presence of a quantum field in the Minkowski vacuum state; due to the Unruh effect, the observer is immersed in a thermal bath at a temperature proportional to its…
We analyze the nature of the structural order established in liquid TIP4P water in the framework provided by the multi-particle correlation expansion of the statistical entropy. Different regimes are mapped onto the phase diagram of the…
In this paper, we introduce the notion of recurrence entropy in the context of nonlinear control systems. A set is said to be ($\tau$-)recurrent if every trajectory that starts in the set returns to it (within at most $\tau$ units of time).…
Accurate fading characterization and channel capacity determination are of paramount importance in both conventional and emerging communication systems. The present work addresses the nonlinearity of the propagation medium and its effects…
The major problem in information theoretic analysis of neural responses and other biological data is the reliable estimation of entropy--like quantities from small samples. We apply a recently introduced Bayesian entropy estimator to…
Let $A$ and $B$ be two accretive operators. We first introduce the weighted geometric mean of $A$ and $B$ together with some related properties. Afterwards, we define the relative entropy as well as the Tsallis entropy of $A$ and $B$. The…
One of the most influential results in neural network theory is the universal approximation theorem [1, 2, 3] which states that continuous functions can be approximated to within arbitrary accuracy by single-hidden-layer feedforward neural…
The additional information carried by an enlarged filtration and its measurement was studied by several authors. Already Meyer (Sur un theoreme de J. Jacod, 1978) and Yor (Entropie d'une partition, et grossissement initial d'une filtration,…
Two general upper bounds on the topological entropy of nonlinear time-varying systems are established: one using the matrix measure of the system Jacobian, the other using the largest real part of the eigenvalues of the Jacobian matrix with…
We develop the framework of classical Observational entropy, which is a mathematically rigorous and precise framework for non-equilibrium thermodynamics, explicitly defined in terms of a set of observables. Observational entropy can be seen…