Related papers: Concentration bounds for entropy estimation of one…
Entropy rate of sequential data-streams naturally quantifies the complexity of the generative process. Thus entropy rate fluctuations could be used as a tool to recognize dynamical perturbations in signal sources, and could potentially be…
We prove concentration inequalities for functions of independent random variables {under} sub-gaussian and sub-exponential conditions. The utility of the inequalities is demonstrated by an extension of the now classical method of Rademacher…
We apply a common measure of randomness, the entropy, in the context of iterated functions on a finite set with n elements. For a permutation, it turns out that this entropy is asymptotically (for a growing number of iterations) close to…
We describe limit fluctuations of the height function for the open TASEP on the coexistence line under the stationary measure. It is known that the height function satisfies a law of large numbers as the number of sites $n$ goes to infinity…
Complexity measures are introduced, that quantify the change of the natural entropy fluctuations at different length scales in time-series emitted from systems operating far from equilibrium. They identify impending sudden cardiac death…
Gibbs-Boltzmann entropy leads to systems that have a strong dependence on initial conditions. In reality, most materials behave quite independently of initial conditions. Nonextensive entropy or Tsallis entropy leads to nonextensive…
Stochastic thermodynamics extends classical thermodynamics to small systems in contact with one or more heat baths. It can account for the effects of thermal fluctuations and describe systems far from thermodynamic equilibrium. A basic…
We consider the full shift $T:\Omega\to\Omega$ where $\Omega=A^{\mathbb N}$, $A$ being a finite alphabet. For a class of potentials which contains in particular potentials $\phi$ with variation decreasing like $O(n^{-\alpha})$ for some…
Statistical mechanics can only be ultimately justified in terms of microscopic dynamics (classical, quantum, relativistic, or any other). It is known that Boltzmann-Gibbs statistics is based on the hypothesis of exponential sensitivity to…
In this note, we show that the relative entropy of an empirical distribution of $n$ samples drawn from a set of size $k$ with respect to the true underlying distribution is exponentially concentrated around its expectation, with central…
The Boltzmann--Gibbs entropy is a functional on the space of probability measures. When a state space is countable, one characterization of the Boltzmann--Gibbs entropy is given by the Shannon--Khinchin axioms, which consist of continuity,…
A new upper bound on the relative entropy is derived as a function of the total variation distance for probability measures defined on a common finite alphabet. The bound improves a previously reported bound by Csisz\'ar and Talata. It is…
The generalized entropic measure, which is optimized by a given arbitrary distribution under the constraints on normalization of the distribution and the finite ordinary expectation value of a physical random quantity, is considered and its…
Optical entropy bounds for metal nanoparticles immersed in nonlinear optical media and for nonlinear dielectric microdroplets on metal surfaces are calculated near the frequency of the surface plasmon resonance. Similar to the…
Consider a statistical physical model on the $d$-regular infinite tree $T_{d}$ described by a set of interactions $\Phi$. Let $\{G_{n}\}$ be a sequence of finite graphs with vertex sets $V_n$ that locally converge to $T_{d}$. From $\Phi$…
Entropic Brenier maps are regularized analogues of Brenier maps (optimal transport maps) which converge to Brenier maps as the regularization parameter shrinks. In this work, we prove quantitative stability bounds between entropic Brenier…
We consider the ASEP and the stochastic six vertex model started with step initial data. After a long time, $T$, it is known that the one-point height function fluctuations for these systems are of order $T^{1/3}$. We prove the KPZ…
Sub-Gaussian and subexponential distributions are introduced and applied to study the fluctuation-response relation out of equilibrium. A bound on the difference in expected values of an arbitrary sub-Gaussian or subexponential physical…
We show how generalized Gibbs-Shannon entropies can provide new insights on the statistical properties of texts. The universal distribution of word frequencies (Zipf's law) implies that the generalized entropies, computed at the word level,…
Entropy estimation is a fundamental problem in information theory that has applications in various fields, including physics, biology, and computer science. Estimating the entropy of discrete sequences can be challenging due to limited data…