相关论文: Concentration bounds for entropy estimation of one…

We propose a mixedness quantifier based on entropy fluctuations. It provides information about the degree of mixedness either for finite dimensional and infinite dimensional Hilbert spaces. It may be used to determine the reduction of the…

General relationship between mean Boltzmann entropy and Gibbs entropy is established. It is found that their difference is equal to fluctuation entropy, which is a Gibbs-like entropy of macroscopic quantities. The ratio of the fluctuation…

We consider Gibbs measures on the configuration space $S^{\mathbb{Z}^d}$, where mostly $d\geq 2$ and $S$ is a finite set. We start by a short review on concentration inequalities for Gibbs measures. In the Dobrushin uniqueness regime, we…

We survey a few concentration inequalities for submodular and fractionally subadditive functions of independent random variables, implied by the entropy method for self-bounding functions. The power of these concentration bounds is that…

For any stationary $\mZ^d$-Gibbs measure that satisfies strong spatial mixing, we obtain sequences of upper and lower approximations that converge to its entropy. In the case, $d=2$, these approximations are efficient in the sense that the…

Microscopic formula to describe the entropy of biomolecular solutions are derived based on the Gibbs formula of entropy, and the generalized Langevin theory combined with the RISM/3D-RISM theory. Two formula are derived: one is concerned…

It is argued that a Gibbsian formula for the space-time distribution of microscopic trajectories of a nonequilibrium system provides a unifying framework for recent results on the fluctuations of the entropy production. The variable entropy…

We derive two upper bounds for the probability of deviation of a vector-valued Lipschitz function of a collection of random variables from its expected value. The resulting upper bounds can be tighter than bounds obtained by a direct…

We present two new estimators for estimating the entropy of absolutely continuous random variables. Some properties of them are considered, specifically consistency of the first is proved. The introduced estimators are compared with the…

We discuss entropy bounds for a class of two-dimensional gravity models. While the Bekenstein bound can be proved to hold in general for weakly gravitating matter, the analogous of the holographic bound is not universal, but depends on the…

Various notions of fluctuations exist depending on the way one chooses to measure them. We discuss two extreme cases (continuous measurement versus long inter-measurement times) and we see their relation with entropy production and with…

We introduce estimators for the entropy production of a Gibbsian process based on the observation of a single or two typical trajectories. These estimators are built with adequate hitting and return times. We then study their convergence…

Motivated by entropy estimation from chaotic time series, we provide a comprehensive analysis of hitting times of cylinder sets in the setting of Gibbsian sources. We prove two strong approximation results from which we easily deduce…

We consider the problem of minimax estimation of the entropy of a density over Lipschitz balls. Dropping the usual assumption that the density is bounded away from zero, we obtain the minimax rates $(n\ln n)^{-s/(s+d)} + n^{-1/2}$ for…

This paper addresses the question of the fluctuations of the empirical entropy of a chain of infinite order. We assume that the chain takes values on a finite alphabet and loses memory exponentially fast. We consider two possible…

The estimation of information measures of continuous distributions based on samples is a fundamental problem in statistics and machine learning. In this paper, we analyze estimates of differential entropy in $K$-dimensional Euclidean space,…

We prove a generalization of the fundamental inequality of Guivarc'h relating entropy, drift and critical exponent to Gibbs measures on geometrically finite quotients of CAT(-1) metric spaces. For random walks with finite superexponential…

We establish upper and lower bounds for the metric entropy and bracketing entropy of the class of $d$-dimensional bounded monotonic functions under $L^p$ norms. It is interesting to see that both the metric entropy and bracketing entropy…

Uniform integer-valued Lipschitz functions on a domain of size $N$ of the triangular lattice are shown to have variations of order $\sqrt{\log N}$. The level lines of such functions form a loop $O(2)$ model on the edges of the hexagonal…

We study regression of $1$-Lipschitz functions under a log-concave measure $\mu$ on $\mathbb{R}^d$. We focus on the high-dimensional regime where the sample size $n$ is subexponential in $d$, in which distribution-free estimators are…