Related papers: A remark on entropy numbers
We generalize McDiarmid's inequality for functions with bounded differences on a high probability set, using an extension argument. Those functions concentrate around their conditional expectations. We further extend the results to…
For general metric theories of gravity, we compare the approach that describes-derives the field equations of gravity as a thermodynamic identity with the one which looks at them from entropy bounds. The comparison is made through the…
In this paper, we provide a new proof of a density version of Tur\'an's theorem. We also rephrase both the theorem and the proof using entropy. With the entropic formulation, we show that some naturally defined entropic quantity is closely…
Some preliminary evidence suggests the conjecture that the collective behaviour of systems having long-range interactions may be described more effectively by the Tsallis rather than by the Boltzmann/Gibbs/Shannon entropy. To this end, we…
We develop an approximation method for the differential entropy $h(\mathbf{X})$ of a $q$-component Gaussian mixture in $\mathbb{R}^n$. We provide two examples of approximations using our method denoted by…
This short note provides a new and simple proof of the convergence rate for Peng's law of large numbers under sublinear expectations, which improves the corresponding results in Song [15] and Fang et al. [3].
Thermodynamic entropy is determined by a heat measurement through the Clausius equality. The entropy then formalizes a fundamental limitation of operations by the second law of thermodynamics. The entropy is also expressed as the Shannon…
The first improvements concern the complex non-linear dependence of entropy on pressure, temperature and salinity, with the use of the standard TEOS10 formulation based on a fit of the oceanic Gibbs function to more recent observations. On…
By decoupling forward and backward stochastic trajectories, we construct a family of martingales and work theorems for both overdamped and underdamped Langevin dynamics. Our results are made possible by an alternative derivation of work…
We announce a number of conjectures associated with and arising from a study of primes and irrationals in $\mathbb{R}$. All are supported by numerical verification to the extent possible.
Consider tossing a collection of coins, each fair or biased towards heads, and take the distribution of the total number of heads that result. It is natural to conjecture that this distribution should be 'more random' when each coin is…
A brief discussion is given of the traditional version of the Maximum Entropy Method, including a review of some of the criticism that has been made in regard to its use in statistical inference. Motivated by these questions, a modified…
We extend Lyons's tree entropy theorem to general determinantal measures. As a byproduct we show that the sofic entropy of an invariant determinantal measure does not depend on the chosen sofic approximation.
We prove a formula for the sofic entropy of expansive principal algebraic actions of residually finite groups, extending recent work of Deninger and Schmidt.
The quantum relative entropy is frequently used as a distance measure between two quantum states, and inequalities relating it to other distance measures are important mathematical tools in many areas of quantum information theory. We have…
We leverage the Gibbs inequality and its natural generalization to R\'enyi entropies to derive closed-form parametric expressions of the optimal lower bounds of $\rho$th-order guessing entropy (guessing moment) of a secret taking values on…
The rate of convergence of the classical Thresholding Greedy Algorithm with respect to bases is studied in this paper. We bound the error of approximation by the product of both norms -- the norm of $f$ and the $A_1$-norm of $f$. We obtain…
A natural link between the notions of majorization and strongly Sperner posets is elucidated. It is then used to obtain a variety of consequences, including new R\'enyi entropy inequalities for sums of independent, integer-valued random…
We partially generalize Peters' formula on modules over the group ring ${\mathbb F} \Gamma$ for a given finite field ${\mathbb F}$ and a sofic group $\Gamma$. It is also discussed that how the values of entropy are related to the zero…
We give a simple proof of a recently result concerning Hardy $q$-inequalities.