English
Related papers

Related papers: The Generalized Chernoff-Stein Lemma, Applications…

200 papers

Asymptotically entropy of chaotic systems increases linearly and the sensitivity to initial conditions is exponential with time: these two behaviors are related. Such relationship is the analogous of and under specific conditions has been…

Statistical Mechanics · Physics 2011-01-04 Roberto Tonelli , Giuseppe Mezzorani , Franco Meloni , Marcello Lissia , Massimo Coraddu

A new notion of typicality for arbitrary probability measures on standard Borel spaces is proposed, which encompasses the classical notions of weak and strong typicality as special cases. Useful lemmas about strong typical sets, including…

Information Theory · Computer Science 2016-11-17 Junekey Jeon

This paper considers the entropy of the sum of (possibly dependent and non-identically distributed) Bernoulli random variables. Upper bounds on the error that follows from an approximation of this entropy by the entropy of a Poisson random…

Information Theory · Computer Science 2016-11-17 Igal Sason

Aim of this short note is to study Shannon's entropy power along entropic interpolations, thus generalizing Costa's concavity theorem. We shall provide two proofs of independent interest: the former by $\Gamma$-calculus, hence applicable to…

Information Theory · Computer Science 2020-12-23 Luca Tamanini

We propose the use of a gravitational uncertainty principle for gravitation. We define the corresponding gravitational Planck's constant and the gravitational quantum of mass. We define entropy in terms of the quantum of gravity with the…

General Relativity and Quantum Cosmology · Physics 2015-06-25 Antonio Alfonso-Faus

Information-theoretic measures such as relative entropy and correlation are extremely useful when modeling or analyzing the interaction of probabilistic systems. We survey the quantum generalization of 5 such measures and point out some of…

Information Theory · Computer Science 2015-06-02 William Blacoe

Numerical experiments support the interesting conjecture that statistical methods be applicable not only to fully-chaotic systems, but also at the edge of chaos by using Tsallis' generalizations of the standard exponential and entropy. In…

Statistical Mechanics · Physics 2017-08-23 Marcello Lissia , Massimo Coraddu , Roberto Tonelli

We investigate properties of the entropy density related to a generalized extensive statistics and derive the thermodynamic Bethe ansatz equation for a system of relativistic particles obeying such a statistics. We investigate the conformal…

High Energy Physics - Theory · Physics 2011-08-17 Andrei G. Bytsko

We present novel bounds for estimating discrete probability distributions under the $\ell_\infty$ norm. These are nearly optimal in various precise senses, including a kind of instance-optimality. Our data-dependent convergence guarantees…

Statistics Theory · Mathematics 2024-02-14 Aryeh Kontorovich , Amichai Painsky

We find the value of constants related to constraints in characterization of some known statistical distributions and then we proceed to use the idea behind maximum entropy principle to derive generalized version of this distributions using…

Statistical Mechanics · Physics 2007-05-23 Oscar Sotolongo-Costa , Alejandro Gonzalez Gonzalez , Francois Brouers

In the present paper we will give some new notions, such as {\Delta}-convergence and {\Delta}-Cauchy, by using the {\Delta}-density and investigate their relations. It is important to say that, the results presented in this work generalize…

Classical Analysis and ODEs · Mathematics 2011-09-22 M. Seyyit Seyyidoglu , N. Özkan Tan

We introduce a new version of Stein's method that reduces a large class of normal approximation problems to variance bounding exercises, thus making a connection between central limit theorems and concentration of measure. Unlike Skorokhod…

Probability · Mathematics 2009-09-29 Sourav Chatterjee

The formalism of statistical mechanics can be generalized by starting from more general measures of information than the Shannon entropy and maximizing those subject to suitable constraints. We discuss some of the most important examples of…

Statistical Mechanics · Physics 2015-05-13 Christian Beck

A general method for proving continuity of the von Neumann entropy on subsets of positive trace-class operators is considered. This makes it possible to re-derive the known conditions for continuity of the entropy in more general forms and…

Mathematical Physics · Physics 2015-05-13 M. E. Shirokov

Shannon and Khinchin showed that assuming four information theoretic axioms the entropy must be of Boltzmann-Gibbs type, $S=-\sum_i p_i \log p_i$. Here we note that in physical systems one of these axioms may be violated. For non-ergodic…

Statistical Mechanics · Physics 2015-03-19 Stefan Thurner , Rudolf Hanel

We present our view in a standing debate about the definition and meaning of power-law entropies for continuous systems. Our suggestion is that such arguments should take into account the generalized operations of addition and…

Statistical Mechanics · Physics 2018-10-17 Anthony J. Creaco , Nikolaos Kalogeropoulos

We show that there exists a natural way to define a condition of generalized thermal equilibrium between systems governed by Tsallis thermostatistics, under the hypotheses that i) the coupling between the systems is weak, ii) the structure…

Statistical Mechanics · Physics 2007-09-17 Massimo Marino

We extend Stein's lemma for averages that explicitly contain the Gaussian random variable at a power. We present two proofs for this extension of Stein's lemma, with the first being a rigorous proof by mathematical induction. The…

Probability · Mathematics 2022-06-27 Konstantinos Mamis

We prove a version of Linnik's basic lemma uniformly over the base field using theta-series and geometric invariant theory in the spirit of Khayutin's approach (Duke Math. J., 168(12), 2019). As an application, we establish entropy bounds…

Number Theory · Mathematics 2025-08-05 Andreas Wieser , Pengyu Yang

The thermodynamic uncertainty relation expresses a universal trade-off between precision and entropy production, which applies in its original formulation to current observables in steady-state systems. We generalize this relation to…

Statistical Mechanics · Physics 2018-12-06 Timur Koyuk , Udo Seifert , Patrick Pietzonka