Related papers: Discrete Entropy of Generalized Jacobi Polynomials

We consider asymptotics of planar orthogonal polynomials $P_{n,N}$ (where $\mathrm{deg}P_{n,N}=n$) with respect to the weight $$\frac{|z-w|^{2NQ_1}}{(1+|z|^2)^{N(1+Q_0+Q_1)+1}}, \quad(Q_0,Q_1 > 0)$$ in the whole complex plane. With $n,…

We give a generalization to convex co-compact semigroups of a beautiful theorem of Patterson-Sullivan, telling that the critical exponent (that is the exponential growth rate) equals the Hausdorff dimension of the limit set (that is the…

The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…

We study asymptotic zero distribution of random Laurent polynomials whose support are contained in dilates of a fixed integral polytope $P$ as their degree grow. We consider a large class of probability distributions including the ones…

The new estimates of the conditional Shannon entropy are introduced in the framework of the model describing a discrete response variable depending on a vector of d factors having a density w.r.t. the Lebesgue measure in R^d. Namely, the…

We present some new nonparametric estimators of entropies and we establish almost sure consistency and central limit Theorems for some of the most important entropies in the discrete case. Our theorical results are validated by simulations.

Let $K_n$ be the convex hull of i.i.d. random variables distributed according to the standard normal distribution on $\R^d$. We establish variance asymptotics as $n \to \infty$ for the re-scaled intrinsic volumes and $k$-face functionals of…

This monograph presents a unified treatment of single- and multi-user problems in Shannon's information theory where we depart from the requirement that the error probability decays asymptotically in the blocklength. Instead, the error…

Entropies must correspond to mean values for them to be measurable. The Shannon entropy corresponds to the weighted arithmetic mean, whereas the Renyi entropy corresponds to the exponential mean. These means refer to code lengths, which are…

We explore the relation between entanglement entropy of quantum many body systems and the distribution of corresponding, properly selected, observables. Such a relation is necessary to actually measure the entanglement entropy. We show that…

We consider random orthonormal polynomials $$ F_{n}(x)=\sum_{i=0}^{n}\xi_{i}p_{i}(x), $$ where $\xi_{0}$, \dots, $\xi_{n}$ are independent random variables with zero mean, unit variance and uniformly bounded $(2+\ep)$ moments, and…

We consider some general facts concerning convergence P_{n}-Q_{n}\to 0 as n\to \infty, where P_{n} and Q_{n} are probability measures in a complete separable metric space. The main point is that the sequences {P_{n}} and {Q_{n}} are not…

We explore asymptotically optimal bounds for deviations of distributions of independent Bernoulli random variables from the Poisson limit in terms of the Shannon relative entropy and R\'enyi/Tsallis relative distances (including Pearson's…

We characterize the limiting distributions of random variables of the form $P_n\left( (X_i)_{i \ge 1} \right)$, where: (i) $(P_n)_{n \ge 1}$ is a sequence of multivariate polynomials, each potentially involving countably many variables;…

We give an exact formula for the value of the derivative at zero of the gap probability in finite n x n Gaussian ensembles. As n goes to infinity our computation provides an asymptotic (with an explicit constant) of the order n^(1/2). As a…

We study the sequence of monic polynomials $\{S_n\}_{n\geqslant 0}$, orthogonal with respect to the Jacobi-Sobolev inner {product} \;$$ \langle f,g\rangle_{\mathsf{s}}= \int_{-1}^{1} f(x) g(x)\,…

In this work in progress, we study the asymptotic behaviour of the $p$-quantile of the Beta distribution, i.e. the quantity $q$ defined implicitly by $\int_0^q t^{a - 1} (1 - t)^{b - 1} \text{d} t = p B (a, b)$, as a function of the first…

This paper studies the problem of estimating the differential entropy $h(S+Z)$, where $S$ and $Z$ are independent $d$-dimensional random variables with $Z\sim\mathcal{N}(0,\sigma^2 \mathrm{I}_d)$. The distribution of $S$ is unknown, but $n$…

Shannon entropy in position ($S_{\rvec}$) and momentum ($S_{\pvec}$) spaces, along with their sum ($S_t$) are presented for unit-normalized densities of He, Li$^+$ and Be$^{2+}$ ions, spatially confined at the center of an impenetrable…

The organization of high-dimensional probability spaces is a fundamental problem at the intersection of statistical physics and information theory. Here, we analyze the distributions populating level surfaces of the probability simplex…