Related papers: Discrete Entropy of Generalized Jacobi Polynomials
We study asymptotic behavior of orthogonal polynomials on the unit circle with varying Verblunsky coefficients $\alpha_{n,N}$ when the ratio $n/N$ converges as $n,N\to\infty$. First, we give a streamlined proof of ratio asymptotics for…
We consider polynomials $P_n$ orthogonal with respect to the weight $J_{\nu}$ on $[0,\infty)$, where $J_{\nu}$ is the Bessel function of order $\nu$. Asheim and Huybrechs considered these polynomials in connection with complex Gaussian…
It was recently shown that estimating the Shannon entropy $H({\rm p})$ of a discrete $k$-symbol distribution ${\rm p}$ requires $\Theta(k/\log k)$ samples, a number that grows near-linearly in the support size. In many applications $H({\rm…
We consider polynomials $p_n^{\omega}(x)$ that are orthogonal with respect to the oscillatory weight $w(x)=e^{i\omega x}$ on $[-1,1]$, where $\omega>0$ is a real parameter. A first analysis of $p_n^{\omega}(x)$ for large values of $\omega$…
We have presented a new axiomatic derivation of Shannon Entropy for a discrete probability distribution on the basis of the postulates of additivity and concavity of the entropy function.We have then modified shannon entropy to take account…
It is proven that a conjecture of Tao (2010) holds true for log-concave random variables on the integers: For every $n \geq 1$, if $X_1,\ldots,X_n$ are i.i.d. integer-valued, log-concave random variables, then $$ H(X_1+\cdots+X_{n+1}) \geq…
We consider random polynomials of the form $H_n(z)=\sum_{j=0}^n\xi_jq_j(z)$ where the $\{\xi_j\}$ are i.i.d non-degenerate complex random variables, and the $\{q_j(z)\}$ are orthonormal polynomials with respect to a compactly supported…
This paper considers the estimation of Shannon entropy for discrete distributions with countably infinite support. While minimax rates for finite-support distributions are established, infinite-support distributions present distinct…
We prove a Bernstein-type bound for the difference between the average of negative log-likelihoods of independent discrete random variables and the Shannon entropy, both defined on a countably infinite alphabet. The result holds for the…
We consider the entropy of sums of independent discrete random variables, in analogy with Shannon's Entropy Power Inequality, where equality holds for normals. In our case, infinite divisibility suggests that equality should hold for…
We study concentration properties of vertex degrees of $n$-dimensional Erdos-R\'enyi random graphs with the edge probability $\rho/n$ by means of high moments of these random variables in the limit when $n$ and $\rho$ tend to infinity.…
We study spectrum of finite truncations of unbounded Jacobi matrices with periodically modulated entries. In particular, we show that under some hypotheses a sequence of properly normalized eigenvalue counting measures converge vaguely to…
The paper extends the analysis of the entropies of the Poisson distribution with parameter $\lambda$. It demonstrates that the Tsallis and Sharma-Mittal entropies exhibit monotonic behavior with respect to $\lambda$, whereas two generalized…
We describe a Riemann-Hilbert problem for a family of $q$-orthogonal polynomials, $\{ P_n(x) \}_{n=0}^\infty$, and use it to deduce their asymptotic behaviours in the limit as the degree, $n$, approaches infinity. We find that the…
A method of estimating the joint probability mass function of a pair of discrete random variables is described. This estimator is used to construct the conditional Shannon-R\'eyni-Tsallis entropies estimates. From there almost sure rates of…
We investigate the asymptotic normality of the posterior distribution in the discrete setting, when model dimension increases with sample size. We consider a probability mass function $\theta_0$ on $\mathbbm{N}\setminus \{0\}$ and a…
The ultimate purpose of the statistical analysis of ordinal patterns is to characterize the distribution of the features they induce. In particular, knowing the joint distribution of the pair Entropy-Statistical Complexity for a large class…
We derive bulk asymptotics of skew-orthogonal polynomials (sop) $\pi^{\bt}_{m}$, $\beta=1$, 4, defined w.r.t. the weight $\exp(-2NV(x))$, $V (x)=gx^4/4+tx^2/2$, $g>0$ and $t<0$. We assume that as $m,N \to\infty$ there exists an $\epsilon >…
In this paper, we develop a non-asymptotic local normal approximation for multinomial probabilities. First, we use it to find non-asymptotic total variation bounds between the measures induced by uniformly jittered multinomials and the…
We study expected values of the polynomials $P_N^{}(z)=\prod_{1\leq n\leq N}(X_n^2+z^2)$ whose $2N$ zeros $\{\pm i X_k\}^{}_{k=1,...,N}$ are generated by $N$ identically distributed multi-variate mean-zero normal random variables…