Related papers: Finite-Sample Concentration of the Multinomial in …
We give a detailed analysis of the Gibbs-type entropy notion and its dynamical behavior in case of time-dependent continuous probability distributions of varied origins: related to classical and quantum systems. The purpose-dependent usage…
Given $\pi \in S_n$, let $Z_{n,k}(\pi)=\sum_{1\leq i_1<\dots<i_k\leq n} \mathbf{1}(\{ \pi_{i_1}<\dots<\pi_{i_k}\}$ denote the number of increasing subsequences of length $k$. Consider the "generalized Ulam problem," studying the…
For a measurable function on a set which has a finite measure, an inequality holds between two Lp-norms. In this paper, we show similar inequalities for the Euclidean space and the Lebesgue measure by using a q-moment which is a moment of…
We study the maximum likelihood estimator of density of $n$ independent observations, under the assumption that it is well approximated by a mixture with a large number of components. The main focus is on statistical properties with respect…
By using the dimension-free Harnack inequality and the integration by parts formula for the associated diffusion semigroup, we prove the central limit theorem, the moderate deviation principle, and the logarithmic iteration law for the…
The 'degree of k-step nilpotence' of a finite group G is the proportion of the tuples (x_1,...,x_{k+1}) in G^{k+1} for which the simple commutator [x_1,...,x_{k+1}] is equal to the identity. In this paper we study versions of this for an…
In this paper we review various information-theoretic characterizations of the approach to equilibrium in biological systems. The replicator equation, evolutionary game theory, Markov processes and chemical reaction networks all describe…
A new method called "variational sampling" is proposed to estimate integrals under probability distributions that can be evaluated up to a normalizing constant. The key idea is to fit the target distribution with an exponential family model…
We consider an extension of $\epsilon$-entropy to a KL-divergence based complexity measure for randomized density estimation methods. Based on this extension, we develop a general information-theoretical inequality that measures the…
Good robust estimators can be tuned to combine a high breakdown point and a specified asymptotic efficiency at a central model. This happens in regression with MM- and tau-estimators among others. However, the finite-sample efficiency of…
The article presents new sup-sums principles for integral F-divergence for arbitrary convex function F and arbitrary (not necessarily positive and absolutely continuous) measures. As applications of these results we derive the corresponding…
In this paper we study the behaviour of the domination number of the Erd\H{o}s-R\'enyi random graph $\mathcal{G}(n,p)$. Extending a result of Wieland and Godbole we show that the domination number of $\mathcal{G}(n,p)$ is equal to one of…
We obtain large $n$ asymptotics for the $m$-point moment generating function of the disk counting statistics of the Mittag-Leffler ensemble. We focus on the critical regime where all disk boundaries are merging at speed…
The Schnorr-Stimm dichotomy theorem concerns finite-state gamblers that bet on infinite sequences of symbols taken from a finite alphabet $\Sigma$. In this paper we use the Kullback-Leibler divergence to formulate the $\textit{lower…
We study the problem of nonnegative rank-one approximation of a nonnegative tensor, and show that the globally optimal solution that minimizes the generalized Kullback-Leibler divergence can be efficiently obtained, i.e., it is not NP-hard.…
In many applications in biology, engineering and economics, identifying similarities and differences between distributions of data from complex processes requires comparing finite categorical samples of discrete counts. Statistical…
The entropy accumulation theorem states that the smooth min-entropy of an $n$-partite system $A = (A_1, \ldots, A_n)$ is lower-bounded by the sum of the von Neumann entropies of suitably chosen conditional states up to corrections that are…
Let $ X_1, \ldots, X_n $ be independent random variables taking values in the alphabet $ \{0, 1, \ldots, r\} $, and $ S_n = \sum_{i = 1}^n X_i $. The Shepp--Olkin theorem states that, in the binary case ($ r = 1 $), the Shannon entropy of $…
This work establishes a new probabilistic bound on the number of elements to generate finite nilpotent groups. Let $\varphi_k(G)$ denote the probability that $k$ random elements generate a finite nilpotent group $G$. For any $0 < \epsilon <…
In a previous paper, we proved that the limit of the collection of possible eigenvalues of output states of a random quantum channel is a deterministic, compact set K_{k,t}. We also showed that the set K_{k,t} is obtained, up to an…