Related papers: R\'enyi entropy and pattern matching for run-lengt…
We derive a strengthened monotonicity inequality for quantum relative entropy by employing properties of $\alpha$-R\'{e}nyi relative entropy. We develop a unifying treatment towards the improvement of some quantum entropy inequalities. In…
We consider a new functional inequality controlling the rate of relative entropy decay for random walks, the interchange process and more general block-type dynamics for permutations. The inequality lies between the classical logarithmic…
We investigate quantum R\'enyi entropic quantities, specifically those derived from 'sandwiched' divergence. This divergence is one of several proposed R\'enyi generalisations of the quantum relative entropy. We may define R\'enyi…
We study the N-step binary stationary ergodic Markov chain and analyze its differential entropy. Supposing that the correlations are weak we express the conditional probability function of the chain through the pair correlation function and…
We investigate symbolic sequences and in particular information carriers as e.g. books and DNA-strings. First the higher order Shannon entropies are calculated, a characteristic root law is detected. Then the algorithmic entropy is…
This paper provides tight bounds on the R\'enyi entropy of a function of a discrete random variable with a finite number of possible values, where the considered function is not one-to-one. To that end, a tight lower bound on the R\'enyi…
Let $\pi$ be a permutation of $[n]=\{1,\dots,n\}$ and denote by $\ell(\pi)$ the length of a longest increasing subsequence of $\pi$. Let $\ell_{n,k}$ be the number of permutations $\pi$ of $[n]$ with $\ell(\pi)=k$. Chen conjectured that the…
We mainly study the R\'enyi entropy and entanglement entropy of the states locally excited by the descendent operators in two dimensional conformal field theories (CFTs). In rational CFTs, we prove that the increase of entanglement entropy…
Bounds on information combining are a fundamental tool in coding theory, in particular when analyzing polar codes and belief propagation. They usually bound the evolution of random variables with respect to their Shannon entropy. In recent…
We discuss algorithms for estimating the Shannon entropy h of finite symbol sequences with long range correlations. In particular, we consider algorithms which estimate h from the code lengths produced by some compression algorithm. Our…
Entanglement in a pure state of a many-body system can be characterized by the R\'enyi entropies $S^{(\alpha)}=\ln\textrm{tr}(\rho^\alpha)/(1-\alpha)$ of the reduced density matrix $\rho$ of a subsystem. These entropies are, however,…
PAE cannot be made a basis for either a generalized statistical mechanics or a generalized information theory. Either statistical independence must be waived, or the expression of the averaged conditional probability as the difference…
The Erd\H os-R\'enyi law states that given a sequence $\{X_j\}_{j=1}^\infty$ of i.i.d.~($p$) coin-tosses, the longest run $L_n$ of heads in the first $n$ coin tosses approaches $\log_{1/p}n$ almost surely. In this paper we explore a…
We study the behavior of the R\'enyi entropies for the toric code subject to a variety of different perturbations, by means of 2D density matrix renormalization group and analytical methods. We find that R\'enyi entropies of different index…
Configurational entropy, or complexity, plays a critical role in characterizing disordered systems such as glasses, yet its measurement often requires significant computational resources. Recently, R\'enyi entropy, a one-parameter…
Momentum space entanglement entropy probes quantum correlations in interacting fermionic phases. It is very sensitive to interactions, obeying volume-law scaling in general, while vanishing in the Fermi gas. We show that the R\'enyi entropy…
We obtain a formula for the determinant of a block Toeplitz matrix associated with a quadratic fermionic chain with complex coupling. Such couplings break reflection symmetry and/or charge conjugation symmetry. We then apply this formula to…
We show that the R\'enyi entropies of single particle, extended wave functions for disordered systems contain information about the multifractal spectrum. It is shown for moments of the R\'enyi entropy, $S_{n}$, where $|n|<1$, it is…
This paper considers the speed of convergence (mixing) of a finite Markov kernel $P$ with respect to the Kullback-Leibler divergence (entropy). Given a Markov kernel one defines either a discrete-time Markov chain (with the $n$-step…
The R\'enyi entanglement entropy is widely used in studying quantum entanglement properties in strongly correlated systems, whose analytic continuation as the R\'enyi index $n \to 1$ is often believed to yield the von Neumann entanglement…