Related papers: Entropy Density and Mismatch in High-Rate Scalar Q…
In signal analysis and synthesis, linear approximation theory considers a linear decomposition of any given signal in a set of atoms, collected into a so-called dictionary. Relevant sparse representations are obtained by relaxing the…
A remarkable yet mysterious property of black holes is that their entropy is proportional to the horizon area. This area law inspired the holographic principle, which was later realized concretely in gauge/gravity duality. In this context,…
Following a recent proof of Shannon's entropy power inequality (EPI), a comprehensive framework for deriving various EPIs for the R\'enyi entropy is presented that uses transport arguments from normal densities and a change of variable by…
In this monograph, we review recent advances in second-order asymptotics for lossy source coding, which provides approximations to the finite blocklength performance of optimal codes. The monograph is divided into three parts. In part I, we…
We revisit generalized entropic formulations of the uncertainty principle for an arbitrary pair of quantum observables in two-dimensional Hilbert space. R\'enyi entropy is used as uncertainty measure associated with the distribution…
Entanglement entropy in causal sets offers a fundamentally covariant characterisation of quantum field degrees of freedom. A known result in this context is that the degrees of freedom consist of a number of contributions that have…
Renyi entropies S_q are useful measures of quantum entanglement; they can be calculated from traces of the reduced density matrix raised to power q, with q>=0. For (d+1)-dimensional conformal field theories, the Renyi entropies across…
R\'enyi entropy is a one-parameter generalization of Shannon entropy, which has been used in various fields of physics. Despite its wide applicability, the physical interpretations of the R\'enyi entropy are not widely known. In this paper,…
We investigate the entanglement properties of the Quantum Six-Vertex Model on a cylinder, focusing on the Shannon-Renyi entropy in the limit of Renyi order $n = \infty$. This entropy, calculated from the ground state amplitudes of the…
We study the time evolution of Renyi entanglement entropy for locally excited states in two dimensional large central charge CFTs. It generically shows a logarithmical growth and we compute the coefficient of $\log t$ term. Our analysis…
The efficiency of Monte Carlo samplers is dictated not only by energetic effects, such as large barriers, but also by entropic effects that are due to the sheer volume that is sampled. The latter effects appear in the form of an entropic…
We investigate the computational hardness of estimating the quantum $\alpha$-R\'enyi entropy ${\rm S}^{\tt R}_{\alpha}(\rho) = \frac{\ln {\rm Tr}(\rho^\alpha)}{1-\alpha}$ and the quantum $q$-Tsallis entropy ${\rm S}^{\tt T}_q(\rho) =…
The phenomenon of entropy concentration provides strong support for the maximum entropy method, MaxEnt, for inferring a probability vector from information in the form of constraints. Here we extend this phenomenon, in a discrete setting,…
Randomized (dithered) quantization is a method capable of achieving white reconstruction error independent of the source. Dithered quantizers have traditionally been considered within their natural setting of uniform quantization. In this…
This paper is twofold. In the first part, we present a refinement of the R\'enyi Entropy Power Inequality (EPI) recently obtained in \cite{BM16}. The proof largely follows the approach in \cite{DCT91} of employing Young's convolution…
This work provides data-processing and majorization inequalities for $f$-divergences, and it considers some of their applications to coding problems. This work also provides tight bounds on the R\'{e}nyi entropy of a function of a discrete…
Entropy is a measure of the randomness of a system. Estimating the entropy of a quantum state is a basic problem in quantum information. In this paper, we introduce a time-efficient quantum approach to estimating the von Neumann entropy…
We study the entanglement and Renyi entropies of two disjoint intervals in minimal models of conformal field theory. We use the conformal block expansion and fusion rules of twist fields to define a systematic expansion in the elliptic…
Quantum generalizations of R\'enyi's entropies are a useful tool to describe a variety of operational tasks in quantum information processing. Two families of such generalizations turn out to be particularly useful: the Petz quantum R\'enyi…
We extend the definitions of different types of quantum R\'enyi relative entropy from the finite dimensional setting of density matrices to density spaces of $C^*$-algebras. We show that those quantities (which trivially coincide in the…