English
Related papers

Related papers: Saturating the Data Processing Inequality for $\al…

200 papers

The relative entropy is a measure of the distinguishability of two quantum states. A great deal of progress has been made in the study of the relative entropy between an excited state and the vacuum state of a conformal field theory (CFT)…

High Energy Physics - Theory · Physics 2019-11-25 Ning Bao , Mudassir Moosa , Ibrahim Shehzad

This paper is concerned with certain invariant random processes (called factors of IID) on infinite trees. Given such a process, one can assign entropies to different finite subgraphs of the tree. There are linear inequalities between these…

Probability · Mathematics 2017-11-27 Ágnes Backhausz , Balázs Gerencsér , Viktor Harangi

The R\'enyi and Shannon entropies are information-theoretic measures which have enabled to formulate the position-momentum uncertainty principle in a much more adequate and stringent way than the (variance-based) Heisenberg-like relation.…

Quantum Physics · Physics 2013-05-24 Pablo Sánchez-Moreno , Steeve Zozor , Jesus S. Dehesa

A task is randomly drawn from a finite set of tasks and is described using a fixed number of bits. All the tasks that share its description must be performed. Upper and lower bounds on the minimum $\rho$-th moment of the number of performed…

Information Theory · Computer Science 2014-10-07 Christoph Bunte , Amos Lapidoth

Following a recent proof of Shannon's entropy power inequality (EPI), a comprehensive framework for deriving various EPIs for the R\'enyi entropy is presented that uses transport arguments from normal densities and a change of variable by…

Information Theory · Computer Science 2018-10-17 Olivier Rioul

We consider the one-dimensional XY quantum spin chain in a transverse magnetic field. We are interested in the Renyi entropy of a block of L neighboring spins at zero temperature on an infinite lattice. The Renyi entropy is essentially the…

Quantum Physics · Physics 2010-02-16 F. Franchini , A. R. Its , V. E. Korepin

Divergences often play important roles for study in information science so that it is indispensable to investigate their fundamental properties. There is also a mathematical significance of such results. In this paper, we introduce some…

Statistical Mechanics · Physics 2011-10-19 S. Furuichi , F. -C. Mitroi

For the classical maximum coverage problem, the greedy algorithm achieves a worst-case $1-1/e$ approximation, which is optimal unless $\text{P} = \text{NP}$. The notion of coverage appears in a wide range of optimization tasks, where…

Data Structures and Algorithms · Computer Science 2026-04-29 Eric Balkanski , Jason Chatzitheodorou , Flore Sentenac

We consider the Student-t and Student-r distributions, which maximise Renyi entropy under a covariance condition. We show that they have information-theoretic properties which mirror those of the Gaussian distributions, which maximise…

Probability · Mathematics 2010-08-17 Oliver Johnson , Christophe Vignat

We show that for a d-dimensional CFT in flat space, the Renyi entropy S_q across a spherical entangling surface has the following property: in an expansion around q=1, the first correction to the entanglement entropy is proportional to C_T,…

High Energy Physics - Theory · Physics 2015-06-16 Eric Perlmutter

We investigate the role of convexity in R\'enyi entropy power inequalities. After proving that a general R\'enyi entropy power inequality in the style of Bobkov-Chistyakov (2015) fails when the R\'enyi parameter $r\in(0,1)$, we show that…

Probability · Mathematics 2019-09-30 Jiange Li , Arnaud Marsiglietti , James Melbourne

We address the question and related controversy of the formulation of the $q$-entropy, and its relative entropy counterpart, for models described by continuous (non-discrete) sets of variables. We notice that an $L_p$ normalized functional…

Statistical Mechanics · Physics 2020-04-22 Nikolaos Kalogeropoulos

While most useful information theoretic inequalities can be deduced from the basic properties of entropy or mutual information, up to now Shannon's entropy power inequality (EPI) is an exception: Existing information theoretic proofs of the…

Information Theory · Computer Science 2016-11-17 Olivier Rioul

The paper establishes the equality condition in the I-MMSE proof of the entropy power inequality (EPI). This is done by establishing an exact expression for the deficit between the two sides of the EPI. Interestingly, a necessary condition…

Information Theory · Computer Science 2017-03-23 Alex Dytso , Ronit Bustin , H. Vincent Poor , Shlomo Shamai

R\'enyi entropies are conceptually valuable and experimentally relevant generalisations of the celebrated von Neumann entanglement entropy. After a quantum quench in a clean quantum many-body system they generically display a universal…

Statistical Mechanics · Physics 2022-08-04 Bruno Bertini , Katja Klobas , Vincenzo Alba , Gianluca Lagnese , Pasquale Calabrese

Quantities computed by minimal cuts, such as entanglement entropies achievable by the Ryu-Takayanagi proposal in the AdS/CFT correspondence, are constrained by linear inequalities. We prove a previously conjectured property of all such…

High Energy Physics - Theory · Physics 2026-02-10 Bartlomiej Czech , Yichen Feng , Xianlai Wu , Minjun Xie

Universal hash functions map the output of a source to random strings over a finite alphabet, aiming to approximate the uniform distribution on the set of strings. A classic result on these functions, called the Leftover Hash Lemma, gives…

Information Theory · Computer Science 2026-01-05 Madhura Pathegama , Alexander Barg

The optimized quantum $f$-divergences form a family of distinguishability measures that includes the quantum relative entropy and the sandwiched R\'enyi relative quasi-entropy as special cases. In this paper, we establish physically…

Quantum Physics · Physics 2021-10-04 Li Gao , Mark M. Wilde

We revisit the connection between index and relative entropy for an inclusion of finite von Neumann algebras. We observe that the Pimsner-Popa index connects to sandwiched Renyi $p$-relative entropy for all $1/2\le p\le \infty$, including…

Operator Algebras · Mathematics 2020-11-17 Li Gao , Marius Junge , Nicholas LaRacuente

I compute the leading contribution to the ground state Renyi entropy $S_{\alpha}$ for a region of linear size $L$ in a Fermi liquid. The result contains a universal boundary law violating term simply related the more familiar entanglement…

Strongly Correlated Electrons · Physics 2012-10-03 Brian Swingle