English
Related papers

Related papers: Saturating the Data Processing Inequality for $\al…

200 papers

Integral representations of quantum relative entropy, and of the directional second and higher order derivatives of von Neumann entropy, are established, and used to give simple proofs of fundamental, known data processing inequalities: the…

Quantum Physics · Physics 2023-09-13 Péter E. Frenkel

We study an extension of the sandwiched R\'enyi relative entropies for normal positive functionals on a von Neumann algebra, for parameter values $\alpha\in [1/2,1)$. This work is intended as a continuation of [A. Jen\v{c}ov\'a, Ann. Henri…

Quantum Physics · Physics 2021-11-08 Anna Jenčová

In this paper we study certain properties of R\'{e}nyi entropy functionals $H_\alpha(\mathcal{P})$ on the space of probability distributions over $\mathbb{Z}_+$. Primarily, continuity and convergence issues are addressed. Some properties…

Information Theory · Computer Science 2020-08-13 Mladen Kovačević , Ivan Stanojević , Vojin Šenk

In this work, we provide a strengthening of the data processing inequality for the relative entropy introduced by Belavkin and Staszewski (BS-entropy). This extends previous results by Carlen and Vershynina for the relative entropy and…

Mathematical Physics · Physics 2020-03-13 Andreas Bluhm , Angela Capel

We offer the first operational interpretation of the $\alpha$-z relative entropies, a measure of distinguishability between two quantum states introduced by Jak\v{s}i\'c et al. and Audenaert and Datta. We show that these relative entropies…

Quantum Physics · Physics 2026-04-24 Frits Verhagen , Marco Tomamichel , Erkka Haapasalo

We prove an achievability result for privacy amplification and decoupling in terms of the sandwiched R\'enyi entropy of order $\alpha \in (1,2]$; this extends previous results which worked for $\alpha=2$. The fact that this proof works for…

Quantum Physics · Physics 2022-01-11 Frédéric Dupuis

Relative entropy is a measure of distinguishability for quantum states, and plays a central role in quantum information theory. The family of Renyi entropies generalizes to Renyi relative entropies that include as special cases most entropy…

High Energy Physics - Theory · Physics 2014-12-12 Nima Lashkari

We study the relative entropy between the empirical estimate of a discrete distribution and the true underlying distribution. If the minimum value of the probability mass function exceeds an $\alpha > 0$ (i.e. when the true underlying…

Statistics Theory · Mathematics 2021-09-21 Alankrita Bhatt , Ankit Pensia

Quantum generalizations of R\'enyi's entropies are a useful tool to describe a variety of operational tasks in quantum information processing. Two families of such generalizations turn out to be particularly useful: the Petz quantum R\'enyi…

Quantum Physics · Physics 2020-12-16 Raban Iten

Recently, an interesting quantity called the quantum Renyi divergence (or "sandwiched" Renyi relative entropy) was defined for pairs of positive semi-definite operators $\rho$ and $\sigma$. It depends on a parameter $\alpha$ and acts as a…

Quantum Physics · Physics 2014-07-28 Nilanjana Datta , Felix Leditzky

We show that under convergence in measure of probability density functions, differential entropy converges whenever the entropy integrands $f_n |\log f_n|$ are uniformly integrable and tight -- a direct consequence of Vitali's convergence…

Information Theory · Computer Science 2026-02-19 Mahesh Godavarti

We describe a quantum algorithm to estimate the $\alpha$-Renyi entropy of an unknown density matrix $\rho\in\mathcal{C}^{d\times d}$ for $\alpha\neq 1$ by combining the recent technique of quantum singular value transformations with the…

Quantum Physics · Physics 2021-09-01 Sathyawageeswar Subramanian , Min-Hsiu Hsieh

Strong data processing inequalities (SDPI) are an important object of study in Information Theory and have been well studied for $f$-divergences. Universal upper and lower bounds have been provided along with several applications,…

Information Theory · Computer Science 2024-05-16 Lifu Jin , Amedeo Roberto Esposito , Michael Gastpar

The R{\'e}nyi entropy is one of the important information measures that generalizes Shannon's entropy. The quantum R{\'e}nyi entropy has a fundamental role in quantum information theory, therefore, bounding this quantity is of vital…

Mathematical Physics · Physics 2016-09-26 Hadi Reisizadeh , S. Mahmoud Manjegani

We investigate the large-time asymptotics of nonlinear diffusion equations $u_t = \Delta u^p$ in dimension $n \ge 1$, in the exponent interval $p > n/(n+2)$, when the initial datum $u_0$ is of bounded second moment. Precise rates of…

Analysis of PDEs · Mathematics 2015-06-19 J. A. Carrillo , G. Toscani

We prove number of quantitative stability bounds for the cases of equality in Petz's monotonicity theorem for quasi-relative entropies defined in terms of an operator monotone decreasing functions. Included in our results is a bound in…

Mathematical Physics · Physics 2018-05-18 Eric A. Carlen , Anna Vershynina

We consider the problem of approximating the empirical Shannon entropy of a high-frequency data stream under the relaxed strict-turnstile model, when space limitations make exact computation infeasible. An equivalent measure of entropy is…

Computation · Statistics 2013-04-18 Peter Clifford , Ioana Ada Cosma

Bounds on information combining are a fundamental tool in coding theory, in particular when analyzing polar codes and belief propagation. They usually bound the evolution of random variables with respect to their Shannon entropy. In recent…

Information Theory · Computer Science 2023-05-05 Christoph Hirche , Xinyue Guan , Marco Tomamichel

Properties of scalar quantization with $r$th power distortion and constrained R\'enyi entropy of order $\alpha\in (0,1)$ are investigated. For an asymptotically (high-rate) optimal sequence of quantizers, the contribution to the R\'enyi…

Information Theory · Computer Science 2012-03-27 Wolfgang Kreitmeier , Tamas Linder

The Matrix-based Renyi's entropy enables us to directly measure information quantities from given data without the costly probability density estimation of underlying distributions, thus has been widely adopted in numerous statistical…

Machine Learning · Statistics 2022-05-17 Yuxin Dong , Tieliang Gong , Shujian Yu , Chen Li