English
Related papers

Related papers: Tight relations and equivalences between smooth re…

200 papers

The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…

Information Theory · Computer Science 2017-05-01 Maciej Skorski

Uncertainty relations based on quantum coherence is an important problem in quantum information science. We discuss uncertainty relations for averaged unified ($\alpha$,$\beta$)-relative entropy of coherence under mutually unbiased…

Quantum Physics · Physics 2026-04-08 Baolong Cheng , Zhaoqi Wu

An uncertainty relation for the R\'enyi entropies of conjugate quantum observables is used to obtain a strong Heisenberg limit of the form ${\rm RMSE} \geq f(\alpha)/(\langle N\rangle+\frac12)$, bounding the root mean square error of any…

Quantum Physics · Physics 2022-11-21 Michael J. W. Hall

We consider two fundamental tasks in quantum information theory, data compression with quantum side information as well as randomness extraction against quantum side information. We characterize these tasks for general sources using…

Quantum Physics · Physics 2013-10-25 Marco Tomamichel , Masahito Hayashi

We develop a maximum relative entropy formalism to generate optimal approximations to probability distributions. The central results consist in (a) justifying the use of relative entropy as the uniquely natural criterion to select a…

Statistical Mechanics · Physics 2008-10-17 Chih-Yuan Tseng , Ariel Caticha

The paper describes an approach to measuring convergence of an algorithm to its result in terms of an entropy-like function of partitions of its inputs of a given length. The goal is to look at the algorithmic data processing from the…

Computational Complexity · Computer Science 2016-05-06 Anatol Slissenko

Entropy is the measure of uncertainty in any data and is adopted for maximisation of mutual information in many remote sensing operations. The availability of wide entropy variations motivated us for an investigation over the suitability…

Computer Vision and Pattern Recognition · Computer Science 2014-05-25 Dr. S. K. Katiyar , Arun P. V.

Over the last few years, machine learning unlocked previously infeasible features for compression, such as providing guarantees for users' privacy or tailoring compression to specific data statistics (e.g., satellite images or audio…

Information Theory · Computer Science 2026-03-25 Gergely Flamich

A fundamental approach for the characterization and quantification of all kinds of resources is to study the conversion between different resource objects under certain constraints. Here we analyze, from a resource-non-specific standpoint,…

Quantum Physics · Physics 2019-07-11 Zi-Wen Liu , Kaifeng Bu , Ryuji Takagi

Purely multiplicative comparisons of quantum relative entropy are desirable but challenging to prove. We show such comparisons for relative entropies between comparable densities, including the relative entropy of a density with respect to…

Quantum Physics · Physics 2022-12-16 Nicholas LaRacuente

We define a one-parameter family of entropies, each assigning a real number to any probability measure on a compact metric space (or, more generally, a compact Hausdorff space with a notion of similarity between points). These entropies…

Metric Geometry · Mathematics 2020-12-17 Tom Leinster , Emily Roff

Thermodynamic entropy, as defined by Clausius, characterizes macroscopic observations of a system based on phenomenological quantities such as temperature and heat. In contrast, information-theoretic entropy, introduced by Shannon, is a…

Quantum Physics · Physics 2017-01-04 Mirjam Weilenmann , Lea Krämer , Philippe Faist , Renato Renner

We review the properties of the quantum relative entropy function and discuss its application to problems of classical and quantum information transfer and to quantum data compression. We then outline further uses of relative entropy to…

Quantum Physics · Physics 2007-05-23 Benjamin Schumacher , Michael D. Westmoreland

We give a simple proof of the uncertainty principle with quantum side information, as in [Berta et al. Nature Physics 6, 659 (2010)], invoking the monotonicity of the relative entropy. Our proof shows that the entropic uncertainty principle…

Quantum Physics · Physics 2011-12-08 Patrick J. Coles , Li Yu , Michael Zwolak

The ability of quantum states to be in superposition is one of the key features that sets them apart from the classical world. This `coherence' is rigorously quantified by resource theories, which aim to understand how such properties may…

Quantum Physics · Physics 2024-07-08 Ruvi Lecamwasam , Syed M Assad , Joseph J Hope , Ping Koy Lam , Jayne Thompson , Mile Gu

Fidelity and relative entropy are two significant quantities in quantum information theory. We study the quantum fidelity and relative entropy under unitary orbits. The maximal and minimal quantum fidelity and relative entropy between two…

Quantum Physics · Physics 2014-01-15 Lin Zhang , Shao-Ming Fei

Information theory has become an increasingly important research field to better understand quantum mechanics. Noteworthy, it covers both foundational and applied perspectives, also offering a common technical language to study a variety of…

Quantum Physics · Physics 2021-03-09 Diego Paiva Pires , Kavan Modi , Lucas Chibebe Céleri

This paper introduces a comprehensive framework for complex-valued probability measures and explores their novel applications in information theory and statistical analysis. We define a complex probability measure as a phase-modulated…

Information Theory · Computer Science 2026-03-16 Siang Cheng , Hejun Xu , Tianxiao Pang

The R{\'e}nyi entropy is one of the important information measures that generalizes Shannon's entropy. The quantum R{\'e}nyi entropy has a fundamental role in quantum information theory, therefore, bounding this quantity is of vital…

Mathematical Physics · Physics 2016-09-26 Hadi Reisizadeh , S. Mahmoud Manjegani

Relative entropy is a powerful measure of the dissimilarity between two statistical field theories in the continuum. In this work, we study the relative entropy between Gaussian scalar field theories in a finite volume with different masses…

Statistical Mechanics · Physics 2025-01-28 Markus Schröfl , Stefan Floerchinger