English
Related papers

Related papers: Telescopic Relative Entropy

200 papers

The aim of this study is to generalise recent results of the two last authors on en-tropy methods for measure solutions of the renewal equation to other classes of structured population problems. Specifically, we develop a generalised…

Analysis of PDEs · Mathematics 2018-04-11 Tomasz Dębiec , Marie Doumic , Piotr Gwiazda , Emil Wiedemann

Two new relative entropy quantities, called the min- and max-relative entropies, are introduced and their properties are investigated. The well-known min- and max- entropies, introduced by Renner, are obtained from these. We define a new…

Quantum Physics · Physics 2016-11-18 Nilanjana Datta

Entropy is the measure of uncertainty in any data and is adopted for maximisation of mutual information in many remote sensing operations. The availability of wide entropy variations motivated us for an investigation over the suitability…

Computer Vision and Pattern Recognition · Computer Science 2014-05-25 Dr. S. K. Katiyar , Arun P. V.

Relative entropy of coherence can be written as an entropy difference of the original state and the incoherent state closest to it when measured by relative entropy. The natural question is, if we generalize this situation to Tsallis or…

Quantum Physics · Physics 2024-08-02 Anna Vershynina

Transfer entropy (TE) is a popular measure of information flow found to perform consistently well in different settings. Symbolic transfer entropy (STE) is defined similarly to TE but on the ranks of the components of the reconstructed…

Chaotic Dynamics · Physics 2010-07-05 Dimitris Kugiumtzis

The quantum relative entropy $S(\rho||\sigma)$ is a widely used dissimilarity measure between quantum states, but it has the peculiarity of being asymmetric in its arguments. We quantify the amount of asymmetry by providing a sharp upper…

Mathematical Physics · Physics 2015-06-15 Koenraad M. R. Audenaert

A way to pose the entropic uncertainty principle for trace-preserving super-operators is presented. It is based on the notion of extremal unraveling of a super-operator. For given input state, different effects of each unraveling result in…

Quantum Physics · Physics 2015-05-19 Alexey E. Rastegin

The density matrix is a positive semidefinite operator of trace 1 characterizing the state of a quantum system. We consider the inverse problem to reconstruct such density matrices from indirect measurements, also known as quantum state…

Numerical Analysis · Mathematics 2026-03-06 Florian Oberender , Thorsten Hohage

In this article we describe the applications of the relative entropy framework. In particular uniqueness of an entropy solution is proven for a scalar conservation law, using the notion of measure-valued entropy solutions. Further we survey…

Analysis of PDEs · Mathematics 2017-09-06 Tomasz Dębiec , Piotr Gwiazda , Kamila Łyczek , Agnieszka Świerczewska-Gwiazda

The Matrix-based Renyi's entropy enables us to directly measure information quantities from given data without the costly probability density estimation of underlying distributions, thus has been widely adopted in numerous statistical…

Machine Learning · Statistics 2022-05-17 Yuxin Dong , Tieliang Gong , Shujian Yu , Chen Li

General hyperbolic systems of balance laws with inhomogeneity in space and time in all constitutive functions are studied in the context of relative entropy. A framework is developed in this setting that contributes to a measure-valued weak…

Analysis of PDEs · Mathematics 2022-06-02 Cleopatra Christoforou

Entropy and relative or cross entropy measures are two very fundamental concepts in information theory and are also widely used for statistical inference across disciplines. The related optimization problems, in particular the maximization…

Statistics Theory · Mathematics 2021-06-18 Abhik Ghosh , Ayanendranath Basu

We introduce variants of relative entropy of entanglement based on the optimal distinguishability from unentangled states by means of restricted measurements. In this way, we are able to prove that the standard regularized entropy of…

Quantum Physics · Physics 2010-01-29 M. Piani

Relative entropy between two states in the same Hilbert space is a fundamental statistical measure of the distance between these states. Relative entropy is always positive and increasing with the system size. Interestingly, for two states…

High Energy Physics - Theory · Physics 2015-06-15 David D. Blanco , Horacio Casini , Ling-Yan Hung , Robert C. Myers

We study the notion of approximate entropy within the framework of network theory. Approximate entropy is an uncertainty measure originally proposed in the context of dynamical systems and time series. We firstly define a purely structural…

Disordered Systems and Neural Networks · Physics 2013-05-30 James West , Lucas Lacasa , Simone Severini , Andrew Teschendorff

We develop a maximum relative entropy formalism to generate optimal approximations to probability distributions. The central results consist in (a) justifying the use of relative entropy as the uniquely natural criterion to select a…

Statistical Mechanics · Physics 2008-10-17 Chih-Yuan Tseng , Ariel Caticha

We present the modified relative entropy of entanglement (MRE) in order to both improve the computability for the relative entropy of entanglement and avoid the problem that the entanglement of formation seems to be greater than…

Quantum Physics · Physics 2007-05-23 An Min Wang

We introduce a new information-theoretic formulation of quantum measurement uncertainty relations, based on the notion of relative entropy between measurement probabilities. In the case of a finite-dimensional system and for any approximate…

Mathematical Physics · Physics 2018-03-02 Alberto Barchielli , Matteo Gregoratti , Alessandro Toigo

We prove that the closest Gaussian state to an arbitrary $N$-mode field state through the relative entropy is built with the covariance matrix and the average displacement of the given state. Consequently, the relative entropy of an…

Quantum Physics · Physics 2013-08-14 Paulina Marian , Tudor A. Marian

The quantum relative entropy is a fundamental quantity in quantum information science, characterizing the distinguishability between two quantum states. However, this quantity is not additive in general for correlated quantum states,…

Quantum Physics · Physics 2025-06-05 Kun Fang , Hamza Fawzi , Omar Fawzi