English
Related papers

Related papers: On Relations Between the Relative entropy and $\ch…

200 papers

Based on numerical and perturbation series arguments we conjecture that for certain critical random matrix models the information dimension of eigenfunctions D_1 and the spectral compressibility chi are related by the simple equation…

Chaotic Dynamics · Physics 2011-09-26 E. Bogomolny , O. Giraud

We define an entropy based on a chosen governing probability distribution. If a certain kind of measurements follow such a distribution it also gives us a suitable scale to study it with. This scale will appear as a link function that is…

Data Analysis, Statistics and Probability · Physics 2007-10-24 Peter Sunehag

We explore properties of the $\chi^2$ and more general R\'enyi (Tsallis) distances to the normal law. In particular we provide necessary and sufficient conditions for the convergence to the normal law in the central limit theorem using…

Probability · Mathematics 2016-08-08 S. G. Bobkov , G. P. Chistyakov , F. Götze

The entanglement entropy in clean, as well as in random quantum spin chains has a logarithmic size-dependence at the critical point. Here, we study the entanglement of composite systems that consist of a clean and a random part, both being…

Disordered Systems and Neural Networks · Physics 2017-11-28 Robert Juhász , István A. Kovács , Gergő Roósz , Ferenc Iglói

Quantum information processing is limited, in practice, to efficiently implementable operations. This motivates the study of quantum divergences that preserve their operational meaning while faithfully capturing these computational…

Quantum Physics · Physics 2025-09-26 Álvaro Yángüez , Thomas A. Hahn , Jan Kochanowski

We study analytically the corrections to the leading terms in the Renyi entropy of a massive lattice theory, showing significant deviations from naive expectations. In particular, we show that finite size and finite mass effects give rise…

High Energy Physics - Theory · Physics 2012-05-31 Elisa Ercolessi , Stefano Evangelisti , Fabio Franchini , Francesco Ravanini

The uncertainty principle can be expressed in entropic terms, also taking into account the role of entanglement in reducing uncertainty. The information exclusion principle bounds instead the correlations that can exist between the outcomes…

Quantum Physics · Physics 2014-02-26 Patrick J. Coles , Marco Piani

We derive an inequality for the linear entropy, that gives sharp bounds for all finite dimensional systems. The derivation is based on generalised Bloch decompositions and provides a strict improvement for the possible distribution of…

Quantum Physics · Physics 2019-10-18 Simon Morelli , Claude Klöckl , Christopher Eltschka , Jens Siewert , Marcus Huber

Numerous entropy-type characteristics (functionals) generalizing R\'enyi entropy are widely used in mathematical statistics, physics, information theory, and signal processing for characterizing uncertainty in probability distributions and…

Statistics Theory · Mathematics 2011-03-28 David Källberg , Nikolaj Leonenko , Oleg Seleznjev

This paper is devoted to the mathematical study of some divergences based on the mutual information well-suited to categorical random vectors. These divergences are generalizations of the "entropy distance" and "information distance". Their…

Statistics Theory · Mathematics 2016-08-16 Jean-François Coeurjolly , Rémy Drouilhet , Jean-François Robineau

In this work, we investigate the reliability of information-theoretic measures based on the electron-density and shape-function, specifically Shannon and R\'enyi entropies, as descriptors of electronic correlation. By establishing a…

Quantum Physics · Physics 2026-05-21 Diogo J. L. Rodrigues , Evelio Francisco , Ángel Martín Pendás

Over the last few years, machine learning unlocked previously infeasible features for compression, such as providing guarantees for users' privacy or tailoring compression to specific data statistics (e.g., satellite images or audio…

Information Theory · Computer Science 2026-03-25 Gergely Flamich

Statistical divergences are ubiquitous in machine learning as tools for measuring discrepancy between probability distributions. As these applications inherently rely on approximating distributions from samples, we consider empirical…

Statistics Theory · Mathematics 2020-05-01 Ziv Goldfeld , Kengo Kato

In this work, we study generalized entropies and information geometry in a group-theoretical framework. We explore the conditions that ensure the existence of some natural properties and at the same time of a group-theoretical structure for…

Mathematical Physics · Physics 2021-08-03 Miguel A. Rodríguez , Álvaro Romaniega , Piergiulio Tempesta

Uncertainty relations are central to quantum physics. While they were originally formulated in terms of variances, they have later been successfully expressed with entropies following the advent of Shannon information theory. Here, we…

Quantum Physics · Physics 2019-05-01 Anaelle Hertz , Nicolas J. Cerf

We present numerical results for various information theoretic properties of the square lattice Ising model. First, using a bond propagation algorithm, we find the difference $2H_L(w) - H_{2L}(w)$ between entropies on cylinders of finite…

Statistical Mechanics · Physics 2013-03-14 Hon Wai Lau , Peter Grassberger

We discuss the problem of the separation of total correlations in a given quantum state into entanglement, dissonance, and classical correlations using the concept of relative entropy as a distance measure of correlations. This allows us to…

Quantum Physics · Physics 2010-03-03 Kavan Modi , Tomasz Paterek , Wonmin Son , Vlatko Vedral , Mark Williamson

To overcome the drawbacks of Shannon's entropy, the concept of cumulative residual and past entropy has been proposed in the information theoretic literature. Furthermore, the Shannon entropy has been generalized in a number of different…

Information Theory · Computer Science 2021-03-23 Chanchal Kundu , Antonio Di Crescenzo , Maria Longobardi

Uncertainty relations provide constraints on how well the outcomes of incompatible measurements can be predicted, and, as well as being fundamental to our understanding of quantum theory, they have practical applications such as for…

Quantum Physics · Physics 2013-05-30 Patrick J. Coles , Roger Colbeck , Li Yu , Michael Zwolak

The information-geometric origin of fidelity susceptibility and its utility as a universal probe of quantum criticality in many-body settings have been widely discussed. Here we explore the metric response of quantum relative entropy (QRE),…

Statistical Mechanics · Physics 2026-05-15 Pritam Sarkar , Diptiman Sen , Arnab Sen