English
Related papers

Related papers: Weighted Approach to R\'enyi Entropy

200 papers

We show that the R\'enyi entropies of single particle, extended wave functions for disordered systems contain information about the multifractal spectrum. It is shown for moments of the R\'enyi entropy, $S_{n}$, where $|n|<1$, it is…

Mesoscale and Nanoscale Physics · Physics 2013-02-04 Xiao Chen , Benjamin Hsu , Taylor L. Hughes , Eduardo Fradkin

The Renyi entropy is a generalization of the usual concept of entropy which depends on a parameter q. In fact, Renyi entropy is closely related to free energy. Suppose we start with a system in thermal equilibrium and then suddenly divide…

Quantum Physics · Physics 2022-05-18 John C. Baez

Comparison-based algorithms are algorithms for which the execution of each operation is solely based on the outcome of a series of comparisons between elements. Comparison-based computations can be naturally represented via the following…

Data Structures and Algorithms · Computer Science 2020-11-17 Michel Schellekens

We obtain formulas for Petz-R\'enyi and Umegaki relative entropy from the idea of distribution of a positive selfadjoint operator. Classical results on R\'enyi and Kullback-Leibler divergences are applied to obtain new results and new…

Quantum Physics · Physics 2023-08-15 George Androulakis , Tiju Cherian John

Classical chaos is often characterized as exponential divergence of nearby trajectories. In many interesting cases these trajectories can be identified with geodesic curves. We define here the entropy by $S = \ln \chi (x)$ with $\chi(x)$…

General Relativity and Quantum Cosmology · Physics 2017-12-27 Gilbert Weinstein , Yosef Strauss , Sergey Bondarenko , Asher Yahalom , Meir Lewkowicz , Lawrence Paul Horwitz , Jacob Levitan

We associate to the p-th R\'enyi entropy a definition of entropy power, which is the natural extension of Shannon's entropy power and exhibits a nice behaviour along solutions to the p-nonlinear heat equation in $R^n$. We show that the…

Information Theory · Computer Science 2014-09-16 Giuseppe Savarè , Giuseppe Toscani

We leverage the Gibbs inequality and its natural generalization to R\'enyi entropies to derive closed-form parametric expressions of the optimal lower bounds of $\rho$th-order guessing entropy (guessing moment) of a secret taking values on…

Information Theory · Computer Science 2024-01-31 Julien Béguinot , Olivier Rioul

We study an extension of the sandwiched R\'enyi relative entropies for normal positive functionals on a von Neumann algebra, for parameter values $\alpha\in [1/2,1)$. This work is intended as a continuation of [A. Jen\v{c}ov\'a, Ann. Henri…

Quantum Physics · Physics 2021-11-08 Anna Jenčová

We obtain uncertainty and certainty relations of state-independent form for the three Pauli observables with use of the R\'enyi entropies of order $\alpha\in(0;1]$. It is shown that these entropic bounds are tight in the sense that they are…

Quantum Physics · Physics 2014-04-03 Alexey E. Rastegin

In this paper we study certain properties of R\'{e}nyi entropy functionals $H_\alpha(\mathcal{P})$ on the space of probability distributions over $\mathbb{Z}_+$. Primarily, continuity and convergence issues are addressed. Some properties…

Information Theory · Computer Science 2020-08-13 Mladen Kovačević , Ivan Stanojević , Vojin Šenk

We show that for any $\alpha>0$ the R\'enyi entropy of order $\alpha$ is minimized, among all symmetric log-concave random variables with fixed variance, either for a uniform distribution or for a two sided exponential distribution. The…

Information Theory · Computer Science 2021-10-05 Maciej Białobrzeski , Piotr Nayar

The extropy is a measure of information introduced by Lad et al. (2015) as dual to entropy. As the entropy, it is a shift-independent information measure. We introduce here the notion of weighted extropy, a shift-dependent information…

Statistics Theory · Mathematics 2020-08-19 Narayanaswamy Balakrishnan , Francesco Buono , Maria Longobardi

Entropy is a measure of heterogeneity widely used in applied sciences, often when data are collected over space. Recently, a number of approaches has been proposed to include spatial information in entropy. The aim of entropy is to…

Statistics Theory · Mathematics 2019-11-12 Linda Altieri , Daniela Cocchi , Giulia Roli

The von Neumann entropy of a density matrix of dimension d, expressed in terms of the first d-1 integer order R\'enyi entropies, is monotonically increasing in R\'enyi entropies of even order and decreasing in those of odd order.

Quantum Physics · Physics 2013-10-23 Mark Fannes

We provide a consistent first principles prescription to compute gravitational R\'enyi entropy using Hayward corner terms. For Euclidean solutions to Einstein gravity, we compute R\'enyi entropy of Hartle--Hawking and fixed--area states by…

High Energy Physics - Theory · Physics 2024-06-28 Jani Kastikainen , Andrew Svesko

We analyse an analog of the entropy-power inequality for the weighted entropy.

Information Theory · Computer Science 2015-03-10 Yuri Suhov , Salimeh Yasaei Sekeh , Mark Kelbert

Relative entropy of coherence can be written as an entropy difference of the original state and the incoherent state closest to it when measured by relative entropy. The natural question is, if we generalize this situation to Tsallis or…

Quantum Physics · Physics 2024-08-02 Anna Vershynina

Entropy rate is a real valued functional on the space of discrete random sources which lacks a closed formula even for subclasses of sources which have intuitive parameterizations. A good way to overcome this problem is to examine its…

Information Theory · Computer Science 2015-01-14 Alexander Schönhuth

In this paper the author analyses the weighted Renyi entropy in order to derive several inequalities in weighted case. Furthermore, using the proposed notions $\alpha$-th generalized derivation and ($\alpha$; p)-th weighted Fisher…

Information Theory · Computer Science 2015-10-16 Salimeh Yasaei Sekeh

The concept of Entropy plays a key role in Information Theory, Statistics, and Machine Learning.This paper introduces a new entropy measure, called the t-entropy, which exploits the concavity of the inverse-tan function. We analytically…

Information Theory · Computer Science 2021-05-06 Saptarshi Chakraborty , Debolina Paul , Swagatam Das
‹ Prev 1 4 5 6 7 8 10 Next ›