English
Related papers

Related papers: Statistical Inference for R\'enyi Entropy Function…

200 papers

It is known that the variance and entropy of quantum observables decompose into intrinsically quantum and classical contributions. Here a general method of constructing quantum-classical decompositions of resources such as uncertainty is…

Quantum Physics · Physics 2023-07-07 Michael J. W. Hall

Using R\'enyi entropy, a possible thermostatistics for nonextensive systems is discussed. We show that it is possible to get the $q$-exponential distribution function for nonextensive systems having nonadditive energy but additive entropy.…

Statistical Mechanics · Physics 2007-05-23 Qiuping A. Wang

Conventional information-theoretic quantities assume access to probability distributions. Estimating such distributions is not trivial. Here, we consider function-based formulations of cross entropy that sidesteps this a priori estimation…

Information Theory · Computer Science 2021-09-27 Isaac J. Sledge , Jose C. Principe

We review connections between the cumulant generating function of full counting statistics of particle number and the R\'enyi entanglement entropy. We calculate these quantities based on the fermionic and bosonic path-integral defined on…

Mesoscale and Nanoscale Physics · Physics 2019-02-05 Yasuhiro Utsumi

We obtain formulas for Petz-R\'enyi and Umegaki relative entropy from the idea of distribution of a positive selfadjoint operator. Classical results on R\'enyi and Kullback-Leibler divergences are applied to obtain new results and new…

Quantum Physics · Physics 2023-08-15 George Androulakis , Tiju Cherian John

A method is presented for computing the R\'enyi entropy of a perturbed massless vacuum on the ball via a comparison with lattice field theory. If the perturbed state is Gaussian with smoothly varying correlation functions and the…

High Energy Physics - Theory · Physics 2024-12-02 Andrew Buchanan

Entropy and relative or cross entropy measures are two very fundamental concepts in information theory and are also widely used for statistical inference across disciplines. The related optimization problems, in particular the maximization…

Statistics Theory · Mathematics 2021-06-18 Abhik Ghosh , Ayanendranath Basu

We introduce and study generalized R\'enyi entropies defined through the traces of products of ${\rm Tr}_B (|\Psi_i\rangle\langle \Psi_j|)$ where $|\Psi_i\rangle$ are eigenstates of a two-dimensional conformal field theory (CFT). When…

High Energy Physics - Theory · Physics 2022-09-21 Sara Murciano , Pasquale Calabrese , Robert M. Konik

R\'enyi complexity ratio of two density functions is introduced for three and multidimensional quantum systems. Localization property of several density functions are defined and five theorems about near continuous property of R\'enyi…

Mathematical Physics · Physics 2021-06-29 Debraj Nath

In many applications, the probability density function is subject to experimental errors. In this work the continuos dependence of a class of generalized entropies on the experimental errors is studied. This class includes the C. Shannon,…

Data Analysis, Statistics and Probability · Physics 2016-05-20 György Steinbrecher , Giorgio Sonnino

We present a general method for calculating R\'enyi entropies in the ground state of a one-dimensional critical system with mixed open boundaries, for an interval starting at one of its ends. In the conformal field theory framework, this…

Statistical Mechanics · Physics 2025-11-12 Benoit Estienne , Yacine Ikhlef , Andrei Rotaru

A large class of strongly correlated quantum systems can be described in certain large-N limits by quadratic in field actions along with self-consistency equations that determine the two-point functions. We use the replica approach and the…

Strongly Correlated Electrons · Physics 2024-02-20 Siqi Shao , Yashar Komijani

A general investigation is made into the intrinsic Riemannian geometry for complex systems, from the perspective of statistical mechanics. The entropic formulation of statistical mechanics is the ingredient which enables a connection…

Statistical Mechanics · Physics 2010-08-18 B. N. Tiwari , Vinod Chandra , Subhashish Banerjee

Shannon entropy for discrete distributions is a fundamental and widely used concept, but its continuous analogue, known as differential entropy, lacks essential properties such as positivity and compatibility with the discrete case. In this…

Probability · Mathematics 2025-08-07 Yuliya Mishura , Kostiantyn Ralchenko

We study the problem of detecting the structure of a complex dynamical system described by a set of deterministic differential equation that contains a Hamiltonian subsystem, without any information on the explicit form of evolution laws.…

Data Analysis, Statistics and Probability · Physics 2015-12-21 György Steinbrecher , Giorgio Sonnino

Entropy can signify different things: For instance, heat transfer in thermodynamics or a measure of information in data analysis. Many entropies have been introduced and it can be difficult to ascertain their different importance and…

Mathematical Physics · Physics 2025-07-10 Henrik Jeldtoft Jensen , Piergiulio Tempesta

Configurational entropy, or complexity, plays a critical role in characterizing disordered systems such as glasses, yet its measurement often requires significant computational resources. Recently, R\'enyi entropy, a one-parameter…

Disordered Systems and Neural Networks · Physics 2025-08-27 Nina Javerzat , Eric Bertin , Misaki Ozawa

Data partitioning that maximizes/minimizes the Shannon entropy, or more generally the R\'enyi entropy is a crucial subroutine in data compression, columnar storage, and cardinality estimation algorithms. These partition algorithms can be…

Data Structures and Algorithms · Computer Science 2025-11-05 Aryan Esmailpour , Sanjay Krishnan , Stavros Sintos

A class of estimators of the R\'{e}nyi and Tsallis entropies of an unknown distribution $f$ in $\mathbb{R}^m$ is presented. These estimators are based on the $k$th nearest-neighbor distances computed from a sample of $N$ i.i.d. vectors with…

Statistics Theory · Mathematics 2012-11-16 Nikolai Leonenko , Luc Pronzato , Vippal Savani

In this study an attempt has been made to propose a way to develop new distribution. For this purpose, we need only idea about distribution function. Some important statistical properties of the new distribution like moments, cumulants,…

Methodology · Statistics 2024-08-30 Brijesh P. Singh , Utpal Dhar Das