English
Related papers

Related papers: R\'enyi entropy for multivariate controlled autore…

200 papers

The emergent dynamics of complex systems often arise from the internal dynamical interactions among different elements and hence is to be modeled using multiple variables that represent the different dynamical processes. When such systems…

Chaotic Dynamics · Physics 2024-11-05 Shivam Kumar , R. Misra , G. Ambika

Sharpness (of the loss minima) is a common measure to investigate the generalization of neural networks. Intuitively speaking, the flatter the landscape near the minima is, the better generalization might be. Unfortunately, the correlation…

Machine Learning · Computer Science 2025-10-17 Qiaozhe Zhang , Jun Sun , Ruijie Zhang , Yingzhuang Liu

We develop a nonequilibrium increment method in quantum Monte Carlo simulations to obtain the R\'enyi entanglement entropy of various quantum many-body systems with high efficiency and precision. To demonstrate its power, we show the…

Strongly Correlated Electrons · Physics 2022-07-01 Jiarui Zhao , Bin-Bin Chen , Yan-Cheng Wang , Zheng Yan , Meng Cheng , Zi Yang Meng

We consider the parametric estimation of the driving L\'evy process of a multivariate continuous-time autoregressive moving average (MCARMA) process, which is observed on the discrete time grid $(0,h,2h,...)$. Beginning with a new state…

Probability · Mathematics 2015-05-19 Peter J. Brockwell , Eckhard Schlemm

The R\'enyi entanglement entropy in quantum many-body systems can be viewed as the difference in free energy between partition functions with different trace topologies. We introduce an external field $\lambda$ that controls the partition…

Strongly Correlated Electrons · Physics 2020-03-20 Jonathan D'Emidio

Two maximization problems of R\'enyi entropy rate are investigated: the maximization over all stochastic processes whose marginals satisfy a linear constraint, and the Burg-like maximization over all stochastic processes whose…

Information Theory · Computer Science 2015-01-06 Christoph Bunte , Amos Lapidoth

We prove that all R\'enyi entanglement entropies of spin-chains described by generic (gapped), translational invariant matrix product states (MPS) are extensive for disconnected sub-systems: All R\'enyi entanglement entropy densities of the…

Quantum Physics · Physics 2020-08-31 Alberto Rolandi , Henrik Wilming

We study systematically resource measures of coherence and entanglement based on R\'enyi relative entropies, which include the logarithmic robustness of coherence, geometric coherence, and conventional relative entropy of coherence together…

Quantum Physics · Physics 2017-11-29 Huangjun Zhu , Masahito Hayashi , Lin Chen

The Renyi entropy is a generalisation of the Shannon entropy that is sensitive to the fine details of a probability distribution. We present results for the Renyi entropy of the totally asymmetric exclusion process (TASEP). We calculate…

Statistical Mechanics · Physics 2017-11-10 Anthony J. Wood , Richard A. Blythe , Martin R. Evans

It is known that the variance and entropy of quantum observables decompose into intrinsically quantum and classical contributions. Here a general method of constructing quantum-classical decompositions of resources such as uncertainty is…

Quantum Physics · Physics 2023-07-07 Michael J. W. Hall

The R\'{e}nyi cross-entropy measure between two distributions, a generalization of the Shannon cross-entropy, was recently used as a loss function for the improved design of deep learning generative adversarial networks. In this work, we…

Information Theory · Computer Science 2022-08-09 Ferenc Cole Thierrin , Fady Alajaji , Tamás Linder

Entropy measures quantify the amount of information and correlation present in a quantum system. In practice, when the quantum state is unknown and only copies thereof are available, one must resort to the estimation of such entropy…

Quantum Physics · Physics 2024-03-27 Ziv Goldfeld , Dhrumil Patel , Sreejith Sreekumar , Mark M. Wilde

A method is presented for computing the R\'enyi entropy of a perturbed massless vacuum on the ball via a comparison with lattice field theory. If the perturbed state is Gaussian with smoothly varying correlation functions and the…

High Energy Physics - Theory · Physics 2024-12-02 Andrew Buchanan

Starting from the geometrical interpretation of the R\'enyi entropy, we introduce further extensive generalizations and study their properties. In particular, we found the probability distribution function obtained by the MaxEnt principle…

Statistical Mechanics · Physics 2015-06-17 Giorgio Sonnino , György Steinbrecher

The R\'enyi and Shannon entropies are information-theoretic measures which have enabled to formulate the position-momentum uncertainty principle in a much more adequate and stringent way than the (variance-based) Heisenberg-like relation.…

Quantum Physics · Physics 2013-05-24 Pablo Sánchez-Moreno , Steeve Zozor , Jesus S. Dehesa

Two R\'{e}nyi-type generalizations of the Shannon cross-entropy, the R\'{e}nyi cross-entropy and the Natural R\'{e}nyi cross-entropy, were recently used as loss functions for the improved design of deep learning generative adversarial…

Information Theory · Computer Science 2022-10-06 Ferenc Cole Thierrin , Fady Alajaji , Tamás Linder

Entropy is the measure of uncertainty in any data and is adopted for maximisation of mutual information in many remote sensing operations. The availability of wide entropy variations motivated us for an investigation over the suitability…

Computer Vision and Pattern Recognition · Computer Science 2014-05-25 Dr. S. K. Katiyar , Arun P. V.

This paper is twofold. In the first part, we present a refinement of the R\'enyi Entropy Power Inequality (EPI) recently obtained in \cite{BM16}. The proof largely follows the approach in \cite{DCT91} of employing Young's convolution…

Probability · Mathematics 2018-05-01 Jiange Li

There are no universally accepted definitions of R\'enyi conditional entropy and R\'enyi mutual information, although motivated by different applications, several definitions have been proposed in the literature. In this paper, we consider…

Information Theory · Computer Science 2025-11-05 Shi-Bing Li , Ke Li , Lei Yu

It is shown that R\'enyi statistics provides a plausible basis to describe the hadron distributions measured in high energy particle interactions. Generalized Boltzmann and gamma distributions obtained by maximization of R\'enyi entropy…

High Energy Physics - Phenomenology · Physics 2007-05-23 A. Kropivnitskaya , A. Rostovtsev