English
Related papers

Related papers: Testing Exponentiality Based on R\'enyi Entropy Wi…

200 papers

A test of the null hypothesis that a hazard rate is monotone nondecreasing, versus the alternative that it is not, is proposed. Both the test statistic and the means of calibrating it are new. Unlike previous approaches, neither is based on…

Statistics Theory · Mathematics 2007-06-13 Peter Hall , Ingrid Van Keilegom

We present a method for improving measurements of the entanglement R\'enyi entropies in quantum Monte Carlo simulations by relating them with measurements of participation R\'enyi entropies. Exploiting the capability of building improved…

Strongly Correlated Electrons · Physics 2014-11-11 David J. Luitz , Xavier Plat , Nicolas Laflorencie , Fabien Alet

We propose a number of concepts and properties related to `weighted' statistical inference where the observed data are classified in accordance with a `value' of a sample string. The motivation comes from the concepts of weighted…

Statistics Theory · Mathematics 2024-07-31 Mark Kelbert , Yuri Suhov

We revisit generalized entropic formulations of the uncertainty principle for an arbitrary pair of quantum observables in two-dimensional Hilbert space. R\'enyi entropy is used as uncertainty measure associated with the distribution…

Quantum Physics · Physics 2014-06-23 Steeve Zozor , Gustavo Martín Bosyk , Mariela Portesi

R\'enyi divergence is related to R\'enyi entropy much like Kullback-Leibler divergence is related to Shannon's entropy, and comes up in many settings. It was introduced by R\'enyi as a measure of information that satisfies almost the same…

Information Theory · Computer Science 2014-04-25 Tim van Erven , Peter Harremoës

We consider a Kendall's tau measure between a binary group indicator and the continuous variable under investigation to develop a thorough two-sample comparison procedure. The measure serves as a useful alternative to the hazard ratio whose…

In this paper, we examine the existence of the R\'enyi divergence between two time invariant general hidden Markov models with arbitrary positive initial distributions. By making use of a Markov chain representation of the probability…

Information Theory · Computer Science 2021-06-04 Cheng-Der Fuh , Su-Chi Fuh , Yuan-Chen Liu , Chuan-Ju Wang

Relative entropy is a fundamental class of distances between probability distributions, with widespread applications in probability theory, statistics, and machine learning. In this work, we study relative entropy from a categorical…

Logic in Computer Science · Computer Science 2026-03-06 Ralph Sarkis , Fabio Zanasi

We establish a general connection between entropic uncertainty relations, Einstein-Podolsky-Rosen steering, and joint measurability. Specifically, we construct steering inequalities from any entropic uncertainty relation, given that the…

Quantum Physics · Physics 2018-12-20 Tamás Kriváchy , Florian Fröwis , Nicolas Brunner

Entanglement entropy is a fundamental measure of quantum entanglement for pure states, but for large-scale many-body systems, R\'{e}nyi entanglement entropy is much more computationally accessible. For mixed states, logarithmic negativity…

Strongly Correlated Electrons · Physics 2025-08-14 Fo-Hong Wang , Xiao Yan Xu

A new sharp inequality featuring the differential R\'enyi entropy, the R\'enyi divergence and the R\'enyi cross-entropy of a pair of probability density functions is established. The equality is reached when one of the probability density…

Information Theory · Computer Science 2026-03-10 Razvan Gabriel Iagar , David Puertas-Centeno

This paper investigates the privacy amplification problem, and compares the existing two bounds: the exponential bound derived by one of the authors and the min-entropy bound derived by Renner. It turns out that the exponential bound is…

Information Theory · Computer Science 2012-11-26 Shun Watanabe , Masahito Hayashi

We introduce a new test statistic for testing the null hypothesis that the sampling distribution has an increasing hazard rate on a specified interval [0,a]. It is based on a comparison of the empirical distribution function with an…

Statistics Theory · Mathematics 2015-03-17 Piet Groeneboom , Geurt Jongbloed

The R\'enyi entropy is a generalization of the Shannon entropy and is widely used in mathematical statistics and applied sciences for quantifying the uncertainty in a probability distribution. We consider estimation of the quadratic R\'enyi…

Statistics Theory · Mathematics 2013-03-08 David Källberg , Nikolaj Leonenko , Oleg Seleznjev

Accounting for the non-normality of asset returns remains challenging in robust portfolio optimization. In this article, we tackle this problem by assessing the risk of the portfolio through the "amount of randomness" conveyed by its…

Portfolio Management · Quantitative Finance 2018-07-03 Nathan Lassance , Frédéric Vrins

The R\'enyi and Shannon entropies are information-theoretic measures which have enabled to formulate the position-momentum uncertainty principle in a much more adequate and stringent way than the (variance-based) Heisenberg-like relation.…

Quantum Physics · Physics 2013-05-24 Pablo Sánchez-Moreno , Steeve Zozor , Jesus S. Dehesa

Two new test statistics are introduced to test the null hypotheses that the sampling distribution has an increasing hazard rate on a specified interval [0,a]. These statistics are empirical L_1-type distances between the isotonic estimates,…

Statistics Theory · Mathematics 2015-03-17 Piet Groeneboom , Geurt Jongbloed

Two R\'{e}nyi-type generalizations of the Shannon cross-entropy, the R\'{e}nyi cross-entropy and the Natural R\'{e}nyi cross-entropy, were recently used as loss functions for the improved design of deep learning generative adversarial…

Information Theory · Computer Science 2022-10-06 Ferenc Cole Thierrin , Fady Alajaji , Tamás Linder

Feature selection, in the context of machine learning, is the process of separating the highly predictive feature from those that might be irrelevant or redundant. Information theory has been recognized as a useful concept for this task, as…

Machine Learning · Computer Science 2020-01-28 Catuscia Palamidessi , Marco Romanelli

In this article, the estimation of reliability of a system is discussed $p(y<x)$ when strength, $X$, and stress, $Y$, are two independent exponential distribution with different scale parameters when the available data are type II Censored…

Methodology · Statistics 2008-01-08 A. M. Abd Elfattah , O. Mohamed Marwa