English
Related papers

Related papers: Testing Exponentiality Based on R\'enyi Entropy Wi…

200 papers

Quantum information measures such as the entropy and the mutual information find applications in physics, e.g., as correlation measures. Generalizing such measures based on the R\'enyi entropies is expected to enhance their scope in…

Quantum Physics · Physics 2015-04-10 Mario Berta , Kaushik P. Seshadreesan , Mark M. Wilde

The matrix-based R\'enyi's entropy allows us to directly quantify information measures from given data, without explicit estimation of the underlying probability distribution. This intriguing property makes it widely applied in statistical…

Machine Learning · Computer Science 2022-12-01 Yuxin Dong , Tieliang Gong , Shujian Yu , Hong Chen , Chen Li

Many axiomatic definitions of entropy, such as the R\'enyi entropy, of a random variable are closely related to the $\ell_{\alpha}$-norm of its probability distribution. This study considers probability distributions on finite sets, and…

Information Theory · Computer Science 2016-05-06 Yuta Sakai , Ken-ichi Iwata

The R\'enyi information measures are characterized in terms of their Shannon counterparts, and properties of the former are recovered from first principle via the associated properties of the latter. Motivated by this characterization, a…

Information Theory · Computer Science 2016-03-14 Ofer Shayevitz

In this article, we consider statistical inference based on dependent competing risks data from Marshall-Olkin bivariate Weibull distribution. The maximum likelihood estimates of the unknown model parameters have been computed by using the…

Methodology · Statistics 2023-04-20 Subhankar Dutta , Suchandan Kayal

Based on independent progressively Type-II censored samples from two-parameter Rayleigh distributions with the same location parameter but different scale parameters, the UMVUE and maximum likelihood estimator of $R=P(Y<X)$ are obtained.…

Applications · Statistics 2017-09-05 Akram Kohansal , Saeid Rezakhah

We propose R\'enyi information generating function and discuss its properties. A connection between the R\'enyi information generating function and the diversity index is proposed for discrete type random variables. The relation between the…

Statistics Theory · Mathematics 2025-02-25 Shital Saha , Suchandan Kayal , N. Balakrishnan

Conventional information-theoretic quantities assume access to probability distributions. Estimating such distributions is not trivial. Here, we consider function-based formulations of cross entropy that sidesteps this a priori estimation…

Information Theory · Computer Science 2021-09-27 Isaac J. Sledge , Jose C. Principe

We leverage the Gibbs inequality and its natural generalization to R\'enyi entropies to derive closed-form parametric expressions of the optimal lower bounds of $\rho$th-order guessing entropy (guessing moment) of a secret taking values on…

Information Theory · Computer Science 2024-01-31 Julien Béguinot , Olivier Rioul

A hybrid censoring scheme is a mixture of Type-I and Type-II censoring schemes. We study the estimation of parameters of weighted exponential distribution based on Type-II hybrid censored data. By applying EM algorithm, maximum likelihood…

Statistics Theory · Mathematics 2012-03-02 Akram Kohansal , Saeid Rezakhah

We introduce a variant of the R\'enyi entropy definition that aligns it with the well-known H\"older mean: in the new formulation, the r-th order R\'enyi Entropy is the logarithm of the inverse of the r-th order H\"older mean. This brings…

Information Theory · Computer Science 2018-11-16 Francisco José Valverde-Albacete , Carmen Peláez-Moreno

Ranked set sampling is a sampling design which has a wide range of applications in industrial statistics, and environmental and ecological studies, etc.. It is well known that ranked set samples provide more Fisher information than simple…

Statistics Theory · Mathematics 2013-01-21 Mohammad Jafari Jozani , Jafar Ahmadi

We compute R\'enyi entropies for the statistics of a noisy simultaneous observation of two complementary observables in two-dimensional quantum systems. The relative amount of uncertainty between two states depends on the uncertainty…

Quantum Physics · Physics 2015-11-17 Alfredo Luis , Gustavo Martín Bosyk , Mariela Portesi

Progressive censoring scheme has received considerable attention in recent years. In this paper we introduce a new type-II progressive censoring scheme for two samples. It is observed that the proposed censoring scheme is analytically more…

Methodology · Statistics 2016-09-20 Shuvashree Mondal , Debasis Kundu

This paper considers an information bottleneck problem with the objective of obtaining a most informative representation of a hidden feature subject to a R\'enyi entropy complexity constraint. The optimal bottleneck trade-off between…

Information Theory · Computer Science 2021-02-01 Jian-Jia Weng , Fady Alajaji , Tamás Linder

Inferential challenges that arise when data are censored have been extensively studied under the classical frameworks. In this paper, we provide an alternative generalized inferential model approach whose output is a data-dependent…

Methodology · Statistics 2021-11-16 Joyce Cahoon , Ryan Martin

The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…

Information Theory · Computer Science 2017-05-01 Maciej Skorski

In this paper, a competing risks model is analyzed based on improved adaptive type-II progressive censored sample (IAT-II PCS). Two independent competing causes of failures are considered. It is assumed that lifetimes of the competing…

Methodology · Statistics 2023-02-20 Subhankar Dutta , Suchandan Kayal

The entropy accumulation theorem, and its subsequent generalized version, is a powerful tool in the security analysis of many device-dependent and device-independent cryptography protocols. However, it has the drawback that the finite-size…

Quantum Physics · Physics 2025-12-22 Amir Arqand , Thomas A. Hahn , Ernest Y. -Z. Tan

We develop a new goodness fit test for Rayleigh distribution for complete as well as right censored data. We use U-Statistic theory to derive the test statistic. First we develop a test for complete data and then discuss, how right censored…

Methodology · Statistics 2022-08-19 Vaisakh K. M. , Thomas Xavier , Sreedevi E. P