Related papers: Computing the Kullback-Leibler Divergence between …
This paper proposes a new family of lower and upper bounds on the minimum mean squared error (MMSE). The key idea is to minimize/maximize the MMSE subject to the constraint that the joint distribution of the input-output statistics lies in…
In this paper, we introduce a bivariate exponentaited generalized Weibull-Gompertz distribution. The model introduced here is of Marshall-Olkin type. Several properties are studied such as bivariate probability density function and it is…
The Weibull distribution is a very applicable model for the lifetime data. In this paper, we have investigated inference on the parameters of Weibull distribution based on record values. We first propose a simple and exact test and a…
We define a new measure of causation from a fluctuation-response theorem for Kullback-Leibler divergences, based on the information-theoretic cost of perturbations. This information response has both the invariance properties required for…
The beta Weibull distribution was introduced by Famoye et al. (2005) and studied by these authors. However, they do not give explicit expressions for the moments. We now derive explicit closed form expressions for the cumulative…
In this work, we address modal parameter fluctuations in statistical distributions describing charge-to-breakdown $(Q_{BD})$ and/or time-to-breakdown $(t_{BD})$ during the dielectric breakdown regime of ultra-thin oxides, which are of high…
Modeling is a challenging topic and using parametric models is an important stage to reach flexible function for modeling. Weibull distribution has two parameters which are shape $\alpha$ and scale $\beta$. In this study, bimodality…
The Chernoff information between two probability measures is a statistical divergence measuring their deviation defined as their maximally skewed Bhattacharyya distance. Although the Chernoff information was originally introduced for…
We propose a closed-form spectral framework for relative log-density estimation in linearly parameterized probabilistic models, including unnormalized and conditional models. This is achieved by representing the Kullback-Leibler (KL)…
The mathematical properties of a family of generalized beta distribution, including beta-normal, skewed-t, log-F, beta-exponential, beta-Weibull distributions have recently been studied in several publications. This paper applies these…
In this paper, we propose a reduced version of the new modified Weibull (NMW) distribution due to Almalki and Yuan \cite{meNMW} in order to avoid some estimation problems. The number of parameters in the NMW distribution is five. The number…
The Weibull--like distributions form a large class of probability distributions that belong to the domain of attraction for the maxima of the Gumbel law. Besides the Weibull distribution, it includes important distributions as the Gamma…
Estimating the Kullback--Leibler (KL) divergence between language models has many applications, e.g., reinforcement learning from human feedback (RLHF), interpretability, and knowledge distillation. However, computing the exact KL…
The autodependogram is a graphical device recently proposed in the literature to analyze autodependencies. It is defined computing the classical Pearson chi-square statistics of independence at various lags in order to point out the…
R\'enyi divergence is related to R\'enyi entropy much like Kullback-Leibler divergence is related to Shannon's entropy, and comes up in many settings. It was introduced by R\'enyi as a measure of information that satisfies almost the same…
Based on suitable left-truncated or censored data, two flexible classes of $M$-estimations of Weibull tail coefficient are proposed with two additional parameters bounding the impact of extreme contamination. Asymptotic normality with…
This paper introduces a polynomial transformation model based on Weibull distribution, whereby the analytical representation of the quantile function for many probability distributions can be obtained. Firstly, the target random variable…
We propose a novel probabilistic approach to multilevel clustering problems based on composite transportation distance, which is a variant of transportation distance where the underlying metric is Kullback-Leibler divergence. Our method…
The non-parametric version of Amari's dually affine Information Geometry provides a practical calculus to perform computations of interest in statistical machine learning. The method uses the notion of a statistical bundle, a mathematical…
It has been argued persuasively that, in order to evaluate climate models, the probability distributions of model output need to be compared to the corresponding empirical distributions of observed data. Distance measures between…