English
Related papers

Related papers: Extropy-Based Generalized Divergence and Similarit…

200 papers

We study the continuity property of the generalized entropy as a function of the underlying probability distribution, defined with an action space and a loss function, and use this property to answer the basic questions in statistical…

Machine Learning · Computer Science 2022-01-04 Aolin Xu

We propose generalized resubstitution error estimators for regression, a broad family of estimators, each corresponding to a choice of empirical probability measures and loss function. The usual sum of squares criterion is a special case…

Machine Learning · Computer Science 2024-10-24 Diego Marcondes , Ulisses Braga-Neto

Probability metrics have become an indispensable part of modern statistics and machine learning, and they play a quintessential role in various applications, including statistical hypothesis testing and generative modeling. However, in a…

Machine Learning · Statistics 2020-03-02 Soheil Kolouri , Kimia Nadjahi , Umut Simsekli , Shahin Shahrampour

The extropy measure, first proposed by Lad, Sanfilippo, and Agro in their (2015) paper in Statistical Science, has attracted considerable attention in recent years. Our study introduces a fresh approach to representing weighted extropy in…

Statistics Theory · Mathematics 2024-05-21 Pradeep Kumar Sahu , Nitin Gupta

The cumulative residual extropy (CRJ) is a measure of uncertainty that serves as an alternative to extropy. It replaces the probability density function with the survival function in the expression of extropy. This work introduces a new…

Methodology · Statistics 2024-07-17 Gaurav Kandpal , Nitin Gupta

Minimum divergence estimators provide a natural choice of estimators in a statistical inference problem. Different properties of various families of these divergence measures such as Hellinger distance, power divergence, density power…

Statistics Theory · Mathematics 2025-07-08 Subhrajyoty Roy , Supratik Basu , Abhik Ghosh , Ayanendranath Basu

A class of discrete probability distributions contains distributions with limited support, i.e. possible argument values are limited to a set of numbers (typically consecutive). Examples of such data are results from subjective experiments…

Methodology · Statistics 2019-09-11 Lucjan Janowski , Bogdan Ćmiel , Krzysztof Rusek , Jakub Nawała , Zhi Li

Extropy, a complementary dual of entropy, (proposed by Lad et al. \cite{lad2015extropy} in 2015) has attracted considerable interest from the research community. In this study, we focus on discrete random variables and define conditional…

Information Theory · Computer Science 2025-07-16 Naveen Kumar , Vivek Vijay

Precision and Recall are two prominent metrics of generative performance, which were proposed to separately measure the fidelity and diversity of generative models. Given their central role in comparing and improving generative models,…

Machine Learning · Computer Science 2023-07-20 Mahyar Khayatkhoei , Wael AbdAlmageed

Extropy and its properties are explored to quantify the uncertainty. In this paper, we obtain alternative expressions for cumulative residual extropy and negative cumulative extropy. We obtain simple estimators of cumulative (residual)…

Methodology · Statistics 2021-08-23 Sudheesh K. K. , Sreedevi E. P

In this work, we propose extropy measures based on density copula, distributional copula, and survival copula, and explore their properties. We study the effect of monotone transformations for the proposed measures and obtain bounds. We…

Statistics Theory · Mathematics 2024-06-04 Shital Saha , Suchandan Kayal

Given finite-dimensional random vectors $Y$, $X$, and $Z$ that form a Markov chain in that order (i.e., $Y \to X \to Z$), we derive upper bounds on the excess minimum risk using generalized information divergence measures. Here, $Y$ is a…

Information Theory · Computer Science 2025-06-02 Ananya Omanwar , Fady Alajaji , Tamás Linder

The ratio of two probability densities, called a density-ratio, is a vital quantity in machine learning. In particular, a relative density-ratio, which is a bounded extension of the density-ratio, has received much attention due to its…

Machine Learning · Statistics 2021-07-05 Atsutoshi Kumagai , Tomoharu Iwata , Yasuhiro Fujiwara

Generalized extreme value (GEV) regression is often more adapted when we investigate a relationship between a binary response variable $Y$ which represents a rare event and potentiel predictors $\mathbf{X}$. In particular, we use the…

Methodology · Statistics 2021-05-04 Aba Diop , El Hadji Deme

In this paper, we develop a relative cumulative residual information measure (RCRI) that aims to quantify the divergence between two survival functions. The dynamic relative cumulative residual information (DRCRI) measure is also…

Methodology · Statistics 2025-12-12 Mary Andrews , Smitha S , Sudheesh K. Kattumannil

We study convergence rates of variational posterior distributions for nonparametric and high-dimensional inference. We formulate general conditions on prior, likelihood, and variational class that characterize the convergence rates. Under…

Statistics Theory · Mathematics 2019-06-18 Fengshuo Zhang , Chao Gao

Recently Qiu et al. (2017) have introduced residual extropy as measure of uncertainty in residual lifetime distributions analogues to residual entropy (1996). Also, they obtained some properties and applications of that. In this paper, we…

Statistics Theory · Mathematics 2020-09-07 Osman Kamari , Francesco Buono

This thesis develops a new divergence that generalizes relative entropy and can be used to compare probability measures without a requirement of absolute continuity. We establish properties of the divergence, and in particular derive and…

Probability · Mathematics 2020-11-18 Yixiang Mao

We present the Shortfall Deviation Risk (SDR), a risk measure that represents the expected loss that occurs with certain probability penalized by the dispersion of results that are worse than such an expectation. SDR combines Expected…

Risk Management · Quantitative Finance 2020-08-04 Marcelo Brutti Righi , Paulo Sergio Ceretta

There are three classical divergence measures exist in the literature on information theory and statistics. These are namely, Jeffryes-Kullback-Leiber J-divergence. Sibson-Burbea-Rao Jensen-Shannon divegernce and Taneja Arithmetic-Geometric…

Information Theory · Computer Science 2011-04-01 Inder Jeet Taneja