English
Related papers

Related papers: Characterization of Generalized Alpha-Beta Diverge…

200 papers

Mixture distributions arise in many parametric and non-parametric settings -- for example, in Gaussian mixture models and in non-parametric estimation. It is often necessary to compute the entropy of a mixture, but, in most cases, this…

Information Theory · Computer Science 2022-11-22 Artemy Kolchinsky , Brendan D. Tracey

The purpose of this paper is twofold. On a technical side, we propose an extension of the Hausdorff distance from metric spaces to spaces equipped with asymmetric distance measures. Specifically, we focus on the family of Bregman…

Machine Learning · Computer Science 2025-04-11 Tuyen Pham , Hana Dal Poz Kouřimská , Hubert Wagner

We study the rates of convergence of the posterior distribution for Bayesian density estimation with Dirichlet mixtures of normal distributions as the prior. The true density is assumed to be twice continuously differentiable. The bandwidth…

Statistics Theory · Mathematics 2009-09-29 Subhashis Ghosal , Aad van der Vaart

For infinite measure-theoretic entropy systems, we introduce the notion of measure-theoretic metric mean dimension of invariant measures for different types of measure-theoretic $\epsilon$-entropies, and show that measure-theoretic metric…

Dynamical Systems · Mathematics 2024-09-04 Rui Yang , Ercai Chen , Xiaoyao Zhou

Compact expressions for the average subentropy and coherence are obtained for random mixed states that are generated via various probability measures. Surprisingly, our results show that the average subentropy of random mixed states…

Quantum Physics · Physics 2017-02-08 Lin Zhang , Uttam Singh , Arun Kumar Pati

In this paper, we propose a general framework to learn a robust large-margin binary classifier when corrupt measurements, called anomalies, caused by sensor failure might be present in the training set. The goal is to minimize the…

Machine Learning · Computer Science 2016-11-17 Tianpei Xie , Nasser M. Nasrabadi , Alfred O. Hero

This work introduces a complexity measure which addresses some conflicting issues between existing ones by using a new principle - measuring the average amount of symmetry broken by an object. It attributes low (although different)…

Statistical Mechanics · Physics 2015-03-26 Roberto C. Alamino

Coherence measures and their operational interpretations lay the cornerstone of coherence theory. In this paper, we introduce a class of coherence measures with $\alpha$-affinity, say $\alpha$-affinity of coherence for $\alpha \in (0, 1)$.…

Quantum Physics · Physics 2018-09-24 Chunhe Xiong , Asutosh Kumar , Junde Wu

We give a substitute to Feller property for semigroups of time-changed processes; under some conditions this leads to establish sufficient (new) conditions for the semigroups to be Feller. Moreover, given a standard process and a sequence…

Probability · Mathematics 2025-10-16 Ali BenAmor , Kazuhiro Kuwae

Entropy is a measure of heterogeneity widely used in applied sciences, often when data are collected over space. Recently, a number of approaches has been proposed to include spatial information in entropy. The aim of entropy is to…

Statistics Theory · Mathematics 2019-11-12 Linda Altieri , Daniela Cocchi , Giulia Roli

This paper considers estimation of the predictive density for a normal linear model with unknown variance under alpha-divergence loss for -1 <= alpha <= 1. We first give a general canonical form for the problem, and then give general…

Statistics Theory · Mathematics 2013-03-12 Yuzo Maruyama , William E. Strawderman

A new upper bound on the relative entropy is derived as a function of the total variation distance for probability measures defined on a common finite alphabet. The bound improves a previously reported bound by Csisz\'ar and Talata. It is…

Information Theory · Computer Science 2015-10-20 Igal Sason , Sergio Verdu

In this paper we propose the use of $\phi$-divergences as test statistics to verify simple hypotheses about a one-dimensional parametric diffusion process $\de X_t = b(X_t, \theta)\de t + \sigma(X_t, \theta)\de W_t$, from discrete…

Statistics Theory · Mathematics 2008-08-22 Alessandro De Gregorio , Stefano Iacus

The mathematical properties of a family of generalized beta distribution, including beta-normal, skewed-t, log-F, beta-exponential, beta-Weibull distributions have recently been studied in several publications. This paper applies these…

Methodology · Statistics 2007-10-26 J. H. Sepanski , Lingji Kong

A one-to-one correspondence is drawn between law invariant risk measures and divergences, which we define as functionals of pairs of probability measures on arbitrary standard Borel spaces satisfying a few natural properties. Divergences…

Risk Management · Quantitative Finance 2016-06-07 Daniel Lacker

We introduce estimation and test procedures through divergence optimization for discrete or continuous parametric models. This approach is based on a new dual representation for divergences. We treat point estimation and tests for simple…

Statistics Theory · Mathematics 2008-12-02 Michel Broniatowski , Amor Keziou

It is perhaps not widely recognized that certain common notions of distance between probability measures have an alternative dual interpretation which compares corresponding functionals against suitable families of test functions. This dual…

Systems and Control · Computer Science 2014-09-16 Lipeng Ning , Tryphon T. Georgiou

Traditional likelihood based methods for parameter estimation get highly affected when the given data is contaminated by outliers even in a small proportion. In this paper, we consider a robust parameter estimation method, namely the…

Statistics Theory · Mathematics 2025-10-16 Himanshi Singh , Abhik Ghosh , Nil Kamal Hazra

This paper deals with four types of point estimators based on minimization of information-theoretic divergences between hypothetical and empirical distributions. These were introduced (i) by Liese & Vajda (2006) and independently…

Statistics Theory · Mathematics 2009-11-06 Michel Broniatowski , Igor Vajda

The non-elementary integrals involving elementary exponential, hyperbolic and trigonometric functions, $ \int x^\alpha e^{\eta x^\beta}dx, \int x^\alpha \cosh\left(\eta x^\beta\right)dx, \int x^\alpha \sinh\left(\eta x^\beta\right)dx, \int…

General Mathematics · Mathematics 2020-07-13 Victor Nijimbere