English
Related papers

Related papers: A Generalized Notion of Completeness and Its Appli…

200 papers

Many works in statistics aim at designing a universal estimation procedure, that is, an estimator that would converge to the best approximation of the (unknown) data generating distribution in a model, without any assumption on this…

Statistics Theory · Mathematics 2025-02-14 Badr-Eddine Chérief-Abdellatif , Pierre Alquier

Calibration of mean estimates for predictions is a crucial property in many applications, particularly in the fields of financial and actuarial decision-making. In this paper, we first review classical approaches for validating…

Applications · Statistics 2025-10-29 Łukasz Delong , Mario Wüthrich

Density-power-based divergences are known to provide robust inference procedures against outliers, and their extensions have been widely studied. A characteristic of successful divergences is that the estimation problem can be reduced to…

Information Theory · Computer Science 2025-02-03 Masahiro Kobayashi

Many generic results have been proved, especially concerning the qualitative behaviour of solutions of partial differential equations. Recently, a new notion of "almost always", the prevalence, has been developped for vectorial spaces. This…

Analysis of PDEs · Mathematics 2009-11-13 Romain Joly

This thesis develops a new divergence that generalizes relative entropy and can be used to compare probability measures without a requirement of absolute continuity. We establish properties of the divergence, and in particular derive and…

Probability · Mathematics 2020-11-18 Yixiang Mao

Recent literature in the last Maximum Entropy workshop introduced an analogy between cumulative probability distributions and normalized utility functions. Based on this analogy, a utility density function can de defined as the derivative…

Artificial Intelligence · Computer Science 2009-11-10 Ali E. Abbas

The notion of utility maximising entropy (u-entropy) of a probability density, which was introduced and studied by Slomczynski and Zastawniak (Ann. Prob 32 (2004) 2261-2285, arXiv:math.PR/0410115 v1), is extended in two directions. First,…

Probability · Mathematics 2008-12-02 Grzegorz Harańczyk , Wojciech Słomczyński , Tomasz Zastawniak

Missing data theory deals with the statistical methods in the occurrence of missing data. Missing data occurs when some values are not stored or observed for variables of interest. However, most of the statistical theory assumes that data…

The law of likelihood underlies a general framework, known as the likelihood paradigm, for representing and interpreting statistical evidence. As stated, the law applies only to simple hypotheses, and there have been reservations about…

Statistics Theory · Mathematics 2009-01-06 Zhiwei Zhang

Recent work has focused on the problem of nonparametric estimation of information divergence functionals. Many existing approaches are restrictive in their assumptions on the density support set or require difficult calculations at the…

Information Theory · Computer Science 2021-07-30 Kevin R. Moon , Kumar Sricharan , Kristjan Greenewald , Alfred O. Hero

For nearly any challenging scientific problem evaluation of the likelihood is problematic if not impossible. Approximate Bayesian computation (ABC) allows us to employ the whole Bayesian formalism to problems where we can use simulations…

Computation · Statistics 2011-07-04 Chris Barnes , Sarah Filippi , Michael P. H. Stumpf , Thomas Thorne

Exponential families form the backbone of modern statistics and machine learning, but textbooks seldom derive them from first principles in an accessible way. Although minimal sufficiency and the principle of maximum entropy, originating in…

Methodology · Statistics 2026-04-27 Korbinian Strimmer

Many current applications in data science need rich model classes to adequately represent the statistics that may be driving the observations. But rich model classes may be too complex to admit estimators that converge to the truth with…

Information Theory · Computer Science 2022-05-04 N. Santhanam , V. Anantharam , W. Szpankowski

The log-normal distribution is one of the most common distributions used for modeling skewed and positive data. It frequently arises in many disciplines of science, specially in the biological and medical sciences. The statistical analysis…

Methodology · Statistics 2020-01-01 Ayanendranath Basu , Abhijit Mandal , Nirian Martin , Leandro Pardo

A stream of algorithmic advances has steadily increased the popularity of the Bayesian approach as an inference paradigm, both from the theoretical and applied perspective. Even with apparent successes in numerous application fields, a…

Methodology · Statistics 2020-07-10 Owen Thomas , Henri Pesonen , Jukka Corander

In this paper a robust version of the classical Wald test statistics for linear hypothesis in the logistic regression model is introduced and its properties are explored. We study the problem under the assumption of random covariates…

Statistics Theory · Mathematics 2019-05-09 Ayandrendanath Basu , Abhik Ghosh , Abhijit Mandal , Nirian Martin , Leandro Pardo

In Bayesian statistics probability distributions express beliefs. However, for many problems the beliefs cannot be computed analytically and approximations of beliefs are needed. We seek a loss function that quantifies how "embarrassing" it…

Statistics Theory · Mathematics 2017-08-07 Reimar H. Leike , Torsten A. Enßlin

This paper presents new families of Rao-type test statistics based on the minimum density power divergence estimators which provide robust generalizations for testing simple and composite null hypotheses. The asymptotic null distributions…

Methodology · Statistics 2019-08-27 Ayanendranath Basu , Abhik Ghosh , Nirian Martin , Leandro Pardo

Statistical modeling of rainfall data is an active research area in agro-meteorology. The most common models fitted to such datasets are exponential, gamma, log-normal, and Weibull distributions. As an alternative to some of these models,…

Methodology · Statistics 2024-02-08 Arnab Hazra

We propose a novel approach for density estimation with exponential families for the case when the true density may not fall within the chosen family. Our approach augments the sufficient statistics with features designed to accumulate…

Machine Learning · Statistics 2012-09-07 Lin Yuan , Sergey Kirshner , Robert Givan