English
Related papers

Related papers: A Generalized Notion of Completeness and Its Appli…

200 papers

The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible constrained to match empirical data, for instance, feature expectations. We seek to generalize…

Information Theory · Computer Science 2022-05-30 Kenneth Bogert

We present new results for consistency of maximum likelihood estimators with a focus on multivariate mixed models. Our theory builds on the idea of using subsets of the full data to establish consistency of estimators based on the full…

Statistics Theory · Mathematics 2019-02-13 Karl Oskar Ekvall , Galin L. Jones

Robust statistics traditionally focuses on outliers, or perturbations in total variation distance. However, a dataset could be corrupted in many other ways, such as systematic measurement errors and missing covariates. We generalize the…

Statistics Theory · Mathematics 2020-12-15 Banghua Zhu , Jiantao Jiao , Jacob Steinhardt

In any parametric inference problem, the robustness of the procedure is a real concern. A procedure which retains a high degree of efficiency under the model and simultaneously provides stable inference under data contamination is…

Methodology · Statistics 2020-01-01 Ayanendranath Basu , Abhijit Mandal , Nirian Martin , Leandro Pardo

In this paper we introduce the notion of Demand-Weighted Completeness, allowing estimation of the completeness of a knowledge base with respect to how it is used. Defining an entity by its classes, we employ usage data to predict the…

Artificial Intelligence · Computer Science 2018-05-01 Andrew Hopkinson , Amit Gurdasani , Dave Palfrey , Arpit Mittal

In a regular full exponential family, the maximum likelihood estimator (MLE) need not exist in the traditional sense. However, the MLE may exist in the completion of the exponential family. Existing algorithms for finding the MLE in the…

Statistics Theory · Mathematics 2020-11-30 Daniel J. Eck , Charles J. Geyer

In this paper, we revisit the classical goodness-of-fit problems for univariate distributions; we propose a new testing procedure based on a characterisation of the uniform distribution. Asymptotic theory for the simple hypothesis case is…

Methodology · Statistics 2021-08-17 Bruno Ebner , Shawn Liebenberg , Jaco Visagie

An estimation problem of fundamental interest is that of phase synchronization, in which the goal is to recover a collection of phases using noisy measurements of relative phases. It is known that in the Gaussian noise setting, the maximum…

Optimization and Control · Mathematics 2016-11-02 Huikang Liu , Man-Chung Yue , Anthony Man-Cho So

Robust inferential methods based on divergences measures have shown an appealing trade-off between efficiency and robustness in many different statistical models. In this paper, minimum density power divergence estimators (MDPDEs) for the…

Statistics Theory · Mathematics 2023-12-06 A. Felipe , M. Jaenada , P. Miranda , L. Pardo

Consider the supervised learning setting where the goal is to learn to predict labels $\mathbf y$ given points $\mathbf x$ from a distribution. An \textit{omnipredictor} for a class $\mathcal L$ of loss functions and a class $\mathcal C$ of…

Machine Learning · Computer Science 2024-01-29 Parikshit Gopalan , Princewill Okoroafor , Prasad Raghavendra , Abhishek Shetty , Mihir Singhal

In this paper a new family of minimum divergence estimators based on the Bregman divergence is proposed. The popular density power divergence (DPD) class of estimators is a sub-class of Bregman divergences. We propose and study a new…

Statistics Theory · Mathematics 2020-08-18 Soumik Purkayastha , Ayanendranath Basu

The lack-of-fit statistical reduction, developed and formulated first by Bruce Turkington, is a general method taking Liouville equation for probability density (detailed level) and transforming it to reduced dynamics of projected…

Statistical Mechanics · Physics 2020-04-01 Michal Pavelka , Vaclav Klika , Miroslav Grmela

Health data are often not symmetric to be adequately modeled through the usual normal distributions; most of them exhibit skewed patterns. They can indeed be modeled better through the larger family of skew-normal distributions covering…

Applications · Statistics 2019-09-24 Amarnath Nandy , Ayanendranath Basu , Abhik Ghosh

Existing two-sample testing techniques, particularly those based on choosing a kernel for the Maximum Mean Discrepancy (MMD), often assume equal sample sizes from the two distributions. Applying these methods in practice can require…

Machine Learning · Statistics 2025-12-17 Aaron Wei , Milad Jalali , Danica J. Sutherland

The notion of relative universality with respect to a {\sigma}-field was introduced to establish the unbiasedness and Fisher consistency of an estimator in nonlinear sufficient dimension reduction. However, there is a gap in the proof of…

Statistics Theory · Mathematics 2025-04-16 Bing Li , Ben Jones , Andreas Artemiou

The property of perfectness plays an important role in the theory of Bayesian networks. First, the existence of perfect distributions for arbitrary sets of variables and directed acyclic graphs implies that various methods for reading…

Artificial Intelligence · Computer Science 2012-12-12 Christopher Meek , David Maxwell Chickering

A guiding principle for data reduction in statistical inference is the sufficiency principle. This paper extends the classical sufficiency principle to decentralized inference, i.e., data reduction needs to be achieved in a decentralized…

Information Theory · Computer Science 2015-06-16 Ge Xu , Shengyu Zhu , Biao Chen

In this article we generalize the classical Edgeworth expansion for the probability density function (PDF) of sums of a finite number of symmetric independent identically distributed random variables with a finite variance to sums of…

Statistical Mechanics · Physics 2015-05-20 Netanel Hazut , Shlomi Medalion , David A. Kessler , Eli Barkai

The theory of the basic statistical concept of (Lehmann-Scheff\'e-)completeness is perfected by providing the theorem indicated in the title and previously overlooked for several decades. Relations to earlier results are discussed and…

Statistics Theory · Mathematics 2014-05-26 Abram M. Kagan , Yaakov Malinovsky , Lutz Mattner

By making use of the familiar Mathieu series and its generalizations, the authors derive a number of new integral representations and present a systematic study of probability density functions and probability distributions associated with…

Classical Analysis and ODEs · Mathematics 2016-10-19 Zivorad Tomovski , Khaled Mehrez