English
Related papers

Related papers: Dual $\phi$-divergences estimation in normal model…

200 papers

A new family of minimum distance estimators for binary logistic regression models based on $\phi$-divergence measures is introduced. The so called "pseudo minimum phi-divergence estimator"(PM$\phi$E) family is presented as an extension of…

Methodology · Statistics 2016-11-09 Elena Castilla , Nirian Martin , Leandro Pardo

Analyzing polytomous response from a complex survey scheme, like stratified or cluster sampling is very crucial in several socio-economics applications. We present a class of minimum quasi weighted density power divergence estimators for…

Methodology · Statistics 2019-04-05 Elena Castilla , Abhik Ghosh , Nirian Martin , Leandro Pardo

Difference-in-differences (DID) is a widely used approach for drawing causal inference from observational panel data. Two common estimation strategies for DID are outcome regression and propensity score weighting. In this paper, motivated…

Applications · Statistics 2021-01-05 Fan Li , Fan Li

Adequacy for estimation between an inferential method and a model can be de{\ldots}ned through two main requirements: {\ldots}rstly the inferential tool should de{\ldots}ne a well posed problem when applied to the model; secondly the…

Statistics Theory · Mathematics 2025-07-30 Michel Broniatowski , Justin Moutsouka

The doubly robust (DR) estimator, which consists of two nuisance parameters, the conditional mean outcome and the logging policy (the probability of choosing an action), is crucial in causal inference. This paper proposes a DR estimator for…

Machine Learning · Computer Science 2021-06-22 Masahiro Kato , Shota Yasui , Kenichiro McAlinn

In this note we prove the dual representation formula of the divergence between two distributions in a parametric model. Resulting estimators for the divergence as for the parameter are derived. These estimators do not make use of any…

Methodology · Statistics 2011-08-23 Michel Broniatowski

The paper investigates the robust optimized certainty equivalents and analyzes the relevant properties of them as risk measures for loss positions with distribution uncertainty. On this basis, the robust generalized quantiles are proposed…

Risk Management · Quantitative Finance 2023-04-11 Weiwei Li , Dejian Tian

Robust estimation under Huber's $\epsilon$-contamination model has become an important topic in statistics and theoretical computer science. Statistically optimal procedures such as Tukey's median and other estimators based on depth…

Machine Learning · Statistics 2019-02-27 Chao Gao , Jiyi Liu , Yuan Yao , Weizhi Zhu

Doubly robust estimators combine an inverse probability weighting estimator and a mass imputation estimator. Several doubly robust estimators for estimating the population mean (or prevalence) of an outcome have been proposed for…

Methodology · Statistics 2025-08-11 Shaun R Seaman , Tommy Nyberg , Anne M Presanis

A useful sampling-reconstruction model should be stable with respect to different kind of small perturbations, regardless whether they result from jitter, measurement errors, or simply from a small change in the model assumptions. In this…

General Mathematics · Mathematics 2007-05-31 E. costa-Reyes , A. Aldroubi , I. Krishtal

We develop and analyze $M$-estimation methods for divergence functionals and the likelihood ratios of two probability distributions. Our method is based on a non-asymptotic variational characterization of $f$-divergences, which allows the…

Statistics Theory · Mathematics 2016-11-18 XuanLong Nguyen , Martin J. Wainwright , Michael I. Jordan

We consider the problem of estimating covariance and precision matrices, and their associated discriminant coefficients, from normal data when the rank of the covariance matrix is strictly smaller than its dimension and the available sample…

Statistics Theory · Mathematics 2015-09-09 Didier Chételat , Martin T. Wells

The doubly-robust (DR) estimator is popular for evaluating causal effects in observational studies and is often perceived as more desirable than inverse probability weighting (IPW) or outcome modeling alone because it provides extra…

Methodology · Statistics 2026-02-03 Chengxin Yang , Laine E. Thomas , Fan Li

M-estimators for Generalized Linear Models are considered under minimal assumptions. Under these preliminaries, strong convergence of the estimators are discussed and an expansion of the estimating operators are given in the non-i.i.d. case…

Statistics Theory · Mathematics 2021-10-26 K. P. Chowdhury

We observe a $n$-sample, the distribution of which is assumed to belong, or at least to be close enough, to a given mixture model. We propose an estimator of this distribution that belongs to our model and possesses some robustness…

Statistics Theory · Mathematics 2025-02-06 Alexandre Lecestre

Distribution shifts are ubiquitous in real-world machine learning applications, posing a challenge to the generalization of models trained on one data distribution to another. We focus on scenarios where data distributions vary across…

Machine Learning · Statistics 2024-06-05 Steven Wilkins-Reeves , Xu Chen , Qi Ma , Christine Agarwal , Aude Hofleitner

In this paper we show that there is a link between approximate Bayesian methods and prior robustness. We show that what is typically recognized as an approximation to the likelihood, either due to the simulated data as in the Approximate…

Methodology · Statistics 2020-04-03 Chaitanya Joshi , Fabrizio Ruggeri

Reparameterization (RP) and likelihood ratio (LR) gradient estimators are used to estimate gradients of expectations throughout machine learning and reinforcement learning; however, they are usually explained as simple mathematical tricks,…

Machine Learning · Computer Science 2021-06-01 Paavo Parmas , Masashi Sugiyama

Due to concerns about parametric model misspecification, there is interest in using machine learning to adjust for confounding when evaluating the causal effect of an exposure on an outcome. Unfortunately, exposure effect estimators that…

Methodology · Statistics 2025-01-08 Oliver Dukes , Stijn Vansteelandt , David Whitney

Many real-life data sets can be analyzed using Linear Mixed Models (LMMs). Since these are ordinarily based on normality assumptions, under small deviations from the model the inference can be highly unstable when the associated parameters…

Methodology · Statistics 2024-02-06 Giovanni Saraceno , Abhik Ghosh , Ayanendranath Basu , Claudio Agostinelli