English
Related papers

Related papers: Multivariate dual to ratio type estimators using a…

200 papers

Standard practice obtains an unbiased variance estimator by dividing by $N-1$ rather than $N$. Yet if only half the data are used to compute the mean, dividing by $N$ can still yield an unbiased estimator. We show that an alternative mean…

Statistics Theory · Mathematics 2025-04-10 Dai Akita

We propose an improved estimator for the multi-task averaging problem, whose goal is the joint estimation of the means of multiple distributions using separate, independent data sets. The naive approach is to take the empirical mean of each…

Machine Learning · Statistics 2020-11-16 Hannah Marienwald , Jean-Baptiste Fermanian , Gilles Blanchard

Marginal model is a popular instrument for studying longitudinal data and cluster data. This paper investigates the estimator of marginal model with subgroup auxiliary information. To marginal model, we propose a new type of auxiliary…

Methodology · Statistics 2018-06-11 Jie He , Xiaogang Duan , Shumei Zhang , Hui Li

We demonstrate that a popular class of nonparametric mutual information (MI) estimators based on k-nearest-neighbor graphs requires number of samples that scales exponentially with the true MI. Consequently, accurate estimation of MI…

Information Theory · Computer Science 2015-03-09 Shuyang Gao , Greg Ver Steeg , Aram Galstyan

Multiple importance sampling estimators are widely used for computing intractable constants due to its reliability and robustness. The celebrated balance heuristic estimator belongs to this class of methods and has proved very successful in…

Computation · Statistics 2019-09-05 Felipe J Medina-Aguayo , Richard G Everitt

Expanding a lower-dimensional problem to a higher-dimensional space and then projecting back is often beneficial. This article rigorously investigates this perspective in the context of finite mixture models, namely how to improve inference…

Methodology · Statistics 2014-11-10 Andrea Mercatanti , Fan Li , Fabrizia Mealli

This paper aims to provide practitioners of causal mediation analysis with a better understanding of estimation options. We take as inputs two familiar strategies (weighting and model-based prediction) and a simple way of combining them…

The manuscript discusses how to incorporate random effects for quantile regression models for clustered data with focus on settings with many but small clusters. The paper has three contributions: (i) documenting that existing methods may…

Methodology · Statistics 2022-02-24 Maria Laura Battagliola , Helle Sørensen , Anders Tolver , Ana-Maria Staicu

We resurrect the infamous harmonic mean estimator for computing the marginal likelihood (Bayesian evidence) and solve its problematic large variance. The marginal likelihood is a key component of Bayesian model selection to evaluate model…

Multiple imputation (MI) is a popular method for handling missing data. Auxiliary variables can be added to the imputation model(s) to improve MI estimates. However, the choice of which auxiliary variables to include in the imputation model…

Statistical and structural modeling represent two distinct approaches to data analysis. In this paper, we propose a set of novel methods for combining statistical and structural models for improved prediction and causal inference. Our first…

Econometrics · Economics 2020-06-11 Jiaming Mao , Jingzhi Xu

The empirical Bayes estimators in mixed models are useful for small area estimation in the sense of increasing precision of prediction for small area means, and one wants to know the prediction errors of the empirical Bayes estimators based…

Methodology · Statistics 2016-04-07 Shonosuke Sugasawa , Tatsuya Kubokawa

A strong link between information geometry and algebraic statistics is made by investigating statistical manifolds which are algebraic varieties. In particular it it shown how first and second order efficient estimators can be constructed,…

Statistics Theory · Mathematics 2014-01-13 Kei Kobayashi , Henry P. Wynn

We present multivariate unbiased estimators for second, third, and fourth order cumulants $C_2(x,y)$, $C_3(x,y,z)$, and $C_4(x,y,z,w)$. Many relevant new estimators are derived for cases where some variables are average-free or pairs of…

Statistics Theory · Mathematics 2019-04-30 Fabian Schefczik , Daniel Hägele

We present simple differentially private estimators for the mean and covariance of multivariate sub-Gaussian data that are accurate at small sample sizes. We demonstrate the effectiveness of our algorithms both theoretically and empirically…

Machine Learning · Statistics 2026-02-10 Sourav Biswas , Yihe Dong , Gautam Kamath , Jonathan Ullman

Fields like public health, public policy, and social science often want to quantify the degree of dependence between variables whose relationships take on unknown functional forms. Typically, in fact, researchers in these fields are…

Statistics Theory · Mathematics 2019-12-10 Octavio César Mesner , Cosma Rohilla Shalizi

In this work, we propose two methods that utilize data symbols in addition to pilot symbols for improved channel estimation quality in a multi-user system, so-called semi-blind channel estimation. To this end, a subspace is estimated based…

Signal Processing · Electrical Eng. & Systems 2023-09-12 Franz Weißer , Nurettin Turan , Dominik Semmler , Wolfgang Utschick

We consider the problem of fitting a relationship (e.g. a potential scientific law) to data involving multiple variables. Ordinary (least squares) regression is not suitable for this because the estimated relationship will differ according…

Methodology · Statistics 2024-09-05 Chris Tofallis

Assume that several competing methods are available to estimate a parameter in a given statistical model. The aim of estimator averaging is to provide a new estimator, built as a linear combination of the initial estimators, that achieves…

Statistics Theory · Mathematics 2017-03-08 Frédéric Lavancier , P Rochet

The use of {\it Mathematica} in deriving mean likelihood estimators is discussed. Comparisons between the maximum likelihood estimator, the mean likelihood estimator and the Bayes estimate based on a Jeffrey's noninformative prior using the…

Statistics Theory · Mathematics 2016-11-04 Ian McLeod , Benoit Quenneville