English
Related papers

Related papers: Empirical and Constrained Empirical Bayes Variance…

200 papers

Several problems in statistics involve the combination of high-variance unbiased estimators with low-variance estimators that are only unbiased under strong assumptions. A notable example is the estimation of causal effects while combining…

Methodology · Statistics 2023-05-25 Michael Oberst , Alexander D'Amour , Minmin Chen , Yuyan Wang , David Sontag , Steve Yadlowsky

It has historically been a challenge to perform Bayesian inference in a design-based survey context. The present paper develops a Bayesian model for sampling inference in the presence of inverse-probability weights. We use a hierarchical…

Methodology · Statistics 2020-06-24 Yajuan Si , Natesh S. Pillai , Andrew Gelman

Bayesian neural networks (BNNs) provide a formalism to quantify and calibrate uncertainty in deep learning. Current inference approaches for BNNs often resort to few-sample estimation for scalability, which can harm predictive performance,…

Machine Learning · Computer Science 2024-02-14 Zhe Zeng , Guy Van den Broeck

In this study, variable acceptance sampling plans under Type I hybrid censoring is designed for a lot of independent and identical units with exponential lifetimes using Bayesian estimate of the parameter $\vartheta$. This approach is new…

Statistics Theory · Mathematics 2023-11-29 Ashlyn Maria Mathai , Mahesh Kumar

We consider Empirical Bayes (EB) estimation in the normal means problem, when the standard deviations of the observations are not known precisely, but estimated with error -- which is almost always the case in practical applications. In…

Methodology · Statistics 2019-01-31 Mengyin Lu , Matthew Stephens

In this paper we consider a network of spatially distributed sensors which collect measurement samples of a spatial field, and aim at estimating in a distributed way (without any central coordinator) the entire field by suitably fusing all…

Systems and Control · Computer Science 2018-05-23 Francesco Sasso , Angelo Coluccia , Giuseppe Notarstefano

We consider the problem of empirical Bayes estimation of multiple variances when provided with sample variances. Assuming an arbitrary prior on the variances, we derive different versions of the Bayes estimators using different loss…

Statistics Theory · Mathematics 2022-03-01 Yeil Kwon , Zhigen Zhao

The most commonly used weighted least square state estimator in power industry is nonlinear and formulated by using conventional measurements such as line flow and injection measurements. PMUs (Phasor Measurement Units) are gradually adding…

Systems and Control · Computer Science 2017-03-22 Hossein A. Sangrody , Mohammad Taghi Ameli

We consider a joint processing of $n$ independent sparse regression problems. Each is based on a sample $(y_{i1},x_{i1})...,(y_{im},x_{im})$ of $m$ \iid observations from $y_{i1}=x_{i1}\t\beta_i+\eps_{i1}$, $y_{i1}\in \R$, $x_{i 1}\in\R^p$,…

Machine Learning · Statistics 2016-09-08 Natalia Bochkina , Ya'acov Ritov

In the present study, we propose a new estimator for population mean of the study variable y in the case of stratified random sampling using the information based on auxiliary variable x. Expression for the mean squared error (MSE) of the…

Applications · Statistics 2014-07-25 Sachin Malik , Viplav Kumar Singh , Rajesh Singh

Sampling experiments provide a viable route to show quantum advantages of quantum devices over classical computers in well-defined computational tasks. However, quantum devices such as boson samplers are susceptible to various errors,…

Quantum Physics · Physics 2025-05-02 Deepesh Singh , Ryan J. Marshman , Nathan Walk , Jens Eisert , Timothy C. Ralph , Austin P. Lund

Motivated by the proliferation of observational datasets and the need to integrate non-randomized evidence with randomized controlled trials, causal inference researchers have recently proposed several new methodologies for combining biased…

Methodology · Statistics 2023-09-14 Evan T. R. Rosenman , Francesca Dominici , Luke Miratrix

We obtain a limit of a hierarchical Bayes estimator of a finite population mean when the sample size is large. The limit is in the sense of ordinary calculus, where the sample observations are treated as fixed quantities. Our result…

Statistics Theory · Mathematics 2007-08-22 P. Lahiri , Kanchan Mukherjee

Regularized system identification has become a significant complement to more classical system identification. It has been numerically shown that kernel-based regularized estimators often perform better than the maximum likelihood estimator…

Machine Learning · Statistics 2025-03-18 Yue Ju , Bo Wahlberg , Håkan Hjalmarsson

We propose generalized resubstitution error estimators for regression, a broad family of estimators, each corresponding to a choice of empirical probability measures and loss function. The usual sum of squares criterion is a special case…

Machine Learning · Computer Science 2024-10-24 Diego Marcondes , Ulisses Braga-Neto

We derive streamlined mean field variational Bayes algorithms for fitting linear mixed models with crossed random effects. In the most general situation, where the dimensions of the crossed groups are arbitrarily large, streamlining is…

Methodology · Statistics 2022-04-15 Marianne Menictas , Gioia Di Credico , Matt P. Wand

Shrinkage estimation usually reduces variance at the cost of bias. But when we care only about some parameters of a model, I show that we can reduce variance without incurring bias if we have additional information about the distribution of…

Statistics Theory · Mathematics 2017-11-01 Jann Spiess

Unbiased and consistent variance estimators generally do not exist for design-based treatment effect estimators because experimenters never observe more than one potential outcome for any unit. The problem is exacerbated by interference and…

Methodology · Statistics 2024-07-04 Christopher Harshaw , Joel A. Middleton , Fredrik Sävje

This paper provides some useful tests for fitting a parametric single-index regression model when covariates are measured with error and validation data is available. We propose two tests whose consistency rates do not depend on the…

Methodology · Statistics 2016-04-29 Hira L. Koul , Chuanlong Xie , Lixing Zhu

Survey researchers are increasingly turning to multimode data collection to deal with declines in survey response rates and increasing costs. An efficient approach offers the less costly modes (e.g., web) followed with a more expensive mode…

Methodology · Statistics 2023-03-24 J. Michael Brick , Jill M. DeMatteis