English
Related papers

Related papers: Bayesian shrinkage methods for partially observed …

200 papers

We consider a Bayesian approach to variable selection in the presence of high dimensional covariates based on a hierarchical model that places prior distributions on the regression coefficients as well as on the model space. We adopt the…

Statistics Theory · Mathematics 2014-07-28 Naveen Naidu Narisetty , Xuming He

Linear model prediction with a large number of potential predictors is both statistically and computationally challenging. The traditional approaches are largely based on shrinkage selection/estimation methods, which are applicable even…

Methodology · Statistics 2024-09-17 Hanmei Sun , Jiangshan Zhang , Jiming Jiang

The known connection between shrinkage estimation, empirical Bayes, and mixed effects models is explored and applied to balanced and unbalanced designs in which the responses are correlated. As an illustration, a mixed model is proposed for…

Methodology · Statistics 2022-01-04 Yihan Bao , James G. Booth

For small area estimation of area-level data, the Fay-Herriot model is extensively used as a model based method. In the Fay-Herriot model, it is conventionally assumed that the sampling variances are known whereas estimators of sampling…

Methodology · Statistics 2017-05-15 Shonosuke Sugasawa , Hiromasa Tamae , Tatsuya Kubokawa

Most estimates for penalised linear regression can be viewed as posterior modes for an appropriate choice of prior distribution. Bayesian shrinkage methods, particularly the horseshoe estimator, have recently attracted a great deal of…

Methodology · Statistics 2017-11-06 Zemei Xu , Daniel F. Schmidt , Enes Makalic , Guoqi Qian , John L. Hopper

We consider planning longitudinal covariate measurements in follow-up studies where covariates are time-varying. We assume that the entire cohort cannot be selected for longitudinal measurements due to financial limitations and study how a…

Methodology · Statistics 2024-07-03 Jaakko Reinikainen , Juha Karvanen

For a Bayesian, real-time forecasting with the posterior predictive distribution can be challenging for a variety of time series models. First, estimating the parameters of a time series model can be difficult with sample-based approaches…

Applications · Statistics 2022-08-08 Taylor R. Brown

We develop and analyze empirical Bayes Stein-type estimators for use in the estimation of causal effects in large-scale online experiments. While online experiments are generally thought to be distinguished by their large sample size, we…

Methodology · Statistics 2019-11-15 Drew Dimmery , Eytan Bakshy , Jasjeet Sekhon

Signal denoising---also known as non-parametric regression---is often performed through shrinkage estimation in a transformed (e.g., wavelet) domain; shrinkage in the transformed domain corresponds to smoothing in the original domain. A key…

Methodology · Statistics 2020-09-09 Zhengrong Xing , Peter Carbonetto , Matthew Stephens

Transfer learning (TL) has emerged as a powerful tool to supplement data collected for a target task with data collected for a related source task. The Bayesian framework is natural for TL because information from the source data can be…

Methodology · Statistics 2024-06-06 Mohamed A. Abba , Jonathan P. Williams , Brian J. Reich

Consider a problem of predicting a response variable using a set of covariates in a linear regression model. If it is \emph{a priori} known or suspected that a subset of the covariates do not significantly contribute to the overall fit of…

Applications · Statistics 2011-09-13 SM Enayetur Raheem , S. Ejaz Ahmed

Computational models provide crucial insights into complex biological processes such as cancer evolution, but their mechanistic nature often makes them nonlinear and parameter-rich, complicating calibration. We systematically evaluate…

Analysis of PDEs · Mathematics 2025-09-24 Christina Schenk , Jacobo Ayensa Jiménez , Ignacio Romero

We consider the problem of model choice for stochastic epidemic models given partial observation of a disease outbreak through time. Our main focus is on the use of Bayes factors. Although Bayes factors have appeared in the epidemic…

Computation · Statistics 2017-10-16 Muteb Alharthi , Theodore Kypraios , Philip D. O'Neill

This article describes a full Bayesian treatment for simultaneous fixed-effect selection and parameter estimation in high-dimensional generalized linear mixed models. The approach consists of using a Bayesian adaptive Lasso penalty for…

Methodology · Statistics 2016-08-31 Dao Thanh Tung , Minh-Ngoc Tran , Tran Manh Cuong

We develop a fully Bayesian framework for function-on-scalars regression with many predictors. The functional data response is modeled nonparametrically using unknown basis functions, which produces a flexible and data-adaptive functional…

Methodology · Statistics 2018-10-25 Daniel R. Kowal , Daniel C. Bourgeois

In large-scale, data-driven applications, parameters are often only known approximately due to noise and limited data samples. In this paper, we focus on high-dimensional optimization problems with linear constraints under uncertain…

Optimization and Control · Mathematics 2024-03-01 Naqi Huang , Nestor Parolya , Theresia van Essen

Researchers regularly perform conditional prediction using imputed values of missing data. However, applications of imputation often lack a firm foundation in statistical theory. This paper originated when we were unable to find analysis…

Econometrics · Economics 2021-02-24 Charles F Manski , Michael Gmeiner , Anat Tamburc

Bayesian regression determines model parameters by minimizing the expected loss, an upper bound to the true generalization error. However, the loss ignores misspecification, where models are imperfect. Parameter uncertainties from Bayesian…

Machine Learning · Statistics 2024-11-07 Thomas D Swinburne , Danny Perez

Vector autogressions (VARs) are widely applied when it comes to modeling and forecasting macroeconomic variables. In high dimensions, however, they are prone to overfitting. Bayesian methods, more concretely shrinkage priors, have shown to…

Econometrics · Economics 2025-02-27 Luis Gruber , Gregor Kastner

Factor models are widely used for dimension reduction. Bayesian approaches to these models often place a prior on the factor loadings that allows for infinitely many factors, with loadings increasingly shrunk toward zero as the column index…

Methodology · Statistics 2026-03-31 Shicheng Liu , Qingping Zhou , Yanan Fan , Xiongwen Ke