English
Related papers

Related papers: Predictor-dependent shrinkage for linear regressio…

200 papers

This paper investigates the high-dimensional linear regression with highly correlated covariates. In this setup, the traditional sparsity assumption on the regression coefficients often fails to hold, and consequently many model selection…

Methodology · Statistics 2019-03-26 Jianqing Fan , Bai Jiang , Qiang Sun

High-dimensional covariates often admit linear factor structure. To effectively screen correlated covariates in high-dimension, we propose a conditional variable screening test based on non-parametric regression using neural networks due to…

Econometrics · Economics 2024-08-21 Jianqing Fan , Weining Wang , Yue Zhao

The coefficient of determination is well defined for linear models and its extension is long wanted for mixed-effects models. We revisit its extension to define measures for proportions of variation explained by the whole model, fixed…

Methodology · Statistics 2022-05-04 Dabao Zhang

This paper focuses on Bayesian shrinkage for covariance matrix estimation. We examine posterior properties and frequentist risks of Bayesian estimators based on new hierarchical inverse-Wishart priors. More precisely, we give the existence…

Methodology · Statistics 2011-06-17 Mathilde Bouriga , Olivier Féron

This article discusses a partially adapted particle filter for estimating the likelihood of a nonlinear structural econometric state space models whose state transition density cannot be expressed in closed form. The filter generates the…

Methodology · Statistics 2012-09-05 Jamie Hall , Michael K. Pitt , Robert Kohn

Model development often takes data structure, subject matter considerations, model assumptions, and goodness of fit into consideration. To diagnose issues with any of these factors, it can be helpful to understand regression model estimates…

Methodology · Statistics 2022-01-11 Amy Zhang , Le Bao , Michael J. Daniels

We propose a novel variational Bayes approach to estimate high-dimensional vector autoregression (VAR) models with hierarchical shrinkage priors. Our approach does not rely on a conventional structural VAR representation of the parameter…

Econometrics · Economics 2023-07-03 Mauro Bernardi , Daniele Bianchi , Nicolas Bianco

Constant (naive) imputation is still widely used in practice as this is a first easy-to-use technique to deal with missing data. Yet, this simple method could be expected to induce a large bias for prediction purposes, as the imputed input…

Statistics Theory · Mathematics 2024-02-07 Alexis Ayme , Claire Boyer , Aymeric Dieuleveut , Erwan Scornet

The empirical likelihood inference is extended to a class of semiparametric models for stationary, weakly dependent series. A partially linear single-index regression is used for the conditional mean of the series given its past, and the…

Methodology · Statistics 2021-05-18 Marie Du Roy de Chaumaray , Matthieu Marbac , Valentin Patilea

The proposed approach extends the confidence posterior distribution to the semi-parametric empirical Bayes setting. Whereas the Bayesian posterior is defined in terms of a prior distribution conditional on the observed data, the confidence…

Methodology · Statistics 2012-05-02 David R. Bickel

Bayes factor, defined as the ratio of the marginal likelihood functions of two competing models, is the natural Bayesian procedure for model selection. Marginal likelihoods are usually computationally demanding and complex. This scenario is…

Methodology · Statistics 2022-09-09 Gabriel Calvo , Carmen Armero , Luigi Spezia , Maria Grazia Pennino

This work is devoted to the finite sample prediction risk analysis of a class of linear predictors of a response $Y\in \mathbb{R}$ from a high-dimensional random vector $X\in \mathbb{R}^p$ when $(X,Y)$ follows a latent factor regression…

Machine Learning · Statistics 2021-04-26 Xin Bing , Florentina Bunea , Seth Strimas-Mackey , Marten Wegkamp

We propose information criteria that measure the prediction risk of a predictive density based on the Bayesian marginal likelihood from a frequentist point of view. We derive criteria for selecting variables in linear regression models,…

Methodology · Statistics 2017-10-20 Yuki Kawakubo , Tatsuya Kubokawa , Muni S. Srivastava

We consider generalized linear regression analysis with left-censored covariate due to the lower limit of detection. Complete case analysis by eliminating observations with values below limit of detection yields valid estimates for…

Methodology · Statistics 2014-12-09 Shengchun Kong , Bin Nan

This paper is devoted to the estimation of a partial graphical model with a structural Bayesian penalization. Precisely, we are interested in the linear regression setting where the estimation is made through the direct links between…

Statistics Theory · Mathematics 2021-05-25 Eunice Okome Obiang , Pascal Jézéquel , Frédéric Proïa

We introduce a random partition model for Bayesian nonparametric regression. The model is based on infinitely-many disjoint regions of the range of a latent covariate-dependent Gaussian process. Given a realization of the process, the…

Methodology · Statistics 2013-01-04 George Karabatsos , Stephen G. Walker

A conventional Bayesian approach to prediction uses the posterior distribution to integrate out parameters in a density for unobserved data conditional on the observed data and parameters. When the true posterior is intractable, it is…

Methodology · Statistics 2026-02-27 Lucas Kock , Scott A. Sisson , G. S. Rodrigues , David J. Nott

I study partial identification of distributional parameters in triangular systems. This model consists of a nonparametric outcome equation and a selection equation. This allows for general unobserved heterogeneity and selection on…

Methodology · Statistics 2014-11-11 Ju Hyun Kim

We propose a functional linear model to predict a response using multiple functional and longitudinal predictors and to estimate the effect lags of predictors. The coefficient functions are written as the expansion of a basis system (e.g.…

Methodology · Statistics 2019-07-24 Haiyan Liu , Georgios Aivaliotis , Jeanine Houwing-Duistermaat

Many scientific and industrial processes produce data that is best analysed as vectors of relative values, often called compositions or proportions. The Dirichlet distribution is a natural distribution to use for composition or proportion…

Methodology · Statistics 2020-04-15 Sean van der Merwe