English
Related papers

Related papers: Fixed effects selection in the linear mixed-effect…

200 papers

Estimating a causal effect from observational data can be biased if we do not control for self-selection. This selection is based on confounding variables that affect the treatment assignment and the outcome. Propensity score methods aim to…

Econometrics · Economics 2021-09-10 Daniel Jacob

Competing risks data refer to situations where the occurrence of one event pre- cludes the possibility of other events happening, resulting in multiple mutually exclusive events. This data type is commonly encountered in medical research…

Methodology · Statistics 2025-10-21 Fatemeh Mahmoudi , Chenxi Li , Kaida Cai , Xuewen Lu

Feature subset selection arises in many high-dimensional applications of statistics, such as compressed sensing and genomics. The $\ell_0$ penalty is ideal for this task, the caveat being it requires the NP-hard combinatorial evaluation of…

Machine Learning · Statistics 2017-06-26 Anindya Bhadra , Jyotishka Datta , Nicholas G. Polson , Brandon Willard

The Huber's criterion is a useful method for robust regression. The adaptive least absolute shrinkage and selection operator (lasso) is a popular technique for simultaneous estimation and variable selection. In the case of small sample size…

Statistics Theory · Mathematics 2012-07-31 Laurent Zwald , Sophie Lambert-Lacroix

Estimating network formation models with degree heterogeneity raises two problems in empirical networks. First, agents that send no links, receive no links, or link to all remaining agents can make the fixed-effects MLE fail to exist.…

Econometrics · Economics 2026-05-04 Zizhong Yan , Jingrong Li , Yi Zhang

With a focus on linear models with smooth functional covariates, we propose a penalization framework (SACR) based on the nonzero centered ridge, where the center of the penalty is optimally reweighted in a supervised way, starting from the…

Methodology · Statistics 2020-11-03 Edoardo Belli

We study ridge estimation of the precision matrix in the high-dimensional setting where the number of variables is large relative to the sample size. We first review two archetypal ridge estimators and note that their utilized penalties do…

Methodology · Statistics 2016-06-17 Wessel N. van Wieringen , Carel F. W. Peeters

In this work a method to regularize Cox frailty models is proposed that accommodates time-varying covariates and time-varying coefficients and is based on the full instead of the partial likelihood. A particular advantage in this framework…

Methodology · Statistics 2020-04-01 Maike Hohberg , Andreas Groll

In this paper, we study the nonparametric linear model, when the error process is a dependent Gaussian process. We focus on the estimation of the mean vector via a model selection approach. We first give the general theoretical form of the…

Statistics Theory · Mathematics 2020-05-05 Emmanuel Caron , Jérôme Dedecker , Bertrand Michel

Non linear mixed effect models are classical tools to analyze non linear longitudinal data in many fields such as population Pharmacokinetic. Groups of observations are usually compared by introducing the group affiliations as binary…

Computation · Statistics 2017-09-28 Edouard Ollier , Adeline Samson , Xavier Delavenne , Vivian Viallon

Mixed linear models are commonly used in repeated measures studies. They account for the dependence amongst observations obtained from the same experimental unit. Oftentimes, the number of observations is small, and it is thus important to…

Methodology · Statistics 2011-08-05 Tatiane F. N. Melo , Silvia L. P. Ferrari , Francisco Cribari-Neto

Variable selection is an old and pervasive problem in regression analysis. One solution is to impose a lasso penalty to shrink parameter estimates toward zero and perform continuous model selection. The lasso-penalized mixture of linear…

Applications · Statistics 2016-05-04 Luke R. Lloyd-Jones , Hien D. Nguyen , Geoffrey J. McLachlan

We propose a sparse coefficient estimation and automated model selection procedure for autoregressive (AR) processes with heavy-tailed innovations based on penalized conditional maximum likelihood. Under mild moment conditions on the…

Methodology · Statistics 2013-09-24 Hailin Sang , Yan Sun

Augmenting a smooth cost function with an $\ell_1$ penalty allows analysts to efficiently conduct estimation and variable selection simultaneously in sophisticated models and can be efficiently implemented using proximal gradient methods.…

Machine Learning · Statistics 2024-12-10 Nathan Wycoff , Lisa O. Singh , Ali Arab , Katharine M. Donato

A new family of penalty functions, adaptive to likelihood, is introduced for model selection in general regression models. It arises naturally through assuming certain types of prior distribution on the regression parameters. To study…

Methodology · Statistics 2013-08-26 Yang Feng , Tengfei Li , Zhiliang Ying

While shrinkage is essential in high-dimensional settings, its use for low-dimensional regression-based prediction has been debated. It reduces variance, often leading to improved prediction accuracy. However, it also inevitably introduces…

This paper tackles the problem of selecting among several linear estimators in non-parametric regression; this includes model selection for linear regression, the choice of a regularization parameter in kernel ridge regression, spline…

Statistics Theory · Mathematics 2011-09-15 Sylvain Arlot , Francis Bach

We consider the problem of estimation of a covariance matrix for Gaussian data in a high dimensional setting. Existing approaches include maximum likelihood estimation under a pre-specified sparsity pattern, l_1-penalized loglikelihood…

Methodology · Statistics 2024-10-04 Luca Cibinel , Alberto Roverato , Veronica Vinciotti

Sparse Gaussian graphical models characterize sparse dependence relationships between random variables in a network. To estimate multiple related Gaussian graphical models on the same set of variables, we formulate a hierarchical model,…

Methodology · Statistics 2014-06-10 Yuancheng Zhu , Rina Foygel Barber

Targeted maximum likelihood estimation is a general methodology combining flexible ensemble learning and semiparametric efficiency theory in a two-step procedure for estimation of causal parameters. Proposed targeted maximum likelihood…

Methodology · Statistics 2021-06-22 Helene Charlotte Wiese Rytgaard , Frank Eriksson , Mark van der Laan