中文
相关论文

相关论文: Omitted variable bias of Lasso-based inference met…

200 篇论文

Hierarchical statistical models are widely employed in information science and data engineering. The models consist of two types of variables: observable variables that represent the given data and latent variables for the unobservable…

机器学习 · 统计学 2014-02-21 Keisuke Yamazaki

When we are interested in high-dimensional system and focus on classification performance, the $\ell_{1}$-penalized logistic regression is becoming important and popular. However, the Lasso estimates could be problematic when penalties of…

机器学习 · 统计学 2020-06-12 Huamei Huang , Yujing Gao , Huiming Zhang , Bo Li

Applying standard statistical methods after model selection may yield inefficient estimators and hypothesis tests that fail to achieve nominal type-I error rates. The main issue is the fact that the post-selection distribution of the data…

统计方法学 · 统计学 2019-05-23 Amit Meir , Mathias Drton

Detecting influential features in non-linear and/or high-dimensional data is a challenging and increasingly important task in machine learning. Variable selection methods have thus been gaining much attention as well as post-selection…

Selective inference methods are developed for group lasso estimators for use with a wide class of distributions and loss functions. The method includes the use of exponential family distributions, as well as quasi-likelihood modeling for…

统计方法学 · 统计学 2024-03-28 Yiling Huang , Sarah Pirenne , Snigdha Panigrahi , Gerda Claeskens

The Lasso is a method for high-dimensional regression, which is now commonly used when the number of covariates $p$ is of the same order or larger than the number of observations $n$. Classical asymptotic normality theory does not apply to…

统计理论 · 数学 2023-09-20 Michael Celentano , Andrea Montanari , Yuting Wei

Recent theoretical work in causal inference has explored an important class of variables which, when conditioned on, may further amplify existing unmeasured confounding bias (bias amplification). Despite this theoretical work, existing…

统计方法学 · 统计学 2020-03-20 Tyrel Stokes , Russell Steele , Ian Shrier

Penalized regression methods, most notably the lasso, are a popular approach to analyzing high-dimensional data. An attractive property of the lasso is that it naturally performs variable selection. An important area of concern, however, is…

统计方法学 · 统计学 2026-05-13 Ryan Miller , Patrick Breheny

We provide a principled way for investigators to analyze randomized experiments when the number of covariates is large. Investigators often use linear multivariate regression to analyze randomized experiments instead of simply reporting the…

统计理论 · 数学 2022-06-08 Adam Bloniarz , Hanzhong Liu , Cun-Hui Zhang , Jasjeet Sekhon , Bin Yu

The use of machine learning methods for predictive purposes has increased dramatically over the past two decades, but uncertainty quantification for predictive comparisons remains elusive. This paper addresses this gap by extending the…

计量经济学 · 经济学 2025-05-09 Juan Carlos Escanciano , Ricardo Parra

We consider statistical inference for a single coordinate of regression coefficients in high-dimensional linear models. Recently, the debiased estimators are popularly used for constructing confidence intervals and hypothesis testing in…

统计理论 · 数学 2020-10-20 Sai Li

A significant hurdle for analyzing large sample data is the lack of effective statistical computing and inference methods. An emerging powerful approach for analyzing large sample data is subsampling, by which one takes a random subsample…

统计方法学 · 统计学 2015-11-24 Rong Zhu , Ping Ma , Michael W. Mahoney , Bin Yu

The Lasso has become a benchmark data analysis procedure, and numerous variants have been proposed in the literature. Although the Lasso formulations are stated so that overall prediction error is optimized, no full control over the…

Lasso is a celebrated method for variable selection in linear models, but it faces challenges when the variables are moderately or strongly correlated. This motivates alternative approaches such as using a non-convex penalty, adding a ridge…

统计理论 · 数学 2022-03-30 Zheng Tracy Ke , Longlin Wang

We consider random sample splitting for estimation and inference in high dimensional generalized linear models, where we first apply the lasso to select a submodel using one subsample and then apply the debiased lasso to fit the selected…

统计方法学 · 统计学 2023-03-01 Omar Vazquez , Bin Nan

Sample selection models are a widely used approach for correcting bias caused by data that are missing not at random. Their formulation requires specifying the variables that influence the outcome and those that drive the selection process.…

统计计算 · 统计学 2026-03-25 Adam J. Iqbal , Emmanuel O. Ogundimu , F. Javier Rubio

We propose a test of the significance of a variable appearing on the Lasso path and use it in a procedure for selecting one of the models of the Lasso path, controlling the Family-Wise Error Rate. Our null hypothesis depends on a set A of…

统计方法学 · 统计学 2024-09-05 Matthieu Pluntz , Cyril Dalmasso , Pascale Tubert-Bitter , Ismail Ahmed

Variable selection for regression models plays a key role in the analysis of biomedical data. However, inference after selection is not covered by classical statistical frequentist theory which assumes a fixed set of covariates in the…

统计方法学 · 统计学 2021-07-21 Michael Kammer , Daniela Dunkler , Stefan Michiels , Georg Heinze

We study the asymptotic properties of the adaptive Lasso in cointegration regressions in the case where all covariates are weakly exogenous. We assume the number of candidate I(1) variables is sub-linear with respect to the sample size (but…

统计方法学 · 统计学 2011-10-11 Eduardo F. Mendes

The graphical lasso is a widely used algorithm for fitting undirected Gaussian graphical models. However, for inference on functionals of edge values in the learned graph, standard tools lack formal statistical guarantees, such as control…

统计方法学 · 统计学 2025-04-01 Sofia Guglielmini , Gerda Claeskens , Snigdha Panigrahi