中文
相关论文

相关论文: Omitted variable bias of Lasso-based inference met…

200 篇论文

Sequential data collection has emerged as a widely adopted technique for enhancing the efficiency of data gathering processes. Despite its advantages, such data collection mechanism often introduces complexities to the statistical inference…

统计理论 · 数学 2023-11-09 Mufang Ying , Koulik Khamaru , Cun-Hui Zhang

We develop a general approach to valid inference after model selection. At the core of our framework is a result that characterizes the distribution of a post-selection estimator conditioned on the selection event. We specialize the…

统计理论 · 数学 2016-05-04 Jason D. Lee , Dennis L. Sun , Yuekai Sun , Jonathan E. Taylor

This work performs a non-asymptotic analysis of the generalized Lasso under the assumption of sub-exponential data. Our main results continue recent research on the benchmark case of (sub-)Gaussian sample distributions and thereby explore…

统计理论 · 数学 2023-01-18 Martin Genzel , Christian Kipp

Explanatory variables in a predictive regression typically exhibit low signal strength and various degrees of persistence. Variable selection in such a context is of great importance. In this paper, we explore the pitfalls and possibilities…

计量经济学 · 经济学 2021-02-16 Ji Hyung Lee , Zhentao Shi , Zhan Gao

Variable selection in relation to regression modeling has constituted a methodological problem for more than 60 years. Especially in the context of high-dimensional regression, developing stable and reliable methods, algorithms, and…

统计方法学 · 统计学 2024-04-04 Charlotte Castel , Zhi Zhao , Magne Thoresen

Biased sampling designs can be highly efficient when studying rare (binary) or low variability (continuous) endpoints. We consider longitudinal data settings in which the probability of being sampled depends on a repeatedly measured…

统计方法学 · 统计学 2020-01-14 Lee S. McDaniel , Jonathan S. Schildcrout , Enrique F. Schisterman , Paul J. Rathouz

We develop tools to do valid post-selective inference for a family of model selection procedures, including choosing a model via cross-validated Lasso. The tools apply universally when the following random vectors are jointly asymptotically…

统计方法学 · 统计学 2018-02-13 Jelena Markovic , Lucy Xia , Jonathan Taylor

We propose two semiparametric versions of the debiased Lasso procedure for the model $Y_i = X_i\beta_0 + g_0(Z_i) + \epsilon_i$, where $\beta_0$ is high dimensional but sparse (exactly or approximately). Both versions are shown to have the…

统计理论 · 数学 2017-08-09 Ying Zhu , Zhuqing Yu , Guang Cheng

We consider the problem of estimating a low-dimensional parameter in high-dimensional linear regression. Constructing an approximately unbiased estimate of the parameter of interest is a crucial step towards performing statistical…

统计理论 · 数学 2021-07-30 Michael Celentano , Andrea Montanari

In analyzing big data for finite population inference, it is critical to adjust for the selection bias in the big data. In this paper, we propose two methods of reducing the selection bias associated with the big data sample. The first…

统计方法学 · 统计学 2019-01-08 Jae Kwang Kim , Zhonglei Wang

In this paper, we seek to establish asymptotic results for selective inference procedures removing the assumption of Gaussianity. The class of selection procedures we consider are determined by affine inequalities, which we refer to as…

统计理论 · 数学 2016-08-05 Xiaoying Tian , Jonathan Taylor

Statistical models can involve implicitly defined quantities, such as solutions to nonlinear ordinary differential equations (ODEs), that unavoidably need to be numerically approximated in order to evaluate the model. The approximation…

统计计算 · 统计学 2024-09-16 Juho Timonen , Nikolas Siccha , Ben Bales , Harri Lähdesmäki , Aki Vehtari

The Lasso is one of the most ubiquitous methods for variable selection in high-dimensional linear regression and has been studied extensively under different regimes. In a particular asymptotic setup entailing $n/p\to \text{constant}$, an…

统计理论 · 数学 2026-02-10 Lina Hidmi , Asaf Weinstein

We consider the problem of parameter estimation using weakly supervised datasets, where a training sample consists of the input and a partially specified annotation, which we refer to as the output. The missing information in the annotation…

机器学习 · 计算机科学 2012-06-22 M. Pawan Kumar , Ben Packer , Daphne Koller

This paper presents a comprehensive exploration of the theoretical properties inherent in the Adaptive Lasso and the Transfer Lasso. The Adaptive Lasso, a well-established method, employs regularization divided by initial estimators and is…

机器学习 · 统计学 2024-04-18 Masaaki Takada , Hironori Fujisawa

In high dimensional settings where a small number of regressors are expected to be important, the Lasso estimator can be used to obtain a sparse solution vector with the expectation that most of the non-zero coefficients are associated with…

机器学习 · 统计学 2019-04-01 Erik Drysdale , Yingwei Peng , Timothy P. Hanna , Paul Nguyen , Anna Goldenberg

Hierarchical learning models, such as mixture models and Bayesian networks, are widely employed for unsupervised learning tasks, such as clustering analysis. They consist of observable and hidden variables, which represent the given data…

机器学习 · 统计学 2018-01-08 Keisuke Yamazaki

The popularity of penalized regression in high-dimensional data analysis has led to a demand for new inferential tools for these models. False discovery rate control is widely used in high-dimensional hypothesis testing, but has only…

统计方法学 · 统计学 2019-01-24 Ryan Miller , Patrick Breheny

High-dimensional multivariate longitudinal data, which arise when many outcome variables are measured repeatedly over time, are becoming increasingly common in social, behavioral and health sciences. We propose a latent variable model for…

统计方法学 · 统计学 2025-12-09 Sze Ming Lee , Yunxiao Chen , Tony Sit

Hierarchical parametric models consisting of observable and latent variables are widely used for unsupervised learning tasks. For example, a mixture model is a representative hierarchical model for clustering. From the statistical point of…

机器学习 · 统计学 2014-01-24 Keisuke Yamazaki