中文
相关论文

相关论文: Model Selection for High-Dimensional Regression un…

200 篇论文

We consider the problem of estimating a low-dimensional parameter in high-dimensional linear regression. Constructing an approximately unbiased estimate of the parameter of interest is a crucial step towards performing statistical…

统计理论 · 数学 2021-07-30 Michael Celentano , Andrea Montanari

Variable selection in linear models plays a pivotal role in modern statistics. Hard-thresholding methods such as $l_0$ regularization are theoretically ideal but computationally infeasible. In this paper, we propose a new approach, called…

机器学习 · 统计学 2015-03-20 Kun Yang

We propose a novel graphical model selection (GMS) scheme for high-dimensional stationary time series or discrete time process. The method is based on a natural generalization of the graphical LASSO (gLASSO), introduced originally for GMS…

机器学习 · 统计学 2023-07-19 Alexander Jung , Gabor Hannak , Norbert Görtz

De-biased lasso has emerged as a popular tool to draw statistical inference for high-dimensional regression models. However, simulations indicate that for generalized linear models (GLMs), de-biased lasso inadequately removes biases and…

统计方法学 · 统计学 2020-06-24 Lu Xia , Bin Nan , Yi Li

The Lasso is a popular model selection and estimation procedure for linear models that enjoys nice theoretical properties. In this paper, we study the Lasso estimator for fitting autoregressive time series models. We adopt a double…

统计理论 · 数学 2008-05-09 Yuval Nardi , Alessandro Rinaldo

In multivariate regression, a $K$-dimensional response vector is regressed upon a common set of $p$ covariates, with a matrix $B^*\in\mathbb{R}^{p\times K}$ of regression coefficients. We study the behavior of the multivariate group Lasso,…

机器学习 · 统计学 2011-03-08 Guillaume Obozinski , Martin J. Wainwright , Michael I. Jordan

We study the limitations of the well known LASSO regression as a variable selector when there exists dependence structures among covariates. We analyze both the classic situation with $n\geq p$ and the high dimensional framework with $p>n$.…

This paper investigates the high-dimensional linear regression with highly correlated covariates. In this setup, the traditional sparsity assumption on the regression coefficients often fails to hold, and consequently many model selection…

统计方法学 · 统计学 2019-03-26 Jianqing Fan , Bai Jiang , Qiang Sun

Discovering the partial differential equations underlying spatio-temporal datasets from very limited and highly noisy observations is of paramount interest in many scientific fields. However, it remains an open question to know when model…

机器学习 · 统计学 2021-10-06 Georges Tod , Gert-Jan Both , Remy Kusters

The Lasso is a prominent algorithm for variable selection. However, its instability in the presence of correlated variables in the high-dimensional setting is well-documented. Although previous research has attempted to address this issue…

统计方法学 · 统计学 2025-05-28 Mahdi Nouraie , Connor Smith , Samuel Muller

Gaussian graphical models are widely utilized to infer and visualize networks of dependencies between continuous variables. However, inferring the graph is difficult when the sample size is small compared to the number of variables. To…

统计理论 · 数学 2016-09-30 Emilie Devijver , Mélina Gallopin

Linear regression is often deemed inherently interpretable; however, challenges arise for high-dimensional data. We focus on further understanding how linear regression approximates nonlinear responses from high-dimensional functional data,…

机器学习 · 计算机科学 2024-11-20 Joachim Schaeffer , Jinwook Rhyu , Robin Droop , Rolf Findeisen , Richard Braatz

A new empirical Bayes approach to variable selection in the context of generalized linear models is developed. The proposed algorithm scales to situations in which the number of putative explanatory variables is very large, possibly much…

统计方法学 · 统计学 2021-06-29 Haim Bar , James Booth , Martin T. Wells

This paper is concerned with high-dimensional panel data models where the number of regressors can be much larger than the sample size. Under the assumption that the true parameter vector is sparse we propose a panel-Lasso estimator and…

统计理论 · 数学 2014-02-14 Anders Bredahl Kock

We propose a new approach to safe variable preselection in high-dimensional penalized regression, such as the lasso. Preselection - to start with a manageable set of covariates - has often been implemented without clear appreciation of its…

We consider the estimation of regression models on strata defined using a categorical covariate, in order to identify interactions between this categorical covariate and the other predictors. A basic approach requires the choice of a…

统计理论 · 数学 2016-11-09 Edouard Ollier , Vivian Viallon

We propose a new measure of variable importance in high-dimensional regression based on the change in the LASSO solution path when one covariate is left out. The proposed procedure provides a novel way to calculate variable importance and…

统计方法学 · 统计学 2020-05-11 Xiangyang Cao , Karl Gregory , Dewei Wang

This work performs a non-asymptotic analysis of the generalized Lasso under the assumption of sub-exponential data. Our main results continue recent research on the benchmark case of (sub-)Gaussian sample distributions and thereby explore…

统计理论 · 数学 2023-01-18 Martin Genzel , Christian Kipp

This paper presents a novel method for statistical inference in high-dimensional binary models with unspecified structure, where we leverage a (potentially misspecified) sparsity-constrained working generalized linear model (GLM) to…

统计方法学 · 统计学 2025-10-03 Xiaotian Hou , Peng Wang , Minge Xie , Linjun Zhang

This paper presents a novel method to make statistical inferences for both the model support and regression coefficients in a high-dimensional logistic regression model. Our method is based on the repro samples framework, in which we…

统计方法学 · 统计学 2024-03-18 Xiaotian Hou , Linjun Zhang , Peng Wang , Min-ge Xie