中文
相关论文

相关论文: The sparsity and bias of the Lasso selection in hi…

200 篇论文

We consider selection of random predictors for high-dimensional regression problem with binary response for a general loss function. Important special case is when the binary model is semiparametric and the response function is misspecified…

统计理论 · 数学 2020-02-19 Mariusz Kubkowski , Jan Mielniczuk

Model selection for regression problems with an increasing number of covariates continues to be an important problem both theoretically and in applications. Model selection consistency and mean structure reconstruction depend on the…

统计理论 · 数学 2019-05-16 Zikun Yang , Andrew Womack

This paper investigates the high-dimensional linear regression with highly correlated covariates. In this setup, the traditional sparsity assumption on the regression coefficients often fails to hold, and consequently many model selection…

统计方法学 · 统计学 2019-03-26 Jianqing Fan , Bai Jiang , Qiang Sun

Although a majority of the theoretical literature in high-dimensional statistics has focused on settings which involve fully-observed data, settings with missing values and corruptions are common in practice. We consider the problems of…

机器学习 · 统计学 2017-11-06 Yining Wang , Jialei Wang , Sivaraman Balakrishnan , Aarti Singh

Among the most popular variable selection procedures in high-dimensional regression, Lasso provides a solution path to rank the variables and determines a cut-off position on the path to select variables and estimate coefficients. In this…

统计方法学 · 统计学 2018-06-19 X. Jessie Jeng , Huimin Peng , Wenbin Lu

We theoretically analyze the model selection consistency of least absolute shrinkage and selection operator (Lasso), both with and without post-thresholding, for high-dimensional Ising models. For random regular (RR) graphs of size $p$ with…

机器学习 · 统计学 2023-02-20 Xiangming Meng , Tomoyuki Obuchi , Yoshiyuki Kabashima

In this study, we investigate the bias and variance properties of the debiased Lasso in linear regression when the tuning parameter of the node-wise Lasso is selected to be smaller than in previous studies. We consider the case where the…

统计理论 · 数学 2022-08-19 Akira Shinkyu , Naoya Sueishi

In this paper, we consider the classic measurement error regression scenario in which our independent, or design, variables are observed with several sources of additive noise. We will show that our motivating example's replicated…

应用统计 · 统计学 2012-07-10 David J. Biagioni , Ryan Elmore , Wesley Jones

Sparse linear regression with ill-conditioned Gaussian random designs is widely believed to exhibit a statistical/computational gap, but there is surprisingly little formal evidence for this belief, even in the form of examples that are…

数据结构与算法 · 计算机科学 2022-03-08 Jonathan A. Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

We consider the problem of best subset selection (BSS) under high-dimensional sparse linear regression model. Recently, Guo et al. (2020) showed that the model selection performance of BSS depends on a certain identifiability margin, a…

统计理论 · 数学 2025-04-15 Saptarshi Roy , Ambuj Tewari , Ziwei Zhu

In this paper, we are concerned with regression problems where covariates can be grouped in nonoverlapping blocks, and where only a few of them are assumed to be active. In such a situation, the group Lasso is an at- tractive method for…

信息论 · 计算机科学 2013-01-01 Samuel Vaiter , Charles Deledalle , Gabriel Peyré , Jalal Fadili , Charles Dossal

We consider the least-square linear regression problem with regularization by the l1-norm, a problem usually referred to as the Lasso. In this paper, we present a detailed asymptotic analysis of model consistency of the Lasso. For various…

机器学习 · 计算机科学 2008-12-18 Francis Bach

Statistical and machine learning theory has developed several conditions ensuring that popular estimators such as the Lasso or the Dantzig selector perform well in high-dimensional sparse regression, including the restricted eigenvalue,…

统计理论 · 数学 2017-10-03 Edgar Dobriban , Jianqing Fan

Large-scale empirical data, the sample size and the dimension are high, often exhibit various characteristics. For example, the noise term follows unknown distributions or the model is very sparse that the number of critical variables is…

统计理论 · 数学 2018-06-18 Yuehan Yang , Hu Yang

We consider Bayesian variable selection in sparse high-dimensional regression, where the number of covariates $p$ may be large relative to the samples size $n$, but at most a moderate number $q$ of covariates are active. Specifically, we…

统计理论 · 数学 2015-03-31 Rina Foygel Barber , Mathias Drton , Kean Ming Tan

Graphical continuous Lyapunov models offer a new perspective on modeling causally interpretable dependence structure in multivariate data by treating each independent observation as a one-time cross-sectional snapshot of a temporal process.…

统计理论 · 数学 2023-11-16 Philipp Dettling , Mathias Drton , Mladen Kolar

Convex estimators such as the Lasso, the matrix Lasso and the group Lasso have been studied extensively in the last two decades, demonstrating great success in both theory and practice. Two quantities are introduced, the noise barrier and…

统计理论 · 数学 2025-01-07 Pierre C Bellec

We introduce a novel Bayesian approach for both covariate selection and sparse precision matrix estimation in the context of high-dimensional Gaussian graphical models involving multiple responses. Our approach provides a sparse estimation…

统计方法学 · 统计学 2024-09-25 Anwesha Chakravarti , Naveen N. Narishetty , Feng Liang

We consider linear regression in the high-dimensional regime where the number of observations $n$ is smaller than the number of parameters $p$. A very successful approach in this setting uses $\ell_1$-penalized least squares (a.k.a. the…

统计方法学 · 统计学 2014-02-05 Adel Javanmard , Andrea Montanari

We study the problem of high-dimensional variable selection via some two-step procedures. First we show that given some good initial estimator which is $\ell_{\infty}$-consistent but not necessarily variable selection consistent, we can…

统计理论 · 数学 2008-10-10 Jian Zhang , Xinge Jessie Jeng , Han Liu