中文
相关论文

相关论文: Risk-consistency of cross-validation with lasso-ty…

200 篇论文

In regression settings where explanatory variables have very low correlations and there are relatively few effects, each of large magnitude, we expect the Lasso to find the important variables with few errors, if any. This paper shows that…

统计理论 · 数学 2016-09-16 Weijie Su , Malgorzata Bogdan , Emmanuel Candes

Generalized compressed sensing (GCS) is a paradigm in which a structured high-dimensional signal may be recovered from random, under-determined, and corrupted linear measurements. Generalized Lasso (GL) programs are effective for solving…

信息论 · 计算机科学 2022-08-25 Aaron Berk , Yaniv Plan , Özgür Yilmaz

In the sparse linear regression setting, we consider testing the significance of the predictor variable that enters the current lasso model, in the sequence of models visited along the lasso solution path. We propose a simple test statistic…

统计理论 · 数学 2014-05-27 Richard Lockhart , Jonathan Taylor , Ryan J. Tibshirani , Robert Tibshirani

We consider the Lasso for a noiseless experiment where one has observations $X \beta^0$ and uses the penalized version of basis pursuit. We compute for some special designs the compatibility constant, a quantity closely related to the…

统计理论 · 数学 2017-01-13 Sara van de Geer

We consider the fundamental problem of estimating the mean of a vector $y=X\beta+z$, where $X$ is an $n\times p$ design matrix in which one can have far more variables than observations, and $z$ is a stochastic error term--the so-called…

统计理论 · 数学 2009-08-21 Emmanuel J. Candès , Yaniv Plan

Reproducibility is imperative for any scientific discovery. More often than not, modern scientific findings rely on statistical analysis of high-dimensional data. At a minimum, reproducibility manifests itself in stability of statistical…

统计理论 · 数学 2013-10-02 Bin Yu

In this article we study the asymptotic predictive optimality of a model selection criterion based on the cross-validatory predictive density, already available in the literature. For a dependent variable and associated explanatory…

统计理论 · 数学 2008-12-18 Arijit Chakrabarti , Tapas Samanta

Variance estimation in the linear model when $p > n$ is a difficult problem. Standard least squares estimation techniques do not apply. Several variance estimators have been proposed in the literature, all with accompanying asymptotic…

统计方法学 · 统计学 2014-01-30 Stephen Reid , Robert Tibshirani , Jerome Friedman

Heavy-tailed high-dimensional data are commonly encountered in various scientific fields and pose great challenges to modern statistical analysis. A natural procedure to address this problem is to use penalized quantile regression with…

统计理论 · 数学 2015-03-20 Jianqing Fan , Yingying Fan , Emre Barut

When we are interested in high-dimensional system and focus on classification performance, the $\ell_{1}$-penalized logistic regression is becoming important and popular. However, the Lasso estimates could be problematic when penalties of…

机器学习 · 统计学 2020-06-12 Huamei Huang , Yujing Gao , Huiming Zhang , Bo Li

We investigate generically applicable and intuitively appealing prediction intervals based on $k$-fold cross validation. We focus on the conditional coverage probability of the proposed intervals, given the observations in the training…

统计理论 · 数学 2022-05-13 Lukas Steinberger , Hannes Leeb

In this article we investigate consistency of selection in regression models via the popular Lasso method. Here we depart from the traditional linear regression assumption and consider approximations of the regression function $f$ with…

统计理论 · 数学 2008-12-18 Florentina Bunea

Due to its low computational cost, Lasso is an attractive regularization method for high-dimensional statistical settings. In this paper, we consider multivariate counting processes depending on an unknown function parameter to be estimated…

统计理论 · 数学 2015-04-08 Niels Richard Hansen , Patricia Reynaud-Bouret , Vincent Rivoirard

The estimation of a precision matrix is a crucial problem in various research fields, particularly when working with high dimensional data. In such settings, the most common approach is to use the penalized maximum likelihood. The…

统计方法学 · 统计学 2025-01-10 Vahe Avagyan

We add a set of convex constraints to the lasso to produce sparse interaction models that honor the hierarchy restriction that an interaction only be included in a model if one or both variables are marginally important. We give a precise…

统计方法学 · 统计学 2013-06-20 Jacob Bien , Jonathan Taylor , Robert Tibshirani

Recent work has focused on the problem of conducting linear regression when the number of covariates is very large, potentially greater than the sample size. To facilitate this, one useful tool is to assume that the model can be well…

统计方法学 · 统计学 2011-11-21 Zhou Fang

In sparse regression modeling via regularization such as the lasso, it is important to select appropriate values of tuning parameters including regularization parameters. The choice of tuning parameters can be viewed as a model selection…

统计方法学 · 统计学 2012-01-05 Kei Hirose , Shohei Tateishi , Sadanori Konishi

Recently, many regularized procedures have been proposed for variable selection in linear regression, but their performance depends on the tuning parameter selection. Here a criterion for the tuning parameter selection is proposed, which…

统计方法学 · 统计学 2013-01-31 Yixin Fang , Junhui Wang , Wei Sun

Classification with a sparsity constraint on the solution plays a central role in many high dimensional machine learning applications. In some cases, the features can be grouped together so that entire subsets of features can be selected or…

机器学习 · 计算机科学 2014-09-05 Nikhil Rao , Robert Nowak , Christopher Cox , Timothy Rogers

Model selection is difficult to analyse yet theoretically and empirically important, especially for high-dimensional data analysis. Recently the least absolute shrinkage and selection operator (Lasso) has been applied in the statistical and…

机器学习 · 统计学 2016-06-02 Ning Xu , Jian Hong , Timothy C. G. Fisher