中文
相关论文

相关论文: Accuracy and stability of solar variable selection…

200 篇论文

We consider the least-square linear regression problem with regularization by the $\ell^1$-norm, a problem usually referred to as the Lasso. In this paper, we first present a detailed asymptotic analysis of model consistency of the Lasso in…

机器学习 · 计算机科学 2009-01-22 Francis Bach

In exciting new work, Bertsimas et al. (2016) showed that the classical best subset selection problem in regression modeling can be formulated as a mixed integer optimization (MIO) problem. Using recent advances in MIO algorithms, they…

统计方法学 · 统计学 2017-08-01 Trevor Hastie , Robert Tibshirani , Ryan J. Tibshirani

We consider estimation and inference in panel data models with additive unobserved individual specific heterogeneity in a high dimensional setting. The setting allows the number of time varying regressors to be larger than the sample size.…

统计方法学 · 统计学 2017-10-05 Alexandre Belloni , Victor Chernozhukov , Christian Hansen , Damian Kozbur

We propose a computationally intensive method, the random lasso method, for variable selection in linear models. The method consists of two major steps. In step 1, the lasso method is applied to many bootstrap samples, each using a set of…

应用统计 · 统计学 2011-04-19 Sijian Wang , Bin Nan , Saharon Rosset , Ji Zhu

Motivation: The high dimensionality of genomic data calls for the development of specific classification methodologies, especially to prevent over-optimistic predictions. This challenge can be tackled by compression and variable selection,…

统计方法学 · 统计学 2021-04-10 G. Durif , L. Modolo , J. Michaelsson , J. E. Mold , S. Lambert-Lacroix , F. Picard

Simultaneous feature selection and non-linear function estimation is challenging in modeling, especially in high-dimensional settings where the number of variables exceeds the available sample size. In this article, we investigate the…

机器学习 · 统计学 2026-01-05 Bin Luo , Susan Halabi

We study the asymptotic properties of Deshpande et al.\ (2019)'s multivariate spike-and-slab LASSO (mSSL) procedure for simultaneous variable and covariance selection in the sparse multivariate linear regression problem. In that problem,…

统计理论 · 数学 2024-05-24 Yunyi Shen , Sameer K. Deshpande

Lasso and other regularization procedures are attractive methods for variable selection, subject to a proper choice of shrinkage parameter. Given a set of potential subsets produced by a regularization algorithm, a consistent model…

统计方法学 · 统计学 2014-02-26 Minh-Ngoc Tran

Variable selection plays an important role in the high-dimensional data analysis. However the high-dimensional data often induces the strongly correlated variables problem. In this paper, we propose Elastic Net procedure for partially…

统计方法学 · 统计学 2015-07-23 Chunhong Li , Dengxiang Huang , Hongshuai Dai , Xinxing Wei

Spike sorting is a class of algorithms used in neuroscience to attribute the time occurences of particular electric signals, called action potential or spike, to neurons. We rephrase this problem as a particular optimization problem : Lasso…

统计理论 · 数学 2022-04-12 Laurent Dragoni , Rémi Flamary , Karim Lounici , Patricia Reynaud-Bouret

The choice of the tuning parameter in the Lasso is central to its statistical performance in high-dimensional linear regression. In this work, we study tuning regimes under which the Lasso exhibits suboptimal prediction performance, in the…

统计理论 · 数学 2026-05-19 Guo Liu

In this paper, we are concerned with regression problems where covariates can be grouped in nonoverlapping blocks, and where only a few of them are assumed to be active. In such a situation, the group Lasso is an at- tractive method for…

信息论 · 计算机科学 2013-01-01 Samuel Vaiter , Charles Deledalle , Gabriel Peyré , Jalal Fadili , Charles Dossal

Sure Independence Screening is a fast procedure for variable selection in ultra-high dimensional regression analysis. Unfortunately, its performance greatly deteriorates with increasing dependence among the predictors. To solve this issue,…

统计方法学 · 统计学 2018-11-15 Yixin Wang , Stefan Van Aelst

We consider the problem of identifying significant predictors in large data bases, where the response variable depends on the linear combination of explanatory variables through an unknown link function, corrupted with the noise from the…

统计方法学 · 统计学 2019-11-19 Wojciech Rejchel , Malgorzata Bogdan

Best subset selection (BSS) is widely known as the holy grail for high-dimensional variable selection. Nevertheless, the notorious NP-hardness of BSS substantially restricts its practical application and also discourages its theoretical…

统计方法学 · 统计学 2021-08-27 Yongyi Guo , Ziwei Zhu , Jianqing Fan

Vector autoregression (VAR) is a fundamental tool for modeling multivariate time series. However, as the number of component series is increased, the VAR model becomes overparameterized. Several authors have addressed this issue by…

统计方法学 · 统计学 2020-09-09 William B. Nicholson , Ines Wilms , Jacob Bien , David S. Matteson

We propose a new sparse regression method called the component lasso, based on a simple idea. The method uses the connected-components structure of the sample covariance matrix to split the problem into smaller ones. It then solves the…

机器学习 · 统计学 2013-12-10 Nadine Hussami , Robert Tibshirani

In multivariate regression, a $K$-dimensional response vector is regressed upon a common set of $p$ covariates, with a matrix $B^*\in\mathbb{R}^{p\times K}$ of regression coefficients. We study the behavior of the multivariate group Lasso,…

机器学习 · 统计学 2011-03-08 Guillaume Obozinski , Martin J. Wainwright , Michael I. Jordan

Sparse regularization such as $\ell_1$ regularization is a quite powerful and widely used strategy for high dimensional learning problems. The effectiveness of sparse regularization has been supported practically and theoretically by…

机器学习 · 统计学 2018-02-23 Masaaki Takada , Taiji Suzuki , Hironori Fujisawa

We study sparse group Lasso for high-dimensional double sparse linear regression, where the parameter of interest is simultaneously element-wise and group-wise sparse. This problem is an important instance of the simultaneously structured…

统计理论 · 数学 2022-05-10 T. Tony Cai , Anru R. Zhang , Yuchen Zhou