English
Related papers

Related papers: The Group Square-Root Lasso: Theoretical Propertie…

200 papers

The sparse-group lasso performs both variable and group selection, simultaneously using the strengths of the lasso and group lasso. It has found widespread use in genetics, a field that regularly involves the analysis of high-dimensional…

Machine Learning · Statistics 2025-09-18 Fabio Feser , Marina Evangelou

In this article we study post-model selection estimators that apply ordinary least squares (OLS) to the model selected by first-step penalized estimators, typically Lasso. It is well known that Lasso can estimate the nonparametric…

Statistics Theory · Mathematics 2013-03-21 Alexandre Belloni , Victor Chernozhukov

Nonconvex penalty methods for sparse modeling in linear regression have been a topic of fervent interest in recent years. Herein, we study a family of nonconvex penalty functions that we call the trimmed Lasso and that offers exact control…

Methodology · Statistics 2017-08-16 Dimitris Bertsimas , Martin S. Copenhaver , Rahul Mazumder

We study confidence regions and approximate chi-squared tests for variable groups in high-dimensional linear regression. When the size of the group is small, low-dimensional projection estimators for individual coefficients can be directly…

Statistics Theory · Mathematics 2016-02-23 Ritwik Mitra , Cun-Hui Zhang

This paper considers a high-dimensional linear regression problem where there are complex correlation structures among predictors. We propose a graph-constrained regularization procedure, named Sparse Laplacian Shrinkage with the Graphical…

Methodology · Statistics 2019-04-10 Yuehan Yang , Siwei Xia , Hu Yang

Demanding sparsity in estimated models has become a routine practice in statistics. In many situations, we wish to require that the sparsity patterns attained honor certain problem-specific constraints. Hierarchical sparse modeling (HSM)…

Methodology · Statistics 2017-12-04 Xiaohan Yan , Jacob Bien

We propose a self-tuning $\sqrt{\mathrm {Lasso}}$ method that simultaneously resolves three important practical problems in high-dimensional regression analysis, namely it handles the unknown scale, heteroscedasticity and (drastic)…

Methodology · Statistics 2014-05-27 Alexandre Belloni , Victor Chernozhukov , Lie Wang

We study a set of regularization methods for high-dimensional linear regression models. These penalized estimators have the square root of the residual sum of squared errors as loss function, and any weakly decomposable norm as penalty…

Statistics Theory · Mathematics 2016-06-28 Benjamin Stucky , Sara van de Geer

Extending the results of Bellec, Lecu\'e and Tsybakov to the setting of sparse high-dimensional linear regression with unknown variance, we show that two estimators, the Square-Root Lasso and the Square-Root Slope can achieve the optimal…

Statistics Theory · Mathematics 2017-12-12 Alexis Derumigny

We propose a new approach to mixed-frequency regressions in a high-dimensional environment that resorts to Group Lasso penalization and Bayesian techniques for estimation and inference. In particular, to improve the prediction properties of…

Econometrics · Economics 2020-06-12 Matteo Mogliani , Anna Simoni

Within the statistical and machine learning literature, regularization techniques are often used to construct sparse (predictive) models. Most regularization strategies only work for data where all predictors are treated identically, such…

Computation · Statistics 2020-12-16 Sander Devriendt , Katrien Antonio , Tom Reynkens , Roel Verbelen

Sparse model estimation is a topic of high importance in modern data analysis due to the increasing availability of data sets with a large number of variables. Another common problem in applied statistics is the presence of outliers in the…

Applications · Statistics 2025-02-03 Andreas Alfons , Christophe Croux , Sarah Gelper

In this paper, we are concerned with regression problems where covariates can be grouped in nonoverlapping blocks, and where only a few of them are assumed to be active. In such a situation, the group Lasso is an at- tractive method for…

Information Theory · Computer Science 2013-01-01 Samuel Vaiter , Charles Deledalle , Gabriel Peyré , Jalal Fadili , Charles Dossal

We propose a new penalized method for variable selection and estimation that explicitly incorporates the correlation patterns among predictors. This method is based on a combination of the minimax concave penalty and Laplacian quadratic…

Statistics Theory · Mathematics 2011-12-16 Jian Huang , Shuangge Ma , Hongzhe Li , Cun-Hui Zhang

We consider the problem of sparse variable selection in nonparametric additive models, with the prior knowledge of the structure among the covariates to encourage those variables within a group to be selected jointly. Previous works either…

Machine Learning · Computer Science 2012-06-22 Junming Yin , Xi Chen , Eric Xing

This paper considers the problem of estimating an unknown high dimensional signal from noisy linear measurements, {when} the signal is assumed to possess a \emph{group-sparse} structure in a {known,} fixed dictionary. We consider signals…

Information Theory · Computer Science 2018-05-22 Mojtaba Kadkhodaie Elyaderani , Swayambhoo Jain , Jeffrey Druce , Stefano Gonella , Jarvis Haupt

The sparse group Lasso is a widely used statistical model which encourages the sparsity both on a group and within the group level. In this paper, we develop an efficient augmented Lagrangian method for large-scale non-overlapping sparse…

Optimization and Control · Mathematics 2020-10-23 Yangjing Zhang , Ning Zhang , Defeng Sun , Kim-Chuan Toh

Gaussian Graphical Models (GGMs) are popular tools for studying network structures. However, many modern applications such as gene network discovery and social interactions analysis often involve high-dimensional noisy data with outliers or…

Machine Learning · Statistics 2015-10-30 Eunho Yang , Aurélie C. Lozano

This paper provides a statistical analysis of high-dimensional batch Reinforcement Learning (RL) using sparse linear function approximation. When there is a large number of candidate features, our result sheds light on the fact that…

Machine Learning · Computer Science 2020-11-10 Botao Hao , Yaqi Duan , Tor Lattimore , Csaba Szepesvári , Mengdi Wang

Sparse linear regression (SLR) is a well-studied problem in statistics where one is given a design matrix $X\in\mathbb{R}^{m\times n}$ and a response vector $y=X\theta^*+w$ for a $k$-sparse vector $\theta^*$ (that is, $\|\theta^*\|_0\leq…

Machine Learning · Computer Science 2025-02-06 Aparna Gupte , Neekon Vafa , Vinod Vaikuntanathan