English
Related papers

Related papers: Sparse Regression under Correlation and Weak Signa…

200 papers

Large-scale modern data often involves estimation and testing for high-dimensional unknown parameters. It is desirable to identify the sparse signals, ``the needles in the haystack'', with accuracy and false discovery control. However, the…

Machine Learning · Computer Science 2021-11-08 Junhui Cai , Xu Han , Ya'acov Ritov , Linda Zhao

We present a sparse analogue to stochastic gradient descent that is guaranteed to perform well under similar conditions to the lasso. In the linear regression setup with irrepresentable noise features, our algorithm recovers the support set…

Statistics Theory · Mathematics 2014-12-16 Jacob Steinhardt , Stefan Wager , Percy Liang

While Weighted Lasso sparse regression has appealing statistical guarantees that would entail a major real-world impact in finance, genomics, and brain imaging applications, it is typically scarcely adopted due to its complex…

Machine Learning · Computer Science 2022-06-13 Kenan Šehić , Alexandre Gramfort , Joseph Salmon , Luigi Nardi

We present a novel Bayesian approach for high-dimensional grouped regression under sparsity. We leverage a sparse projection method that uses a sparsity-inducing map to derive an induced posterior on a lower-dimensional parameter space. Our…

Methodology · Statistics 2026-05-25 Samhita Pal , Subhashis Ghosal

We study the asymptotic properties of Lasso+mLS and Lasso+Ridge under the sparse high-dimensional linear regression model: Lasso selecting predictors and then modified Least Squares (mLS) or Ridge estimating their coefficients. First, we…

Statistics Theory · Mathematics 2014-01-14 Hanzhong Liu , Bin Yu

Bayesian shrinkage methods have generated a lot of recent interest as tools for high-dimensional regression and model selection. These methods naturally facilitate tractable uncertainty quantification and incorporation of prior information.…

Computation · Statistics 2017-04-17 Bala Rajaratnam , Doug Sparks , Kshitij Khare , Liyuan Zhang

Theoretical results show that Bayesian methods can achieve lower bounds on regret for online logistic regression. In practice, however, such techniques may not be feasible especially for very large feature sets. Various approximations that,…

Machine Learning · Computer Science 2021-01-29 Gil I. Shamir , Wojciech Szpankowski

In this paper, we introduce ``UniLasso'' -- a novel statistical method for sparse regression. This two-stage approach preserves the signs of the univariate coefficients and leverages their magnitude. Both of these properties are attractive…

Methodology · Statistics 2025-06-26 Sourav Chatterjee , Trevor Hastie , Robert Tibshirani

When we are interested in high-dimensional system and focus on classification performance, the $\ell_{1}$-penalized logistic regression is becoming important and popular. However, the Lasso estimates could be problematic when penalties of…

Machine Learning · Statistics 2020-06-12 Huamei Huang , Yujing Gao , Huiming Zhang , Bo Li

We consider the sparse regression model where the number of parameters $p$ is larger than the sample size $n$. The difficulty when considering high-dimensional problems is to propose estimators achieving a good compromise between…

Statistics Theory · Mathematics 2011-03-15 Pierre Alquier , Karim Lounici

Lasso is a celebrated method for variable selection in linear models, but it faces challenges when the variables are moderately or strongly correlated. This motivates alternative approaches such as using a non-convex penalty, adding a ridge…

Statistics Theory · Mathematics 2022-03-30 Zheng Tracy Ke , Longlin Wang

In recent years a number of methods have been developed for automatically learning the (sparse) connectivity structure of Markov Random Fields. These methods are mostly based on L1-regularized optimization which has a number of…

Machine Learning · Computer Science 2014-08-12 Yutian Chen , Max Welling

Bagging, a powerful ensemble method from machine learning, improves the performance of unstable predictors. Although the power of Bagging has been shown mostly in classification problems, we demonstrate the success of employing Bagging in…

Machine Learning · Statistics 2019-05-03 Luoluo Liu , Sang Peter Chin , Trac D. Tran

In recent years a number of methods have been developed for automatically learning the (sparse) connectivity structure of Markov Random Fields. These methods are mostly based on L1-regularized optimization which has a number of…

Machine Learning · Statistics 2012-06-26 Yutian Chen , Max Welling

We investigate the frequentist properties of Bayesian procedures for estimation based on the horseshoe prior in the sparse multivariate normal means model. Previous theoretical results assumed that the sparsity level, that is, the number of…

Statistics Theory · Mathematics 2017-02-14 Stéphanie van der Pas , Botond Szabó , Aad van der Vaart

This work considers variational Bayesian inference as an inexpensive and scalable alternative to a fully Bayesian approach in the context of sparsity-promoting priors. In particular, the priors considered arise from scale mixtures of Normal…

Computation · Statistics 2022-11-01 Kody J. H. Law , Vitaly Zankin

Common high-dimensional methods for prediction rely on having either a sparse signal model, a model in which most parameters are zero and there are a small number of non-zero parameters that are large in magnitude, or a dense signal model,…

Methodology · Statistics 2017-09-29 Victor Chernozhukov , Christian Hansen , Yuan Liao

In sparse Bayesian learning (SBL), Gaussian scale mixtures (GSMs) have been used to model sparsity-inducing priors that realize a class of concave penalty functions for the regression task in real-valued signal models. Motivated by the…

Data irregularity in cancer genomics studies has been widely observed in the form of outliers and heavy-tailed distributions in the complex traits. In the past decade, robust variable selection methods have emerged as powerful alternatives…

Methodology · Statistics 2024-05-14 Yuwen Liu , Jie Ren , Shuangge Ma , Cen Wu

We consider a linear regression problem in a high dimensional setting where the number of covariates $p$ can be much larger than the sample size $n$. In such a situation, one often assumes sparsity of the regression vector, \textit i.e.,…

Statistics Theory · Mathematics 2011-10-12 Mohamed Hebiri , Sara A. Van De Geer