English
Related papers

Related papers: Sparse Group Lasso: Optimal Sample Complexity, Con…

200 papers

In this paper, we consider the Group Lasso estimator of the covariance matrix of a stochastic process corrupted by an additive noise. We propose to estimate the covariance matrix in a high-dimensional setting under the assumption that the…

Statistics Theory · Mathematics 2011-10-26 Jérémie Bigot , Rolando Biscay , Jean-Michel Loubes , Lilian Muniz Alvarez

We introduce and study the Group Square-Root Lasso (GSRL) method for estimation in high dimensional sparse regression models with group structure. The new estimator minimizes the square root of the residual sum of squares plus a penalty…

Statistics Theory · Mathematics 2013-08-01 Florentina Bunea , Johannes Lederer , Yiyuan She

We propose a Machine Learning approach for optimal macroeconomic density forecasting in a high-dimensional setting where the underlying model exhibits a known group structure. Our approach is general enough to encompass specific forecasting…

Econometrics · Economics 2024-11-18 Matteo Mogliani , Anna Simoni

This paper studies the sensitivity to the observations of the block/group Lasso solution to an overdetermined linear regression model. Such a regularization is known to promote sparsity patterns structured as nonoverlapping groups of…

Statistics Theory · Mathematics 2012-05-09 Samuel Vaiter , Charles Deledalle , Gabriel Peyré , Jalal Fadili , Charles Dossal

In this paper, we study the problem of sparse mixed linear regression on an unlabeled dataset that is generated from linear measurements from two different regression parameter vectors. Since the data is unlabeled, our task is not only to…

Machine Learning · Computer Science 2022-09-12 Adarsh Barik , Jean Honorio

We consider estimation in a high-dimensional linear model with strongly correlated variables. We propose to cluster the variables first and do subsequent sparse estimation such as the Lasso for cluster-representatives or the group Lasso…

Methodology · Statistics 2015-01-14 Peter Bühlmann , Philipp Rütimann , Sara van de Geer , Cun-Hui Zhang

In this paper, we propose a new method for estimation and constructing confidence intervals for low-dimensional components in a high-dimensional model. The proposed estimator, called Constrained Lasso (CLasso) estimator, is obtained by…

Methodology · Statistics 2017-04-19 Yun Yang

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical…

Machine Learning · Computer Science 2015-08-25 Rémi Gribonval , Rodolphe Jenatton , Francis Bach

The paper considers a linear model with grouped explanatory variables. If the model errors are not with zero mean and bounded variance or if model contains outliers, then the least squares framework is not appropriate. Thus, the quantile…

Statistics Theory · Mathematics 2016-07-14 Gabriela Ciuperca

Many models for sparse regression typically assume that the covariates are known completely, and without noise. Particularly in high-dimensional applications, this is often not the case. This paper develops efficient OMP-like algorithms to…

Statistics Theory · Mathematics 2015-03-31 Yudong Chen , Constantine Caramanis

Sparse linear regression methods including the well-known LASSO and the Dantzig selector have become ubiquitous in the engineering practice, including in medical imaging. Among other tasks, they have been successfully applied for the…

Signal Processing · Electrical Eng. & Systems 2023-01-03 Anna Pidnebesna , Iveta Fajnerova , Jiri Horacek , Jaroslav Hlinka

We develop tools for selective inference in the setting of group sparsity, including the construction of confidence intervals and p-values for testing selected groups of variables. Our main technical result gives the precise distribution of…

Methodology · Statistics 2016-07-28 Fan Yang , Rina Foygel Barber , Prateek Jain , John Lafferty

Sparse feature selection has been demonstrated to be effective in handling high-dimensional data. While promising, most of the existing works use convex methods, which may be suboptimal in terms of the accuracy of feature selection and…

Machine Learning · Computer Science 2013-01-22 Shuo Xiang , Xiaotong Shen , Jieping Ye

We present a novel Bayesian approach for high-dimensional grouped regression under sparsity. We leverage a sparse projection method that uses a sparsity-inducing map to derive an induced posterior on a lower-dimensional parameter space. Our…

Methodology · Statistics 2026-05-25 Samhita Pal , Subhashis Ghosal

The sparse modeling is an evident manifestation capturing the parsimony principle just described, and sparse models are widespread in statistics, physics, information sciences, neuroscience, computational mathematics, and so on. In…

Machine Learning · Computer Science 2023-08-29 Jianyi Lin

In this paper, we study problem of estimating a sparse regression vector with correct support in the presence of outlier samples. The inconsistency of lasso-type methods is well known in this scenario. We propose a combinatorial version of…

Machine Learning · Computer Science 2023-06-23 Adarsh Barik , Jean Honorio

The problem of sparse linear regression is relevant in the context of linear system identification from large datasets. When data are collected from real-world experiments, measurements are always affected by perturbations or low-precision…

Optimization and Control · Mathematics 2020-04-01 S. M. Fosson , V. Cerone , D. Regruto

Sparse regression is frequently employed in diverse scientific settings as a feature selection method. A pervasive aspect of scientific data that hampers both feature selection and estimation is the presence of strong correlations between…

Methodology · Statistics 2021-03-25 Ankit Kumar , Sharmodeep Bhattacharyya , Kristofer Bouchard

We study sparse linear regression over a network of agents, modeled as an undirected graph (with no centralized node). The estimation problem is formulated as the minimization of the sum of the local LASSO loss functions plus a quadratic…

Machine Learning · Computer Science 2023-06-23 Yao Ji , Gesualdo Scutari , Ying Sun , Harsha Honnappa

The Lasso is one of the most important approaches for parameter estimation and variable selection in high dimensional linear regression. At the heart of its success is the attractive rate of convergence result even when $p$, the dimension…

Statistics Theory · Mathematics 2019-08-09 Junlong Zhao , Chenlei Leng
‹ Prev 1 3 4 5 6 7 10 Next ›