中文
相关论文

相关论文: Support recovery and sup-norm convergence rates fo…

200 篇论文

We study the problem of estimating high-dimensional regression models regularized by a structured sparsity-inducing penalty that encodes prior structural information on either the input or output variables. We consider two widely adopted…

机器学习 · 统计学 2012-07-02 Xi Chen , Qihang Lin , Seyoung Kim , Jaime G. Carbonell , Eric P. Xing

We study a family of sparse estimators defined as minimizers of some empirical Lipschitz loss function -- which include the hinge loss, the logistic loss and the quantile regression loss -- with a convex, sparse or group-sparse…

机器学习 · 统计学 2021-09-23 Antoine Dedieu

Many statistical $M$-estimators are based on convex optimization problems formed by the combination of a data-dependent loss function with a norm-based regularizer. We analyze the convergence rates of projected gradient and composite…

机器学习 · 统计学 2012-07-26 Alekh Agarwal , Sahand N. Negahban , Martin J. Wainwright

Estimating covariance matrices with high-dimensional complex data presents significant challenges, particularly concerning positive definiteness, sparsity, and numerical stability. Existing robust sparse estimators often fail to guarantee…

统计方法学 · 统计学 2025-12-30 Shaoxin Wang , Ziyun Ma

We study unconstrained optimization problems with nonsmooth and convex objective function in the form of a mathematical expectation. The proposed method approximates the expected objective function with a sample average function using…

最优化与控制 · 数学 2022-11-03 Natasa Krejic , Natasa Krklec Jerinkic , Tijana Ostojic

We present a sparse analogue to stochastic gradient descent that is guaranteed to perform well under similar conditions to the lasso. In the linear regression setup with irrepresentable noise features, our algorithm recovers the support set…

统计理论 · 数学 2014-12-16 Jacob Steinhardt , Stefan Wager , Percy Liang

We propose a new method of learning a sparse nonnegative-definite target matrix. Our primary example of the target matrix is the inverse of a population covariance or correlation matrix. The algorithm first estimates each column of the…

统计理论 · 数学 2013-10-15 Tingni Sun , Cun-Hui Zhang

We introduce and study the Group Square-Root Lasso (GSRL) method for estimation in high dimensional sparse regression models with group structure. The new estimator minimizes the square root of the residual sum of squares plus a penalty…

统计理论 · 数学 2013-08-01 Florentina Bunea , Johannes Lederer , Yiyuan She

This paper studies well-posedness and parameter sensitivity of the Square Root LASSO (SR-LASSO), an optimization model for recovering sparse solutions to linear inverse problems in finite dimension. An advantage of the SR-LASSO (e.g., over…

最优化与控制 · 数学 2024-04-01 Aaron Berk , Simone Brugiapaglia , Tim Hoheisel

This paper is concerned with high-dimensional panel data models where the number of regressors can be much larger than the sample size. Under the assumption that the true parameter vector is sparse we propose a panel-Lasso estimator and…

统计理论 · 数学 2014-02-14 Anders Bredahl Kock

Compared with digital methods, sparse recovery based on spiking neural networks has great advantages like high computational efficiency and low power-consumption. However, current spiking algorithms cannot guarantee more accurate estimates…

信号处理 · 电气工程与系统科学 2020-09-22 Xiang Zhang , Lei Yu , Gang Zheng

We propose a method to reconstruct sparse signals degraded by a nonlinear distortion and acquired at a limited sampling rate. Our method formulates the reconstruction problem as a nonconvex minimization of the sum of a data fitting term and…

最优化与控制 · 数学 2023-01-19 Arthur Marmin , Marc Castella , Jean-Christophe Pesquet , Laurent Duval

Recent results have proven the minimax optimality of LASSO and related algorithms for noisy linear regression. However, these results tend to rely on variance estimators that are inefficient or optimizations that are slower than LASSO…

统计理论 · 数学 2019-03-18 Christopher Kennedy , Rachel Ward

This paper proposes a multi-stage projection-based Lasso procedure for the semiparametric sample selection model in high-dimensional settings under a weak nonparametric restriction on the selection correction. In particular, the number of…

统计理论 · 数学 2014-11-13 Ying Zhu

In this article we study post-model selection estimators that apply ordinary least squares (OLS) to the model selected by first-step penalized estimators, typically Lasso. It is well known that Lasso can estimate the nonparametric…

统计理论 · 数学 2013-03-21 Alexandre Belloni , Victor Chernozhukov

Sparse regularization is a central technique for both machine learning (to achieve supervised features selection or unsupervised mixture learning) and imaging sciences (to achieve super-resolution). Existing performance guaranties assume a…

信息论 · 计算机科学 2018-10-09 Clarice Poon , Nicolas Keriven , Gabriel Peyré

Sparse regression and classification estimators that respect group structures have application to an assortment of statistical and machine learning problems, from multitask learning to sparse additive modeling to hierarchical selection.…

统计方法学 · 统计学 2024-03-11 Ryan Thompson , Farshid Vahid

We consider a distributed learning setup where a sparse signal is estimated over a network. Our main interest is to save communication resource for information exchange over the network and reduce processing time. Each node of the network…

机器学习 · 统计学 2018-04-03 Ahmed Zaki , Saikat Chatterjee , Partha P. Mitra , Lars K. Rasmussen

Learning sparse models from data is an important task in all those frameworks where relevant information should be identified within a large dataset. This can be achieved by formulating and solving suitable sparsity promoting optimization…

最优化与控制 · 数学 2025-02-18 V. Cerone , S. M. Fosson , D. Regruto , A. Salam

We propose methodology for estimation of sparse precision matrices and statistical inference for their low-dimensional parameters in a high-dimensional setting where the number of parameters $p$ can be much larger than the sample size. We…

统计理论 · 数学 2016-07-21 Jana Janková , Sara van de Geer