中文
相关论文

相关论文: Sharp thresholds for high-dimensional and noisy re…

200 篇论文

This paper considers the problem of estimating an unknown high dimensional signal from noisy linear measurements, {when} the signal is assumed to possess a \emph{group-sparse} structure in a {known,} fixed dictionary. We consider signals…

We propose a self-tuning $\sqrt{\mathrm {Lasso}}$ method that simultaneously resolves three important practical problems in high-dimensional regression analysis, namely it handles the unknown scale, heteroscedasticity and (drastic)…

统计方法学 · 统计学 2014-05-27 Alexandre Belloni , Victor Chernozhukov , Lie Wang

The lasso and related sparsity inducing algorithms have been the target of substantial theoretical and applied research. Correspondingly, many results are known about their behavior for a fixed or optimally chosen tuning parameter specified…

统计理论 · 数学 2016-06-23 Darren Homrighausen , Daniel J. McDonald

We develop and analyze stochastic optimization algorithms for problems in which the expected loss is strongly convex, and the optimum is (approximately) sparse. Previous approaches are able to exploit only one of these two structures,…

机器学习 · 统计学 2012-07-19 Alekh Agarwal , Sahand Negahban , Martin J. Wainwright

Recent findings by Jahn, T. Ullrich, Voigtlaender [10] relate non-linear sampling numbers for the square norm to quantities involving trigonometric best $m-$term approximation errors in the uniform norm. Here we establish new results for…

数值分析 · 数学 2024-07-24 Moritz Moeller , Serhii Stasyuk , Tino Ullrich

The iterations of many sparse estimation algorithms are comprised of a fixed linear filter cascaded with a thresholding nonlinearity, which collectively resemble a typical neural network layer. Consequently, a lengthy sequence of algorithm…

机器学习 · 计算机科学 2016-05-11 Bo Xin , Yizhou Wang , Wen Gao , David Wipf

Lower dimensional signal representation schemes frequently assume that the signal of interest lies in a single vector space. In the context of the recently developed theory of compressive sensing (CS), it is often assumed that the signal of…

信息论 · 计算机科学 2014-03-18 Thakshila Wimalajeewa , Yonina C. Eldar , Pramod K. Varshney

We address the issue of estimating the regression vector $\beta$ in the generic $s$-sparse linear model $y = X\beta+z$, with $\beta\in\R^{p}$, $y\in\R^{n}$, $z\sim\mathcal N(0,\sg^2 I)$ and $p> n$ when the variance $\sg^{2}$ is unknown. We…

统计理论 · 数学 2012-11-06 Stéphane Chrétien , Sébastien Darses

We consider the least-square linear regression problem with regularization by the $\ell^1$-norm, a problem usually referred to as the Lasso. In this paper, we first present a detailed asymptotic analysis of model consistency of the Lasso in…

机器学习 · 计算机科学 2009-01-22 Francis Bach

This paper addresses the problem of identifying sparse linear time-invariant (LTI) systems from a single sample trajectory generated by the system dynamics. We introduce a Lasso-like estimator for the parameters of the system, taking into…

系统与控制 · 计算机科学 2019-04-23 Salar Fattahi , Nikolai Matni , Somayeh Sojoudi

Recovering a sparse signal from outlier-contaminated measurements is a fundamental challenge in many applications. While existing algorithms predominantly address scenarios with bounded noise or assume known signal sparsity, few methods…

信息论 · 计算机科学 2026-03-09 Jiao Xu , Peng Li , Bing Zheng

We give oracle inequalities on procedures which combines quantization and variable selection via a weighted Lasso $k$-means type algorithm. The results are derived for a general family of weights, which can be tuned to size the influence of…

统计理论 · 数学 2016-07-07 Clément Levrard

The performance of estimating the common support for jointly sparse signals based on their projections onto lower-dimensional space is analyzed. Support recovery is formulated as a multiple-hypothesis testing problem. Both upper and lower…

信息论 · 计算机科学 2009-11-05 Gongguo Tang , Arye Nehorai

In this paper, we study the number of measurements required to recover a sparse signal in ${\mathbb C}^M$ with $L$ non-zero coefficients from compressed samples in the presence of noise. For a number of different recovery criteria, we prove…

信息论 · 计算机科学 2007-11-05 Mehmet Akçakaya , Vahid Tarokh

In this paper, we develop verifiable and computable performance analysis of sparsity recovery. We define a family of goodness measures for arbitrary sensing matrices as a set of optimization problems, and design algorithms with a…

信息论 · 计算机科学 2011-10-06 Gongguo Tang , Arye Nehorai

In high-dimensions, many variable selection methods, such as the lasso, are often limited by excessive variability and rank deficiency of the sample covariance matrix. Covariance sparsity is a natural phenomenon in high-dimensional…

统计方法学 · 统计学 2010-06-08 X. Jessie Jeng And Z. John Daye

In inverse problems, it is widely recognized that the incorporation of a sparsity prior yields a regularization effect on the solution. This approach is grounded on the a priori assumption that the unknown can be appropriately represented…

机器学习 · 统计学 2025-06-13 Giovanni S. Alberti , Luca Ratti , Matteo Santacesaria , Silvia Sciutto

We formulate sparse support recovery as a salient set identification problem and use information-theoretic analyses to characterize the recovery performance and sample complexity. We consider a very general model where we are not restricted…

信息论 · 计算机科学 2014-03-14 Cem Aksoylar , Venkatesh Saligrama

In this paper we study the problem of recovering sparse or compressible signals from uniformly quantized measurements. We present a new class of convex optimization programs, or decoders, coined Basis Pursuit DeQuantizer of moment $p$…

最优化与控制 · 数学 2015-03-13 Laurent Jacques , David K. Hammond , M. Jalal Fadili

We consider the demixing problem of two (or more) high-dimensional vectors from nonlinear observations when the number of such observations is far less than the ambient dimension of the underlying vectors. Specifically, we demonstrate an…

机器学习 · 统计学 2017-01-25 Mohammadreza Soltani , Chinmay Hegde