中文
相关论文

相关论文: Average case analysis of Lasso under ultra-sparse …

200 篇论文

In compressive sensing, sparse signals are recovered from underdetermined noisy linear observations. One of the interesting problems which attracted a lot of attention in recent times is the support recovery or sparsity pattern recovery…

信息论 · 计算机科学 2010-04-26 Subhojit Som , Lee C Potter

Performance of regularized least-squares estimation in noisy compressed sensing is analyzed in the limit when the dimensions of the measurement matrix grow large. The sensing matrix is considered to be from a class of random ensembles that…

信息论 · 计算机科学 2016-02-08 Mikko Vehkapera , Yoshiyuki Kabashima , Saikat Chatterjee

In this article we study post-model selection estimators that apply ordinary least squares (OLS) to the model selected by first-step penalized estimators, typically Lasso. It is well known that Lasso can estimate the nonparametric…

统计理论 · 数学 2013-03-21 Alexandre Belloni , Victor Chernozhukov

Performing statistical inference in high-dimension is an outstanding challenge. A major source of difficulty is the absence of precise information on the distribution of high-dimensional estimators. Here, we consider linear regression in…

统计理论 · 数学 2016-06-15 Adel Javanmard , Andrea Montanari

The network Lasso (nLasso) has been proposed recently as an efficient learning algorithm for massive networked data sets (big data over networks). It extends the well-known least absolute shrinkage and selection operator (Lasso) from…

机器学习 · 计算机科学 2019-07-24 Alexander Jung , Nguyen Tran

Discovering the partial differential equations underlying spatio-temporal datasets from very limited and highly noisy observations is of paramount interest in many scientific fields. However, it remains an open question to know when model…

机器学习 · 统计学 2021-10-06 Georges Tod , Gert-Jan Both , Remy Kusters

The lasso has become an important practical tool for high dimensional regression as well as the object of intense theoretical investigation. But despite the availability of efficient algorithms, the lasso remains computationally demanding…

统计理论 · 数学 2009-11-23 Christopher Genovese , Jiashun Jin , Larry Wasserman

We consider the model {eqnarray*}y=X\theta^*+\xi, Z=X+\Xi,{eqnarray*} where the random vector $y\in\mathbb{R}^n$ and the random $n\times p$ matrix $Z$ are observed, the $n\times p$ matrix $X$ is unknown, $\Xi$ is an $n\times p$ random noise…

统计理论 · 数学 2010-11-11 Mathieu Rosenbaum , Alexandre B. Tsybakov

We study the estimation capacity of the generalized Lasso, i.e., least squares minimization combined with a (convex) structural constraint. While Lasso-type estimators were originally designed for noisy linear regression problems, it has…

统计理论 · 数学 2019-09-12 Martin Genzel , Gitta Kutyniok

The least absolute shrinkage and selection operator (LASSO) of Tibshirani (1996) is a prominent estimator which selects significant (under some sense) features and kills insignificant ones. Indeed the LASSO shrinks features lager than a…

统计方法学 · 统计学 2016-12-20 B. Yuzbasi , M. Arashi

It is known that the Thresholded Lasso (TL), SCAD or MCP correct intrinsic estimation bias of the Lasso. In this paper we propose an alternative method of improving the Lasso for predictive models with general convex loss functions which…

For multiple index models, it has recently been shown that the sliced inverse regression (SIR) is consistent for estimating the sufficient dimension reduction (SDR) space if and only if $\rho=\lim\frac{p}{n}=0$, where $p$ is the dimension…

统计理论 · 数学 2018-06-19 Qian Lin , Zhigen Zhao , Jun S. Liu

This paper studies sparse super-resolution in arbitrary dimensions. More precisely, it develops a theoretical analysis of support recovery for the so-called BLASSO method, which is an off-the-grid generalisation of l1 regularization (also…

数值分析 · 数学 2017-09-12 Clarice Poon , Gabriel Peyré

We consider the problem of learning a graph modeling the statistical relations of the $d$ variables from a dataset with $n$ samples $X \in \mathbb{R}^{n \times d}$. Standard approaches amount to searching for a precision matrix $\Theta$…

机器学习 · 统计学 2023-12-13 Titouan Vayer , Etienne Lasalle , Rémi Gribonval , Paulo Gonçalves

A classical problem that arises in numerous signal processing applications asks for the reconstruction of an unknown, $k$-sparse signal $x_0\in R^n$ from underdetermined, noisy, linear measurements $y=Ax_0+z\in R^m$. One standard approach…

统计理论 · 数学 2015-02-18 Christos Thrampoulidis , Ashkan Panahi , Daniel Guo , Babak Hassibi

This paper provides novel results for the recovery of signals from undersampled measurements based on analysis $\ell_1$-minimization, when the analysis operator is given by a frame. We both provide so-called uniform and nonuniform recovery…

信息论 · 计算机科学 2014-11-04 Holger Rauhut , Maryia Kabanava

Blocking, a special case of rerandomization, is routinely implemented in the design stage of randomized experiments to balance the baseline covariates. This study proposes a regression adjustment method based on the least absolute shrinkage…

统计方法学 · 统计学 2024-11-15 Ke Zhu , Hanzhong Liu , Yuehan Yang

We give an efficient algorithm for finding sparse approximate solutions to linear systems of equations with nonnegative coefficients. Unlike most known results for sparse recovery, we do not require {\em any} assumption on the matrix other…

数据结构与算法 · 计算机科学 2015-01-09 Aditya Bhaskara , Ananda Theertha Suresh , Morteza Zadimoghaddam

Least Absolute Shrinkage and Selection Operator or the Lasso, introduced by Tibshirani (1996), is a popular estimation procedure in multiple linear regression when underlying design has a sparse structure, because of its property that it…

统计方法学 · 统计学 2017-10-31 Debraj Das , S. N. Lahiri

Sparse linear regression is one of the most basic questions in machine learning and statistics. Here, we are given as input a design matrix $X \in \mathbb{R}^{N \times d}$ and measurements or labels ${y} \in \mathbb{R}^N$ where ${y} = {X}…

机器学习 · 计算机科学 2025-11-11 Gautam Chandrasekaran , Raghu Meka , Konstantinos Stavropoulos