中文
相关论文

相关论文: Average case analysis of Lasso under ultra-sparse …

200 篇论文

We propose a class of greedy algorithms for weighted sparse recovery by considering new loss function-based generalizations of Orthogonal Matching Pursuit (OMP). Given a (regularized) loss function, the proposed algorithms alternate the…

信息论 · 计算机科学 2025-02-18 Sina Mohammad-Taheri , Simone Brugiapaglia

The fused lasso is an important method for signal processing when the hidden signals are sparse and blocky. It is often used in combination with the squared loss function. However, the squared loss is not suitable for heavy tail error…

统计方法学 · 统计学 2021-05-04 Xiaoli Gao

In this paper we consider regression problems subject to arbitrary noise in the operator or design matrix. This characterization appropriately models many physical phenomena with uncertainty in the regressors. Although the problem has been…

统计计算 · 统计学 2021-04-08 Richard J Clancy , Stephen Becker

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a limited number of noisy linear measurements is an important problem in compressed sensing. In the high-dimensional setting, it is known that recovery with a…

信息论 · 计算机科学 2012-06-26 Galen Reeves , Michael Gastpar

Consider a Bernoulli-Gaussian complex $n$-vector whose components are $V_i = X_i B_i$, with $X_i \sim \Cc\Nc(0,\Pc_x)$ and binary $B_i$ mutually independent and iid across $i$. This random $q$-sparse vector is multiplied by a square random…

信息论 · 计算机科学 2015-03-20 Antonia Tulino , Giuseppe Caire , Sergio Verdu' , Shlomo Shamai

Applying standard statistical methods after model selection may yield inefficient estimators and hypothesis tests that fail to achieve nominal type-I error rates. The main issue is the fact that the post-selection distribution of the data…

统计方法学 · 统计学 2019-05-23 Amit Meir , Mathias Drton

This paper investigates the problem of signal estimation from undersampled noisy sub-Gaussian measurements under the assumption of a cosparse model. Based on generalized notions of sparsity, we derive novel recovery guarantees for the…

信息论 · 计算机科学 2021-02-23 Martin Genzel , Gitta Kutyniok , Maximilian März

A multiple interval-valued linear regression model considering all the cross-relationships between the mids and spreads of the intervals has been introduced recently. A least-squares estimation of the regression parameters has been carried…

统计理论 · 数学 2016-02-09 Marta García Bárzana , Ana Colubi , Erricos John Kontoghiorghes

In this paper, we study the problem of signal estimation from noisy non-linear measurements when the unknown $n$-dimensional signal is in the range of an $L$-Lipschitz continuous generative model with bounded $k$-dimensional inputs. We make…

机器学习 · 统计学 2020-10-09 Zhaoqiang Liu , Jonathan Scarlett

The achievable and converse regions for sparse representation of white Gaussian noise based on an overcomplete dictionary are derived in the limit of large systems. Furthermore, the marginal distribution of such sparse representations is…

信息论 · 计算机科学 2017-02-13 Ori Shental

Many theoretical results for the lasso require the samples to be iid. Recent work has provided guarantees for the lasso assuming that the time series is generated by a sparse Vector Auto-Regressive (VAR) model with Gaussian innovations.…

统计理论 · 数学 2019-03-22 Kam Chung Wong , Zifan Li , Ambuj Tewari

We study the problem of exact support recovery based on noisy observations and present Refined Least Squares (RLS). Given a set of noisy measurement $$ \myvec{y} = \myvec{X}\myvec{\theta}^* + \myvec{\omega},$$ and $\myvec{X} \in…

统计理论 · 数学 2021-03-22 Ofir Lindenbaum , Stefan Steinerberger

The least-absolute shrinkage and selection operator (LASSO) is a regularization technique for estimating sparse signals of interest emerging in various applications and can be efficiently solved via the alternating direction method of…

信息论 · 计算机科学 2022-08-25 Huiyue Yi , Yan Xu , Wuxiong Zhang , Hui Xu

We analyze a practical algorithm for sparse PCA on incomplete and noisy data under a general non-random sampling scheme. The algorithm is based on a semidefinite relaxation of the $\ell_1$-regularized PCA problem. We provide theoretical…

机器学习 · 统计学 2023-02-06 Hanbyul Lee , Qifan Song , Jean Honorio

For high-dimensional omics data, sparsity-inducing regularization methods such as the Lasso are widely used and often yield strong predictive performance, even in settings when the assumption of sparsity is likely violated. We demonstrate…

统计方法学 · 统计学 2025-02-13 Andrea Bratsberg , Magne Thoresen , Jelle J. Goeman

In this note, we propose to use sparse methods (e.g. LASSO, Post-LASSO, sqrt-LASSO, and Post-sqrt-LASSO) to form first-stage predictions and estimate optimal instruments in linear instrumental variables (IV) models with many instruments in…

统计方法学 · 统计学 2017-10-05 Alexandre Belloni , Victor Chernozhukov , Christian Hansen

This paper suggests a nonparametric scheme to find the sparse solution of the underdetermined system of linear equations in the presence of unknown impulsive or non-Gaussian noise. This approach is robust against any variations of the noise…

计算机视觉与模式识别 · 计算机科学 2012-01-16 Mahmoud Ramezani Mayiami , Babak Seyfe

We present upper and lower bounds for the prediction error of the Lasso. For the case of random Gaussian design, we show that under mild conditions the prediction error of the Lasso is up to smaller order terms dominated by the prediction…

统计理论 · 数学 2018-04-04 Sara van de Geer

We propose a new algorithm for recovery of sparse signals from their compressively sensed samples. The proposed algorithm benefits from the strategy of gradual movement to estimate the positions of non-zero samples of sparse signal. We…

信息论 · 计算机科学 2012-04-04 Seyed Hossein Hosseini , Mahrokh G. Shayesteh

This paper considers the problem of robust adaptive efficient estimating of a periodic function in a continuous time regression model with the dependent noises given by a general square integrable semimartingale with a conditionally…

统计理论 · 数学 2019-09-24 Evgeny Pchelintsev , Serguei Pergamenshchikov