中文
相关论文

相关论文: Compressed Regression

200 篇论文

Compressive sensing (CS) exploits sparsity to recover sparse or compressible signals from dimensionality reducing, non-adaptive sensing mechanisms. Sparsity is also used to enhance interpretability in machine learning and statistics…

信息论 · 计算机科学 2015-07-21 Anastasios Kyrillidis , Luca Baldassarre , Marwa El-Halabi , Quoc Tran-Dinh , Volkan Cevher

In this paper, we investigate the theoretical guarantees of penalized $\lun$ minimization (also called Basis Pursuit Denoising or Lasso) in terms of sparsity pattern recovery (support and sign consistency) from noisy measurements with…

信息论 · 计算机科学 2011-09-13 Charles Dossal , Marie-Line Chabanol , Gabriel Peyré , Jalal Fadili

Many conventional statistical procedures are extremely sensitive to seemingly minor deviations from modeling assumptions. This problem is exacerbated in modern high-dimensional settings, where the problem dimension can grow with and…

机器学习 · 统计学 2017-02-27 Simon S. Du , Sivaraman Balakrishnan , Aarti Singh

The field of compressed sensing has shown that a sparse but otherwise arbitrary vector can be recovered exactly from a small number of randomly constructed linear projections (or samples). The question addressed in this paper is whether an…

信息论 · 计算机科学 2010-01-26 Galen Reeves , Michael Gastpar

We analyze a practical algorithm for sparse PCA on incomplete and noisy data under a general non-random sampling scheme. The algorithm is based on a semidefinite relaxation of the $\ell_1$-regularized PCA problem. We provide theoretical…

机器学习 · 统计学 2023-02-06 Hanbyul Lee , Qifan Song , Jean Honorio

The constrained $\ell_p^p/\ell_q^p$ ratio model is scale invariant and is therefore attractive for sparse signal recovery. However, its nonconvex, nonsmooth, and fractional structure makes a unified theoretical and algorithmic analysis…

最优化与控制 · 数学 2026-05-26 Lang Yu , Nan-jing Huang

We consider the problem of detecting the locations of targets in the far field by sending probing signals from an antenna array and recording the reflected echoes. Drawing on key concepts from the area of compressive sensing, we use an…

信息论 · 计算机科学 2013-04-25 Max Hügel , Holger Rauhut , Thomas Strohmer

Estimation problems with constrained parameter spaces arise in various settings. In many of these problems, the observations available to the statistician can be modelled as arising from the noisy realization of the image of a random linear…

统计理论 · 数学 2023-03-23 Reese Pathak , Martin J. Wainwright , Lin Xiao

Compressed sensing has shown that it is possible to reconstruct sparse high dimensional signals from few linear measurements. In many cases, the solution can be obtained by solving an L1-minimization problem, and this method is accurate…

数值分析 · 数学 2009-04-27 Deanna Needell

Sparse regression is frequently employed in diverse scientific settings as a feature selection method. A pervasive aspect of scientific data that hampers both feature selection and estimation is the presence of strong correlations between…

统计方法学 · 统计学 2021-03-25 Ankit Kumar , Sharmodeep Bhattacharyya , Kristofer Bouchard

This paper studies sparse linear regression analysis with outliers in the responses. A parameter vector for modeling outliers is added to the standard linear regression model and then the sparse estimation problem for both coefficients and…

统计理论 · 数学 2015-05-21 Shota Katayama , Hironori Fujisawa

Although the standard formulations of prediction problems involve fully-observed and noiseless data drawn in an i.i.d. manner, many applications involve noisy and/or missing data, possibly involving dependence, as well. We study these…

统计理论 · 数学 2015-03-19 Po-Ling Loh , Martin J. Wainwright

As in standard linear regression, in truncated linear regression, we are given access to observations $(A_i, y_i)_i$ whose dependent variable equals $y_i= A_i^{\rm T} \cdot x^* + \eta_i$, where $x^*$ is some fixed unknown vector of interest…

机器学习 · 计算机科学 2020-07-30 Constantinos Daskalakis , Dhruv Rohatgi , Manolis Zampetakis

We study the recovery of sparse vectors from subsampled random convolutions via $\ell_1$-minimization. We consider the setup in which both the subsampling locations as well as the generating vector are chosen at random. For a subgaussian…

信息论 · 计算机科学 2018-03-28 Shahar Mendelson , Holger Rauhut , Rachel Ward

In this paper we discuss the variable selection method from \ell0-norm constrained regression, which is equivalent to the problem of finding the best subset of a fixed size. Our study focuses on two aspects, consistency and computation. We…

统计方法学 · 统计学 2013-03-20 Shifeng Xiong

This paper surveys recent work in applying ideas from graphical models and message passing algorithms to solve large scale regularized regression problems. In particular, the focus is on compressed sensing reconstruction via ell_1 penalized…

信息论 · 计算机科学 2015-03-17 Andrea Montanari

In regression analysis of multivariate data, it is tacitly assumed that response and predictor variables in each observed response-predictor pair correspond to the same entity or unit. In this paper, we consider the situation of "permuted…

统计理论 · 数学 2017-11-17 Martin Slawski , Emanuel Ben-David

In this paper, we review state-of-the-art methods for feature selection in statistics with an application-oriented eye. Indeed, sparsity is a valuable property and the profusion of research on the topic might have provided little guidance…

统计方法学 · 统计学 2021-11-08 Dimitris Bertsimas , Jean Pauphilet , Bart Van Parys

From a numerical analysis perspective, assessing the robustness of l1-minimization is a fundamental issue in compressed sensing and sparse regularization. Yet, the recovery guarantees available in the literature usually depend on a priori…

数值分析 · 数学 2017-05-10 Simone Brugiapaglia , Ben Adcock , Richard K. Archibald

In compressed sensing, one wishes to acquire an approximately sparse high-dimensional signal $x\in\mathbb{R}^n$ via $m\ll n$ noisy linear measurements, then later approximately recover $x$ given only those measurement outcomes. Various…

信息论 · 计算机科学 2016-06-07 Tom Morgan , Jelani Nelson