中文
相关论文

相关论文: Sparse Linear Regression with Constraints: A Flexi…

200 篇论文

We consider the problem of the recovery of a k-sparse vector from compressed linear measurements when data are corrupted by a quantization noise. When the number of measurements is not sufficiently large, different $k$-sparse solutions may…

最优化与控制 · 数学 2019-09-10 Vito Cerone , Sophie M. Fosson , Diego Regruto

We describe a probabilistic, {\it sublinear} runtime, measurement-optimal system for model-based sparse recovery problems through dimensionality reducing, {\em dense} random matrices. Specifically, we obtain a linear sketch $u\in \R^M$ of a…

信息论 · 计算机科学 2012-06-22 Anastasios Kyrillidis , Volkan Cevher

In this paper, we investigate the recovery of a sparse weight vector (parameters vector) from a set of noisy linear combinations. However, only partial information about the matrix representing the linear combinations is available. Assuming…

机器学习 · 计算机科学 2016-11-18 Ashkan Esmaeili , Arash Amini , Farokh Marvasti

The extensive need for computational resources poses a significant obstacle to deploying large-scale Deep Neural Networks (DNN) on devices with constrained resources. At the same time, studies have demonstrated that a significant number of…

机器学习 · 计算机科学 2024-08-27 Yehonathan Refael , Iftach Arbel , Wasim Huleihel

Sparse principal component analysis addresses the problem of finding a linear combination of the variables in a given data set with a sparse coefficients vector that maximizes the variability of the data. This model enhances the ability to…

最优化与控制 · 数学 2017-03-09 Amir Beck , Yakov Vaisbourd

Sliced inverse regression is a popular tool for sufficient dimension reduction, which replaces covariates with a minimal set of their linear combinations without loss of information on the conditional distribution of the response given the…

机器学习 · 统计学 2018-09-18 Kean Ming Tan , Zhaoran Wang , Tong Zhang , Han Liu , R. Dennis Cook

We propose a new class of nonconvex penalty functions, based on data depth functions, for multitask sparse penalized regression. These penalties quantify the relative position of rows of the coefficient matrix from a fixed distribution…

统计方法学 · 统计学 2018-05-08 Subhabrata Majumdar , Snigdhansu Chatterjee

This paper studies the problem of accurately recovering a sparse vector $\beta^{\star}$ from highly corrupted linear measurements $y = X \beta^{\star} + e^{\star} + w$ where $e^{\star}$ is a sparse error vector whose nonzero entries may be…

统计理论 · 数学 2015-03-19 Nam H. Nguyen , Trac D. Tran

In exact sparse optimization problems on Rd (also known as sparsity constrained problems), one looks for solution that have few nonzero components. In this paper, we consider problems where sparsity is exactly measured either by the…

最优化与控制 · 数学 2019-02-14 Jean-Philippe Chancelier , Michel De Lara , Ponts Paristech

In this paper, we consider the problem of obtaining the best $k$-sparse solution of $Ax=y$ subject to the constraint that the columns of $A$ are orthogonal. The naive approach for obtaining a solution to this problem has exponential…

其他统计学 · 统计学 2012-04-11 Phanindra V. Jampana , Sastry S. Challa

We propose a new sparse regression method called the component lasso, based on a simple idea. The method uses the connected-components structure of the sample covariance matrix to split the problem into smaller ones. It then solves the…

机器学习 · 统计学 2013-12-10 Nadine Hussami , Robert Tibshirani

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a small number of noisy linear measurements is an important problem in compressed sensing. In this paper, the high-dimensional setting is considered. It is shown…

信息论 · 计算机科学 2013-02-06 Galen Reeves , Michael Gastpar

We develop a Bayesian methodology aimed at simultaneously estimating low-rank and row-sparse matrices in a high-dimensional multiple-response linear regression model. We consider a carefully devised shrinkage prior on the matrix of…

统计方法学 · 统计学 2019-04-10 Antik Chakraborty , Anirban Bhattacharya , Bani K. Mallick

We present a novel feature selection technique, Sparse Linear Centroid-Encoder (SLCE). The algorithm uses a linear transformation to reconstruct a point as its class centroid and, at the same time, uses the $\ell_1$-norm penalty to filter…

机器学习 · 计算机科学 2023-06-12 Tomojit Ghosh , Michael Kirby , Karim Karimov

We propose a robust and efficient approach to the problem of compressive phase retrieval in which the goal is to reconstruct a sparse vector from the magnitude of a number of its linear measurements. The proposed framework relies on…

信息论 · 计算机科学 2015-10-28 Sohail Bahmani , Justin Romberg

In econometrics and finance, the vector error correction model (VECM) is an important time series model for cointegration analysis, which is used to estimate the long-run equilibrium variable relationships. The traditional analysis and…

机器学习 · 统计学 2017-10-17 Ziping Zhao , Daniel P. Palomar

Sufficient dimension reduction (SDR) is a popular tool in regression analysis, which replaces the original predictors with a minimal set of their linear combinations. However, the estimated linear combinations generally contain all original…

统计计算 · 统计学 2020-12-16 Lei Yan , Xin Chen

An algorithmic limit of compressed sensing or related variable-selection problems is analytically evaluated when a design matrix is given by an overcomplete random matrix. The replica method from statistical mechanics is employed to derive…

无序系统与神经网络 · 物理学 2018-11-14 Tomoyuki Obuchi , Yoshinori Nakanishi-Ohno , Masato Okada , Yoshiyuki Kabashima

We study the problem of recovering a hidden binary $k$-sparse $p$-dimensional vector $\beta$ from $n$ noisy linear observations $Y=X\beta+W$ where $X_{ij}$ are i.i.d. $\mathcal{N}(0,1)$ and $W_i$ are i.i.d. $\mathcal{N}(0,\sigma^2)$. A…

统计理论 · 数学 2019-03-13 Galen Reeves , Jiaming Xu , Ilias Zadik

We study parameter estimation and asymptotic inference for sparse nonlinear regression. More specifically, we assume the data are given by $y = f( x^\top \beta^* ) + \epsilon$, where $f$ is nonlinear. To recover $\beta^*$, we propose an…

机器学习 · 统计学 2015-11-17 Zhuoran Yang , Zhaoran Wang , Han Liu , Yonina C. Eldar , Tong Zhang