中文
相关论文

相关论文: An iterative hard thresholding estimator for low r…

200 篇论文

We study the problem of recovery of matrices that are simultaneously low rank and row and/or column sparse. Such matrices appear in recent applications in cognitive neuroscience, imaging, computer vision, macroeconomics, and genetics. We…

机器学习 · 统计学 2019-04-11 Ming Yu , Varun Gupta , Mladen Kolar

Iterative refinement is particularly popular for numerical solution of linear systems of equations. We extend it to Low Rank Approximation of a matrix (LRA) and observe close link of the resulting algorithm to oversampling techniques,…

数值分析 · 数学 2024-11-28 Victor Y. Pan , Qi Luan , Soo Go

We propose methodology for estimation of sparse precision matrices and statistical inference for their low-dimensional parameters in a high-dimensional setting where the number of parameters $p$ can be much larger than the sample size. We…

统计理论 · 数学 2016-07-21 Jana Janková , Sara van de Geer

We propose a unified framework for estimating low-rank matrices through nonconvex optimization based on gradient descent algorithm. Our framework is quite general and can be applied to both noisy and noiseless observations. In the general…

机器学习 · 统计学 2016-10-18 Lingxiao Wang , Xiao Zhang , Quanquan Gu

This paper proposes a new method for estimating sparse precision matrices in the high dimensional setting. It has been popular to study fast computation and adaptive procedures for this problem. We propose a novel approach, called Sparse…

统计方法学 · 统计学 2016-12-23 Weidong Liu , Xi Luo

We study high-dimensional covariance/precision matrix estimation under the assumption that the covariance/precision matrix can be decomposed into a low-rank component L and a diagonal component D. The rank of L can either be chosen to be…

统计方法学 · 统计学 2018-02-19 Yilei Wu , Yingli Qin , Mu Zhu

Compressed sensing is a technique to sample compressible signals below the Nyquist rate, whilst still allowing near optimal reconstruction of the signal. In this paper we present a theoretical analysis of the iterative hard thresholding…

信息论 · 计算机科学 2008-05-06 Thomas Blumensath , Mike E. Davies

This paper studies the matrix completion problem under arbitrary sampling schemes. We propose a new estimator incorporating both max-norm and nuclear-norm regularization, based on which we can conduct efficient low-rank matrix recovery…

机器学习 · 统计学 2016-09-27 Ethan X. Fang , Han Liu , Kim-Chuan Toh , Wen-Xin Zhou

In this paper, we develop an efficient numerical solver for unsteady diffusion-type partial differential equations with random coefficients. A major computational challenge in such problems lies in repeatedly handling large-scale linear…

数值分析 · 数学 2026-01-19 Yujun Zhu , Min Li , Yulan Ning , Ju Ming

In this paper, we analyze the generalization performance of the Iterative Hard Thresholding (IHT) algorithm widely used for sparse recovery problems. The parameter estimation and sparsity recovery consistency of IHT has long been known in…

机器学习 · 统计学 2022-03-18 Xiao-Tong Yuan , Ping Li

Low rank approximation is an important tool used in many applications of signal processing and machine learning. Recently, randomized sketching algorithms were proposed to effectively construct low rank approximations and obtain approximate…

信息论 · 计算机科学 2018-09-11 Shashanka Ubaru , Arya Mazumdar , Yousef Saad

The task of reconstructing a low rank matrix from incomplete linear measurements arises in areas such as machine learning, quantum state tomography and in the phase retrieval problem. In this note, we study the particular setup that the…

信息论 · 计算机科学 2016-12-12 Holger Rauhut , Ulrich Terstiege

Learning generative probabilistic models is a core problem in machine learning, which presents significant challenges due to the curse of dimensionality. This paper proposes a joint dimensionality reduction and non-parametric density…

机器学习 · 统计学 2022-06-22 Magda Amiridi , Nikos Kargas , Nicholas D. Sidiropoulos

In this paper we consider the trace regression model. Assume that we observe a small set of entries or linear combinations of entries of an unknown matrix $A_0$ corrupted by noise. We propose a new rank penalized estimator of $A_0$. For…

统计理论 · 数学 2011-09-14 Olga Klopp

Low rank matrix approximation is a popular topic in machine learning. In this paper, we propose a new algorithm for this topic by minimizing the least-squares estimation over the Riemannian manifold of fixed-rank matrices. The algorithm is…

机器学习 · 计算机科学 2022-02-15 Qianqian Song

This paper considers the problem of robustly estimating a structured covariance matrix with an elliptical underlying distribution with known mean. In applications where the covariance matrix naturally possesses a certain structure, taking…

应用统计 · 统计学 2016-06-29 Ying Sun , Prabhu Babu , Daniel P. Palomar

We study low-rank matrix trace regression and the related problem of low-rank matrix bandits. Assuming access to the distribution of the covariates, we propose a novel low-rank matrix estimation method called LowPopArt and provide its…

机器学习 · 统计学 2024-06-11 Kyoungseok Jang , Chicheng Zhang , Kwang-Sung Jun

We study the recovery of low-rank Hermitian matrices from rank-one measurements obtained by uniform sampling from complex projective 3-designs, using nuclear-norm minimization. This framework includes phase retrieval as a special case via…

信息论 · 计算机科学 2025-12-15 Timm Gilles

We consider the matrix completion problem under a form of row/column weighted entrywise sampling, including the case of uniform entrywise sampling as a special case. We analyze the associated random observation operator, and prove that with…

信息论 · 计算机科学 2011-05-17 Sahand Negahban , Martin J. Wainwright

We consider the problem of estimating the uncertainty in statistical inverse problems using Bayesian inference. When the probability density of the noise and the prior are Gaussian, the solution of such a statistical inverse problem is also…

数值分析 · 数学 2018-07-20 Peter Benner , Yue Qiu , Martin Stoll