中文
相关论文

相关论文: An iterative hard thresholding estimator for low r…

200 篇论文

We consider the problem of recovering an unknown low-rank matrix X with (possibly) non-orthogonal, effectively sparse rank-1 decomposition from measurements y gathered in a linear measurement process A. We propose a variational formulation…

信息论 · 计算机科学 2023-06-13 Johannes Maly

We study the problem of estimating low-rank matrices from linear measurements (a.k.a., matrix sensing) through nonconvex optimization. We propose an efficient stochastic variance reduced gradient descent algorithm to solve a nonconvex…

机器学习 · 统计学 2017-01-17 Xiao Zhang , Lingxiao Wang , Quanquan Gu

We propose a general framework for reconstructing and denoising single entries of incomplete and noisy entries. We describe: effective algorithms for deciding if and entry can be reconstructed and, if so, for reconstructing and denoising…

机器学习 · 统计学 2013-04-02 Franz J. Király , Louis Theran

This paper studies stochastic minimization of a finite-sum loss $ F (\mathbf{x}) = \frac{1}{N} \sum_{\xi=1}^N f(\mathbf{x};\xi) $. In many real-world scenarios, the Hessian matrix of such objectives exhibits a low-rank structure on a batch…

最优化与控制 · 数学 2025-08-12 Yu Liu , Weibin Peng , Tianyu Wang , Jiajia Yu

In this study, we consider the numerical solution of large systems of linear equations obtained from the stochastic Galerkin formulation of stochastic partial differential equations. We propose an iterative algorithm that exploits the…

数值分析 · 数学 2016-05-18 Kookjin Lee , Howard C. Elman

High-dimensional inference refers to problems of statistical estimation in which the ambient dimension of the data may be comparable to or possibly even larger than the sample size. We study an instance of high-dimensional inference in…

统计理论 · 数学 2009-12-31 Sahand Negahban , Martin J. Wainwright

We present and analyze an efficient implementation of an iteratively reweighted least squares algorithm for recovering a matrix from a small number of linear measurements. The algorithm is designed for the simultaneous promotion of both a…

数值分析 · 数学 2011-07-19 Massimo Fornasier , Holger Rauhut , Rachel Ward

We propose methodology for statistical inference for low-dimensional parameters of sparse precision matrices in a high-dimensional setting. Our method leads to a non-sparse estimator of the precision matrix whose entries have a Gaussian…

统计理论 · 数学 2015-08-13 Jana Jankova , Sara van de Geer

We study matrix estimation problems arising in reinforcement learning (RL) with low-rank structure. In low-rank bandits, the matrix to be recovered specifies the expected arm rewards, and for low-rank Markov Decision Processes (MDPs), it…

机器学习 · 计算机科学 2023-10-31 Stefan Stojanovic , Yassir Jedra , Alexandre Proutiere

The problem of recovering a low-rank matrix from the linear constraints, known as affine matrix rank minimization problem, has been attracting extensive attention in recent years. In general, affine matrix rank minimization problem is a…

最优化与控制 · 数学 2020-01-31 Angang Cui , Jigen Peng , Haiyang Li

Estimating covariance matrices with high-dimensional complex data presents significant challenges, particularly concerning positive definiteness, sparsity, and numerical stability. Existing robust sparse estimators often fail to guarantee…

统计方法学 · 统计学 2025-12-30 Shaoxin Wang , Ziyun Ma

Suppose that we observe entries or, more generally, linear combinations of entries of an unknown $m\times T$-matrix $A$ corrupted by noise. We are particularly interested in the high-dimensional setting where the number $mT$ of unknown…

统计理论 · 数学 2011-05-16 Angelika Rohde , Alexandre B. Tsybakov

We consider robust low rank matrix estimation as a trace regression when outputs are contaminated by adversaries. The adversaries are allowed to add arbitrary values to arbitrary outputs. Such values can depend on any samples. We deal with…

机器学习 · 统计学 2024-05-27 Takeyuki Sasai , Hironori Fujisawa

Randomized algorithms have proven to perform well on a large class of numerical linear algebra problems. Their theoretical analysis is critical to provide guarantees on their behaviour, and in this sense, the stochastic analysis of the…

We characterize the first-order sensitivity of approximately recovering a low-rank matrix from linear measurements, a standard problem in compressed sensing. A special case covered by our analysis is approximating an incomplete matrix by a…

数值分析 · 数学 2024-07-02 Paul Breiding , Nick Vannieuwenhoven

We provide new approximation guarantees for greedy low rank matrix estimation under standard assumptions of restricted strong convexity and smoothness. Our novel analysis also uncovers previously unknown connections between the low rank…

机器学习 · 统计学 2017-03-09 Rajiv Khanna , Ethan Elenberg , Alexandros G. Dimakis , Sahand Negahban

The problem of structured matrix estimation has been studied mostly under strong noise dependence assumptions. This paper considers a general framework of noisy low-rank-plus-sparse matrix recovery, where the noise matrix may come from any…

机器学习 · 统计学 2025-04-07 Jinhang Chai , Jianqing Fan

Commonly employed reconstruction algorithms in compressed sensing (CS) use the $L_2$ norm as the metric for the residual error. However, it is well-known that least squares (LS) based estimators are highly sensitive to outliers present in…

信息论 · 计算机科学 2013-11-28 Rafael E. Carrillo , Kenneth E. Barner

Positive semi-definite matrices commonly occur as normal matrices of least squares problems in statistics or as kernel matrices in machine learning and approximation theory. They are typically large and dense. Thus algorithms to solve…

数值分析 · 数学 2020-12-01 Markus Hegland , Frank deHoog

This paper addresses the problem of identifying linear systems from noisy input-output trajectories. We introduce Thresholded Ho-Kalman, an algorithm that leverages a rank-adaptive procedure to estimate a Hankel-like matrix associated with…

系统与控制 · 电气工程与系统科学 2025-10-10 Frédéric Zheng , Yassir Jedra , Alexandre Proutière