中文
相关论文

相关论文: Minimax risk of matrix denoising by singular value…

200 篇论文

We prove an estimate on the smallest singular value of a multiplicatively and additively deformed random rectangular matrix. Suppose $n\le N \le M \le \Lambda N$ for some constant $\Lambda \ge 1$. Let $X$ be an $M\times n$ random matrix…

概率论 · 数学 2018-10-17 Fan Yang

Previous work regarding low-rank matrix recovery has concentrated on the scenarios in which the matrix is noise-free and the measurements are corrupted by noise. However, in practical application, the matrix itself is usually perturbed by…

信息论 · 计算机科学 2020-03-09 Jianwen Huang , Jianjun Wang , Feng Zhang , Hailin Wang , Wendong Wang

We obtain estimation error rates for estimators obtained by aggregation of regularized median-of-means tests, following a construction of Le Cam. The results hold with exponentially large probability -- as in the gaussian framework with…

统计理论 · 数学 2017-07-19 Lecué Guillaume , Lerasle Matthieu

We study alternating minimization for matrix completion in the simplest possible setting: completing a rank-one matrix from a revealed subset of the entries. We bound the asymptotic convergence rate by the variational characterization of…

机器学习 · 计算机科学 2020-08-13 Rui Liu , Alex Olshevsky

The matrix pencil method (MPM) is a well-known technique for estimating the parameters of exponentially damped sinusoids in noise by solving a generalized eigenvalue problem. However, in several cases, this is an ill-conditioned problem…

信号处理 · 电气工程与系统科学 2024-04-18 Raymundo Albert , Cecilia G. Galarza

We consider recovery of low-rank matrices from noisy data by hard thresholding of singular values, where singular values below a prescribed threshold $\lambda$ are set to 0. We study the asymptotic MSE in a framework where the matrix size…

统计方法学 · 统计学 2014-06-05 Matan Gavish , David L. Donoho

Consider the noisy underdetermined system of linear equations: y=Ax0 + z0, with n x N measurement matrix A, n < N, and Gaussian white noise z0 ~ N(0,\sigma^2 I). Both y and A are known, both x0 and z0 are unknown, and we seek an…

统计理论 · 数学 2015-03-14 David L. Donoho , Arian Maleki , Andrea Montanari

Trace norm regularization is a widely used approach for learning low rank matrices. A standard optimization strategy is based on formulating the problem as one of low rank matrix factorization which, however, leads to a non-convex problem.…

机器学习 · 计算机科学 2017-08-01 Carlo Ciliberto , Dimitris Stamos , Massimiliano Pontil

We consider the problem of estimating an unknown signal $x_0$ from noisy linear observations $y = Ax_0 + z\in R^m$. In many practical instances, $x_0$ has a certain structure that can be captured by a structure inducing convex function…

信息论 · 计算机科学 2013-11-07 Samet Oymak , Christos Thrampoulidis , Babak Hassibi

Low-rank matrix recovery problems involving high-dimensional and heterogeneous data appear in applications throughout statistics and machine learning. The contribution of this paper is to establish the fundamental limits of recovery for a…

机器学习 · 统计学 2022-03-22 Joshua K. Behne , Galen Reeves

We use convex relaxation techniques to provide a sequence of solutions to the matrix completion problem. Using the nuclear norm as a regularizer, we provide simple and very efficient algorithms for minimizing the reconstruction error…

机器学习 · 统计学 2009-06-12 Rahul Mazumder , Trevor Hastie , Rob Tibshirani

The task of reconstructing a matrix given a sample of observedentries is known as the matrix completion problem. It arises ina wide range of problems, including recommender systems, collaborativefiltering, dimensionality reduction, image…

统计理论 · 数学 2014-12-20 Jean Lafond , Olga Klopp , Eric Moulines , Jospeh Salmon

This paper introduces a novel algorithm to approximate the matrix with minimum nuclear norm among all matrices obeying a set of convex constraints. This problem may be understood as the convex relaxation of a rank minimization problem, and…

最优化与控制 · 数学 2008-10-21 Jian-Feng Cai , Emmanuel J. Candes , Zuowei Shen

In this paper, we propose a new algorithm for recovery of low-rank matrices from compressed linear measurements. The underlying idea of this algorithm is to closely approximate the rank function with a smooth function of singular values,…

信息论 · 计算机科学 2016-11-18 Mohammadreza Malek-Mohammadi , Massoud Babaie-Zadeh , Mikael Skoglund

We describe novel subgradient methods for a broad class of matrix optimization problems involving nuclear norm regularization. Unlike existing approaches, our method executes very cheap iterations by combining low-rank stochastic…

机器学习 · 计算机科学 2012-07-03 Haim Avron , Satyen Kale , Shiva Kasiviswanathan , Vikas Sindhwani

For the problems of low-rank matrix completion, the efficiency of the widely-used nuclear norm technique may be challenged under many circumstances, especially when certain basis coefficients are fixed, for example, the low-rank correlation…

最优化与控制 · 数学 2015-06-23 Weimin Miao , Shaohua Pan , Defeng Sun

This paper studies the problem of selecting a submatrix of a positive definite matrix in order to achieve a desired bound on the smallest eigenvalue of the submatrix. Maximizing this smallest eigenvalue has applications to selecting input…

系统与控制 · 计算机科学 2017-09-08 Andrew Clark , Qiqiang Hou , Linda Bushnell , Radha Poovendran

We consider the problem of imaging sparse scenes from a few noisy data using an $l_1$-minimization approach. This problem can be cast as a linear system of the form $A \, \rho =b$, where $A$ is an $N\times K$ measurement matrix. We assume…

图像与视频处理 · 电气工程与系统科学 2020-04-22 Miguel Moscoso , Alexei Novikov , George Papanicolaou , Chrysoula Tsogka

Neutrinos are perhaps the most elusive known particles in the universe. We know they have some nonzero mass, but unlike all other particles, the absolute scale remains unknown. In addition, their fundamental nature is uncertain; they can…

核理论 · 物理学 2023-07-31 A. Belley , T. Miyagi , S. R. Stroberg , J. D. Holt

In this paper we investigate the reconstruction conditions of nuclear norm minimization for low-rank matrix recovery. We obtain sufficient conditions $\delta_{tr}<t/(4-t)$ with $0<t<4/3$ to guarantee the robust reconstruction $(z\neq0)$ or…

信息论 · 计算机科学 2020-03-11 Jianwen Huang , Jianjun Wang , Feng Zhang , Wendong Wang