English
Related papers

Related papers: Minimax Lower Bounds for Noisy Matrix Completion U…

200 papers

We study the problem of robust matrix completion (RMC), where the partially observed entries of an underlying low-rank matrix is corrupted by sparse noise. Existing analysis of the non-convex methods for this problem either requires the…

Information Theory · Computer Science 2025-04-28 Tianming Wang , Ke Wei

We consider the high-dimensional inference problem where the signal is a low-rank matrix which is corrupted by an additive Gaussian noise. Given a probabilistic model for the low-rank matrix, we compute the limit in the large dimension…

Probability · Mathematics 2018-06-01 Léo Miolane

We consider the problem of imaging sparse scenes from a few noisy data using an $l_1$-minimization approach. This problem can be cast as a linear system of the form $A \, \rho =b$, where $A$ is an $N\times K$ measurement matrix. We assume…

Image and Video Processing · Electrical Eng. & Systems 2020-04-22 Miguel Moscoso , Alexei Novikov , George Papanicolaou , Chrysoula Tsogka

We introduce sparsity detection and estimation in main effect matrix factor models for matrix-valued time series. A carefully chosen set of identification conditions for the common component and the potentially nonstationary main effects is…

Statistics Theory · Mathematics 2025-08-19 Zetai Cen , Kaixin Liu , Clifford Lam

Under a standard assumption in complexity theory (NP not in P/poly), we demonstrate a gap between the minimax prediction risk for sparse linear regression that can be achieved by polynomial-time algorithms, and that achieved by optimal…

Statistics Theory · Mathematics 2014-05-22 Yuchen Zhang , Martin J. Wainwright , Michael I. Jordan

In tracking of time-varying low-rank models of time-varying matrices, we present a method robust to both uniformly-distributed measurement noise and arbitrarily-distributed ``sparse'' noise. In theory, we bound the tracking error. In…

Optimization and Control · Mathematics 2020-02-05 Albert Akhriev , Jakub Marecek , Andrea Simonetto

This paper considers the problem of estimating linear dynamic system models when the observations are corrupted by random disturbances with nonstandard distributions. The paper is particularly motivated by applications where sensor…

Methodology · Statistics 2018-07-09 Johan Dahlin , Adrian Wills , Brett Ninness

In this article, we develop methods for estimating a low rank tensor from noisy observations on a subset of its entries to achieve both statistical and computational efficiencies. There have been a lot of recent interests in this problem of…

Machine Learning · Statistics 2018-03-21 Dong Xia , Ming Yuan , Cun-Hui Zhang

It is well known that the class of rotation invariant algorithms are suboptimal even for learning sparse linear problems when the number of examples is below the "dimension" of the problem. This class includes any gradient descent trained…

Machine Learning · Statistics 2024-03-06 Manfred K. Warmuth , Wojciech Kotłowski , Matt Jones , Ehsan Amid

Tensor completion is a fundamental tool for incomplete data analysis, where the goal is to predict missing entries from partial observations. However, existing methods often make the explicit or implicit assumption that the observed entries…

Machine Learning · Statistics 2022-03-18 Yuning Qiu , Guoxu Zhou , Qibin Zhao , Shengli Xie

Nonnegative matrix factorization (NMF) approximates a nonnegative matrix, $X$, by the product of two nonnegative factors, $WH$, where $W$ has $r$ columns and $H$ has $r$ rows. In this paper, we consider NMF using the component-wise L1 norm…

Machine Learning · Computer Science 2026-04-01 Giovanni Seraghiti , Kévin Dubrulle , Arnaud Vandaele , Nicolas Gillis

Low-rank tensor approximation error bounds are proposed for the case of noisy input data that depend on low-rank representation type, rank and the dimensionality of the tensor. The bounds show that high-dimensional low-rank structured…

Numerical Analysis · Mathematics 2024-12-16 Sergey Petrov , Nikolai Zamarashkin

In this paper we consider the trace regression model where $n$ entries or linear combinations of entries of an unknown $m_1\times m_2$ matrix $A_0$ corrupted by noise are observed. We establish for the nuclear-norm penalized estimator of…

Statistics Theory · Mathematics 2011-10-26 Karim Lounici

We consider the model {eqnarray*}y=X\theta^*+\xi, Z=X+\Xi,{eqnarray*} where the random vector $y\in\mathbb{R}^n$ and the random $n\times p$ matrix $Z$ are observed, the $n\times p$ matrix $X$ is unknown, $\Xi$ is an $n\times p$ random noise…

Statistics Theory · Mathematics 2010-11-11 Mathieu Rosenbaum , Alexandre B. Tsybakov

The estimation of parameters in a linear model is considered under the hypothesis that the noise, with finite second order statistics, can be represented in a given deterministic basis by random coefficients. An extended underdetermined…

Statistics Theory · Mathematics 2014-05-06 Piero Barone , Isabella Lari

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical…

Machine Learning · Computer Science 2015-08-25 Rémi Gribonval , Rodolphe Jenatton , Francis Bach

Matrix completion is the study of recovering an underlying matrix from a sparse subset of noisy observations. Traditionally, it is assumed that the entries of the matrix are "missing completely at random" (MCAR), i.e., each entry is…

Econometrics · Economics 2021-10-01 Anish Agarwal , Munther Dahleh , Devavrat Shah , Dennis Shen

In this paper, we consider a well-known sparse optimization problem that aims to find a sparse solution of a possibly noisy underdetermined system of linear equations. Mathematically, it can be modeled in a unified manner by minimizing…

Optimization and Control · Mathematics 2021-10-01 Lei Yang , Xiaojun Chen , Shuhuang Xiang

Consider the standard Gaussian linear regression model $Y=X\theta+\epsilon$, where $Y\in R^n$ is a response vector and $ X\in R^{n*p}$ is a design matrix. Numerous work have been devoted to building efficient estimators of $\theta$ when $p$…

Statistics Theory · Mathematics 2012-01-26 Nicolas Verzelen

An unknown $m$ by $n$ matrix $X_0$ is to be estimated from noisy measurements $Y=X_0+Z$, where the noise matrix $Z$ has i.i.d. Gaussian entries. A popular matrix denoising scheme solves the nuclear norm penalization problem $\operatorname…

Statistics Theory · Mathematics 2014-11-05 David Donoho , Matan Gavish
‹ Prev 1 3 4 5 6 7 10 Next ›