English
Related papers

Related papers: Rank penalized estimators for high-dimensional mat…

200 papers

This paper deals with the trace regression model where $n$ entries or linear combinations of entries of an unknown $m_1\times m_2$ matrix $A_0$ corrupted by noise are observed. We propose a new nuclear norm penalized estimator of $A_0$ and…

Statistics Theory · Mathematics 2016-03-24 Vladimir Koltchinskii , Alexandre B. Tsybakov , Karim Lounici

We present a new trace estimator of the matrix whose explicit form is not given but its matrix multiplication to a vector is available. The form of the estimator is similar to the Hutchison stochastic trace estimator, but instead of the…

Machine Learning · Statistics 2016-06-20 Boram Yoon

Suppose that we observe entries or, more generally, linear combinations of entries of an unknown $m\times T$-matrix $A$ corrupted by noise. We are particularly interested in the high-dimensional setting where the number $mT$ of unknown…

Statistics Theory · Mathematics 2011-05-16 Angelika Rohde , Alexandre B. Tsybakov

We consider robust low rank matrix estimation as a trace regression when outputs are contaminated by adversaries. The adversaries are allowed to add arbitrary values to arbitrary outputs. Such values can depend on any samples. We deal with…

Machine Learning · Statistics 2024-05-27 Takeyuki Sasai , Hironori Fujisawa

In this paper we consider the trace regression model where $n$ entries or linear combinations of entries of an unknown $m_1\times m_2$ matrix $A_0$ corrupted by noise are observed. We establish for the nuclear-norm penalized estimator of…

Statistics Theory · Mathematics 2011-10-26 Karim Lounici

Learning of matrix-valued data has recently surged in a range of scientific and business applications. Trace regression is a widely used method to model effects of matrix predictors and has shown great success in matrix learning. However,…

Machine Learning · Statistics 2021-05-06 Chanwoo Lee , Lexin Li , Hao Helen Zhang , Miaoyan Wang

In this paper, we study the trace regression when a matrix of parameters B* is estimated via the convex relaxation of a rank-regularized regression or via regularized non-convex optimization. It is known that these estimators satisfy…

Machine Learning · Computer Science 2023-08-31 Nima Hamidi , Mohsen Bayati

We address the problem of estimating a high-dimensional matrix from linear measurements, with a focus on designing optimal rank-adaptive algorithms. These algorithms infer the matrix by estimating its singular values and the corresponding…

Information Theory · Computer Science 2026-05-12 Frédéric Zheng , Yassir Jedra , Alexandre Proutiere

Penalized estimation principle is fundamental to high-dimensional problems. In the literature, it has been extensively and successfully applied to various models with only structural parameters. As a contrast, in this paper, we apply this…

Statistics Theory · Mathematics 2017-08-03 Jianqing Fan , Runlong Tang , Xiaofeng Shi

The trace regression model, a direct extension of the well-studied linear regression model, allows one to map matrices to real-valued outputs. We here introduce an even more general model, namely the partial-trace regression model, a family…

Machine Learning · Computer Science 2020-08-26 Hachem Kadri , Stéphane Ayache , Riikka Huusari , Alain Rakotomamonjy , Liva Ralaivola

We consider in this paper the multivariate regression problem, when the target regression matrix $A$ is close to a low rank matrix. Our primary interest in on the practical case where the variance of the noise is unknown. Our main…

Statistics Theory · Mathematics 2011-06-24 Christophe Giraud

While matrix variate regression models have been studied in many existing works, classical statistical and computational methods for the analysis of the regression coefficient estimation are highly affected by high dimensional and noisy…

Machine Learning · Statistics 2022-05-17 Hsin-Hsiung Huang , Feng Yu , Xing Fan , Teng Zhang

We study low-rank matrix regression in settings where matrix-valued predictors and scalar responses are observed across multiple individuals. Rather than assuming a fully homogeneous coefficient matrices across individuals, we accommodate…

Methodology · Statistics 2025-10-28 Di Wang , Xiaoyu Zhang , Guodong Li , Wenyang Zhang

We propose a new pivotal method for estimating high-dimensional matrices. Assume that we observe a small set of entries or linear combinations of entries of an unknown matrix $A\_0$ corrupted by noise. We propose a new method for estimating…

Statistics Theory · Mathematics 2015-02-03 Olga Klopp , Stéphane Gaiffas

The paper introduces a penalized matrix estimation procedure aiming at solutions which are sparse and low-rank at the same time. Such structures arise in the context of social networks or protein interactions where underlying graphs have…

Data Structures and Algorithms · Computer Science 2012-07-03 Emile Richard , Pierre-Andre Savalle , Nicolas Vayatis

We propose a penalized likelihood method to fit the linear discriminant analysis model when the predictor is matrix valued. We simultaneously estimate the means and the precision matrix, which we assume has a Kronecker product…

Machine Learning · Statistics 2016-10-31 Aaron J. Molstad , Adam J. Rothman

We present randomized algorithms for estimating the trace and deter- minant of Hermitian positive semi-definite matrices. The algorithms are based on subspace iteration, and access the matrix only through matrix vector products. We analyse…

Numerical Analysis · Mathematics 2017-02-17 Arvind K. Saibaba , Alen Alexanderian , Ilse C. F. Ipsen

Motivated by value function estimation in reinforcement learning, we study statistical linear inverse problems, i.e., problems where the coefficients of a linear system to be solved are observed in noise. We consider penalized estimators,…

Machine Learning · Computer Science 2012-07-03 Bernardo Avila Pires , Csaba Szepesvari

We consider a rank-one symmetric matrix corrupted by additive noise. The rank-one matrix is formed by an $n$-component unknown vector on the sphere of radius $\sqrt{n}$, and we consider the problem of estimating this vector from the…

Machine Learning · Statistics 2021-05-27 Antoine Bodin , Nicolas Macris

The task of reconstructing a matrix given a sample of observedentries is known as the matrix completion problem. It arises ina wide range of problems, including recommender systems, collaborativefiltering, dimensionality reduction, image…

Statistics Theory · Mathematics 2014-12-20 Jean Lafond , Olga Klopp , Eric Moulines , Jospeh Salmon
‹ Prev 1 2 3 10 Next ›