English
Related papers

Related papers: Estimation under matrix quadratic loss and matrix …

200 papers

Matrix concentration inequalities provide information about the probability that a random matrix is close to its expectation with respect to the $l_2$ operator norm. This paper uses semigroup methods to derive sharp nonlinear matrix…

Probability · Mathematics 2021-01-08 De Huang , Joel A. Tropp

Online averaged stochastic gradient algorithms are more and more studied since (i) they can deal quickly with large sample taking values in high dimensional spaces, (ii) they enable to treat data sequentially, (iii) they are known to be…

Statistics Theory · Mathematics 2024-09-16 Antoine Godichon-Baggioni

Matrix Factorization has emerged as a widely adopted framework for modeling data exhibiting low-rank structures. To address challenges in manifold learning, this paper presents a subspace-constrained quadratic matrix factorization model.…

Machine Learning · Computer Science 2024-11-08 Zheng Zhai , Xiaohui Li

In this paper, we study a new notion of scaled minimaxity for sparse estimation in high-dimensional linear regression model. We present more optimistic lower bounds than the one given by the classical minimax theory and hence improve on…

Statistics Theory · Mathematics 2018-10-15 Mohamed Ndaoud

Sequential estimation of the success probability $p$ in inverse binomial sampling is considered in this paper. For any estimator $\hat p$, its quality is measured by the risk associated with normalized loss functions of linear-linear or…

Statistics Theory · Mathematics 2018-12-18 Luis Mendo

We consider the high-dimensional inference problem where the signal is a low-rank matrix which is corrupted by an additive Gaussian noise. Given a probabilistic model for the low-rank matrix, we compute the limit in the large dimension…

Probability · Mathematics 2018-06-01 Léo Miolane

A lower bound on the minimum mean-squared error (MSE) in a Bayesian estimation problem is proposed in this paper. This bound utilizes a well-known connection to the deterministic estimation setting. Using the prior distribution, the bias…

Information Theory · Computer Science 2009-05-27 Zvika Ben-Haim , Yonina C. Eldar

Analyzing concentration of large random matrices is a common task in a wide variety of fields. Given independent random variables, many tools are available to analyze random matrices whose entries are linear in the variables, e.g. the…

Computational Complexity · Computer Science 2023-01-19 Goutham Rajendran , Madhur Tulsiani

We analyze a class of estimators based on convex relaxation for solving high-dimensional matrix decomposition problems. The observations are noisy realizations of a linear transformation $\mathfrak{X}$ of the sum of an approximately) low…

Machine Learning · Statistics 2012-08-09 Alekh Agarwal , Sahand N. Negahban , Martin J. Wainwright

We give an efficient algorithm which can obtain a relative error approximation to the spectral norm of a matrix, combining the power iteration method with some techniques from matrix reconstruction which use random sampling.

Data Structures and Algorithms · Computer Science 2011-04-13 Malik Magdon-Ismail

Recently, there is a revival of interest in low-rank matrix completion-based unsupervised learning through the lens of dual-graph regularization, which has significantly improved the performance of multidisciplinary machine learning tasks…

Machine Learning · Computer Science 2022-09-07 Yangge Chen , Lei Cheng , Yik-Chung Wu

We propose a generalized formulation of the Huber loss. We show that with a suitable function of choice, specifically the log-exp transform; we can achieve a loss function which combines the desirable properties of both the absolute and the…

Machine Learning · Statistics 2021-08-31 Kaan Gokcesu , Hakan Gokcesu

We study the expectation of linear eigenvalue statistics of matrix models with any $\beta>0$, assuming that the potential $V$ is a real analytic function and that the corresponding equilibrium measure has a one-interval support. We obtain…

Mathematical Physics · Physics 2010-04-01 T. Kriecherbauer , M. Shcherbina

Estimation of the mean vector and covariance matrix is of central importance in the analysis of multivariate data. In the framework of generalized linear models, usually the variances are certain functions of the means with the normal…

Methodology · Statistics 2023-01-25 Anupam Kundu , Mohsen Pourahmadi

In this article, we study large-dimensional matrix factor models and estimate the factor loading matrices and factor score matrix by minimizing square loss function. Interestingly, the resultant estimators coincide with the Projected…

Methodology · Statistics 2022-11-22 Yong He , Xinbing Kong , Long Yu , Xinsheng Zhang , Changwei Zhao

We present a detailed analysis of epsilon'/epsilon within the Standard Model, taking into account the strong enhancement through final-state interactions identified in refs. [1] and [2]. The relevant hadronic matrix elements are fixed at…

High Energy Physics - Phenomenology · Physics 2014-11-17 E. Pallante , A. Pich , I. Scimemi

We study the effects of missingness on the estimation of population parameters. Moving beyond restrictive missing completely at random (MCAR) assumptions, we first formulate a missing data analogue of Huber's arbitrary…

Statistics Theory · Mathematics 2026-04-28 Tianyi Ma , Kabir A. Verchand , Thomas B. Berrett , Tengyao Wang , Richard J. Samworth

We supplement the result of the first part of the work with estimates of the integrals of the difference of subharmonic functions in measure with some deterioration of the absolute constants, but these estimates have the form of a…

Complex Variables · Mathematics 2021-07-13 B. N. Khabibullin

Many statistical estimands can expressed as continuous linear functionals of a conditional expectation function. This includes the average treatment effect under unconfoundedness and generalizations for continuous-valued and personalized…

Methodology · Statistics 2020-11-23 David A. Hirshberg , Stefan Wager

Matrix completion has been well studied under the uniform sampling model and the trace-norm regularized methods perform well both theoretically and numerically in such a setting. However, the uniform sampling model is unrealistic for a…

Machine Learning · Computer Science 2017-05-01 T. Tony Cai , Wen-Xin Zhou