English
Related papers

Related papers: Estimation under matrix quadratic loss and matrix …

200 papers

Given a matrix the seriation problem consists in permuting its rows in such way that all its columns have the same shape, for example, they are monotone increasing. We propose a statistical approach to this problem where the matrix of…

Statistics Theory · Mathematics 2016-08-02 Nicolas Flammarion , Cheng Mao , Philippe Rigollet

Originally developed for imputing missing entries in low rank, or approximately low rank matrices, matrix completion has proven widely effective in many problems where there is no reason to assume low-dimensional linear structure in the…

Statistics Theory · Mathematics 2021-05-06 Yunhua Xiang , Tianyu Zhang , Xu Wang , Ali Shojaie , Noah Simon

We consider models of Bayesian inference of signals with vectorial components of finite dimensionality. We show that, under a proper perturbation, these models are replica symmetric in the sense that the overlap matrix concentrates. The…

Information Theory · Computer Science 2020-01-27 Jean Barbier

We study the problem of designing minimax procedures in linear regression under the quantile risk. We start by considering the realizable setting with independent Gaussian noise, where for any given noise level and distribution of inputs,…

Statistics Theory · Mathematics 2024-06-19 Ayoub El Hanchi , Chris J. Maddison , Murat A. Erdogdu

We consider the twin problems of estimating the effective rank and the Schatten norms $\|{\bf A}\|_{s}$ of a rectangular $p\times q$ matrix ${\bf A}$ from noisy observations. When $s$ is an even integer, we introduce a polynomial-time…

Statistics Theory · Mathematics 2021-11-29 Solène Thépaut , Nicolas Verzelen

Isotonic regression or monotone function estimation is a problem of estimating function values under monotonicity constraints, which appears naturally in many scientific fields. This paper proposes a new Bayesian method with global-local…

Methodology · Statistics 2024-02-07 Ryo Okano , Yasuyuki Hamura , Kaoru Irie , Shonosuke Sugasawa

We describe several algorithms for matrix completion and matrix approximation when only some of its entries are known. The approximation constraint can be any whose approximated solution is known for the full matrix. For low rank…

Numerical Analysis · Mathematics 2014-07-01 Gil Shabat , Yaniv Shmueli , Amir Averbuch

This paper introduces a matrix quantile factor model for matrix-valued data with low-rank structure. We estimate the row and column factor spaces via minimizing the empirical check loss function with orthogonal rotation constraints. We show…

Methodology · Statistics 2024-08-21 Xin-Bing Kong , Yong-Xin Liu , Long Yu , Peng Zhao

In this paper we analyze, for a model of linear regression with gaussian covariates, the performance of a Bayesian estimator given by the mean of a log-concave posterior distribution with gaussian prior, in the high-dimensional limit where…

Probability · Mathematics 2021-11-12 Jean Barbier , Wei-Kuo Chen , Dmitry Panchenko , Manuel Sáenz

We consider in this paper the problem of noisy 1-bit matrix completion under a general non-uniform sampling distribution using the max-norm as a convex relaxation for the rank. A max-norm constrained maximum likelihood estimate is…

Machine Learning · Statistics 2013-09-25 T. Tony Cai , Wen-Xin Zhou

The variance of noise plays an important role in many change-point detection procedures and the associated inferences. Most commonly used variance estimators require strong assumptions on the true mean structure or normality of the error…

Methodology · Statistics 2023-11-17 Ning Hao , Yue Selena Niu , Han Xiao

This paper studies low-rank matrix completion in the presence of heavy-tailed and possibly asymmetric noise, where we aim to estimate an underlying low-rank matrix given a set of highly incomplete noisy entries. Though the matrix completion…

Statistics Theory · Mathematics 2022-06-10 Bingyan Wang , Jianqing Fan

In a remarkable series of papers beginning in 1956, Charles Stein set the stage for the future development of minimax shrinkage estimators of a multivariate normal mean under quadratic loss. More recently, parallel developments have seen…

Methodology · Statistics 2012-03-27 Edward I. George , Feng Liang , Xinyi Xu

We consider the problem of precision matrix estimation where, due to extraneous confounding of the underlying precision matrix, the data are independent but not identically distributed. While such confounding occurs in many scientific…

Machine Learning · Statistics 2019-07-01 Sinong Geng , Mladen Kolar , Oluwasanmi Koyejo

The semiparametric accelerated failure time model is not as widely used as the Cox relative risk model mainly due to computational difficulties. Recent developments in least squares estimation and induced smoothing estimating equations…

Methodology · Statistics 2015-06-02 Steven Chiou , Junghi Kim , Jun Yan

Inference about dependencies in a multiway data array can be made using the array normal model, which corresponds to the class of multivariate normal distributions with separable covariance matrices. Maximum likelihood and Bayesian methods…

Statistics Theory · Mathematics 2018-06-20 David Gerard , Peter Hoff

In this paper, we observe a sparse mean vector through Gaussian noise and we aim at estimating some additive functional of the mean in the minimax sense. More precisely, we generalize the results of (Collier et al., 2017, 2019) to a very…

Statistics Theory · Mathematics 2019-08-30 Olivier Collier , Laëtitia Comminges

Consider the problem of estimating the entries of a large matrix, when the observed entries are noisy versions of a small random fraction of the original entries. This problem has received widespread attention in recent times, especially…

Statistics Theory · Mathematics 2014-12-31 Sourav Chatterjee

In many practical applications including remote sensing, multi-task learning, and multi-spectrum imaging, data are described as a set of matrices sharing a common column space. We consider the joint estimation of such matrices from their…

Statistics Theory · Mathematics 2023-06-07 Rakshith S Srinivasa , Seonho Kim , Kiryung Lee

In this study, we consider the realm of covariance matrices in machine learning, particularly focusing on computing Fr\'echet means on the manifold of symmetric positive definite matrices, commonly referred to as Karcher or geometric means.…

Machine Learning · Statistics 2024-06-06 Florent Bouchard , Ammar Mian , Malik Tiomoko , Guillaume Ginolhac , Frédéric Pascal