English
Related papers

Related papers: Matrix norm shrinkage estimators and priors

200 papers

We obtain the optimal Bayesian minimax rate for the unconstrained large covariance matrix of multivariate normal sample with mean zero, when both the sample size, n, and the dimension, p, of the covariance matrix tend to infinity.…

Statistics Theory · Mathematics 2017-12-04 Kyoungjae Lee , Jaeyong Lee

A common data analysis task is the reduced-rank regression problem: $$\min_{\textrm{rank-}k \ X} \|AX-B\|,$$ where $A \in \mathbb{R}^{n \times c}$ and $B \in \mathbb{R}^{n \times d}$ are given large matrices and $\|\cdot\|$ is some norm.…

Data Structures and Algorithms · Computer Science 2021-07-02 Praneeth Kacham , David P. Woodruff

The shrinkage function is widely used in matrix low-rank approximation, compressive sensing, and statistical estimation. In this article, an elementary derivation of the shrinkage function is given. In addition, applications of the…

Optimization and Control · Mathematics 2017-03-30 Toby Boas , Aritra Dutta , Xin Li , Kathryn P. Mercier , Eric Niderman

Fitted probabilities from widely used Bayesian multinomial probit models can depend strongly on the choice of a base category, which is used to uniquely identify the parameters of the model. This paper proposes a novel identification…

Methodology · Statistics 2020-05-19 Lane F. Burgette , David Puelz , P. Richard Hahn

Importance sampling algorithms are discussed in detail, with an emphasis on implicit sampling, and applied to data assimilation via particle filters. Implicit sampling makes it possible to use the data to find high-probability samples at…

Computation · Statistics 2015-06-02 Alexandre J. Chorin , Fei Lu , Robert N. Miller , Matthias Morzfeld , Xuemin Tu

We consider the problem of estimating the spectral norm of a matrix using only matrix-vector products. We propose a new Counterbalance estimator that provides upper bounds on the norm and derive probabilistic guarantees on its…

Numerical Analysis · Mathematics 2025-06-19 Alexey Naumov , Maxim Rakhuba , Denis Ryapolov , Sergey Samsonov

We primarily study a special a weighted low-rank approximation of matrices and then apply it to solve the background modeling problem. We propose two algorithms for this purpose: one operates in the batch mode on the entire data and the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Aritra Dutta , Xin Li , Peter Richtarik

The heavy-tailed distributions of corrupted outliers and singular values of all channels in low-level vision have proven effective priors for many applications such as background modeling, photometric stereo and image alignment. And they…

Machine Learning · Computer Science 2018-10-15 Fanhua Shang , James Cheng , Yuanyuan Liu , Zhi-Quan Luo , Zhouchen Lin

A mean function in a reproducing kernel Hilbert space (RKHS), or a kernel mean, is central to kernel methods in that it is used by many classical algorithms such as kernel principal component analysis, and it also forms the core inference…

Machine Learning · Statistics 2016-02-26 Krikamol Muandet , Bharath Sriperumbudur , Kenji Fukumizu , Arthur Gretton , Bernhard Schölkopf

We study frequentist risk properties of predictive density estimators for mean mixtures of multivariate normal distributions, involving an unknown location parameter $\theta \in \mathbb{R}^d$, and which include multivariate skew normal…

Statistics Theory · Mathematics 2022-02-02 Pankaj Bhagwat , Eric Marchand

Many applications involve estimating the mean of multiple binomial outcomes as a common problem -- assessing intergenerational mobility of census tracts, estimating prevalence of infectious diseases across countries, and measuring…

Econometrics · Economics 2026-01-01 Yan Chen , Lihua Lei

We investigate shrinkage priors for constructing Bayesian predictive distributions. It is shown that there exist shrinkage predictive distributions asymptotically dominating Bayesian predictive distributions based on the Jeffreys prior or…

Statistics Theory · Mathematics 2007-06-13 Fumiyasu Komaki

In all areas of human knowledge, datasets are increasing in both size and complexity, creating the need for richer statistical models. This trend is also true for economic data, where high-dimensional and nonlinear/nonparametric inference…

Econometrics · Economics 2021-12-23 Dimitris Korobilis , Kenichi Shimizu

The low-rank matrix approximation problem is ubiquitous in computational mathematics. Traditionally, this problem is solved in spectral or Frobenius norms, where the accuracy of the approximation is related to the rate of decrease of the…

Numerical Analysis · Mathematics 2022-01-31 Stanislav Morozov , Nikolai Zamarashkin , Eugene Tyrtyshnikov

The addition of noise has a regularizing effect on Hermitian matrices. This effect is studied here for $H=A+V$, where $A$ is the base matrix and $V$ is sampled from the GOE or the GUE random matrix ensembles. We bound the mean number of…

Probability · Mathematics 2017-09-22 Michael Aizenman , Ron Peled , Jeffrey Schenker , Mira Shamis , Sasha Sodin

We develop an empirical Bayes (EB) algorithm for the matrix completion problems. The EB algorithm is motivated from the singular value shrinkage estimator for matrix means by Efron and Morris (1972). Since the EB algorithm is essentially…

Machine Learning · Statistics 2019-04-10 Takeru Matsuda , Fumiyasu Komaki

Recently, metric learning and similarity learning have attracted a large amount of interest. Many models and optimisation algorithms have been proposed. However, there is relatively little work on the generalization analysis of such…

Machine Learning · Computer Science 2013-03-19 Qiong Cao , Zheng-Chu Guo , Yiming Ying

Motivated by the proliferation of observational datasets and the need to integrate non-randomized evidence with randomized controlled trials, causal inference researchers have recently proposed several new methodologies for combining biased…

Methodology · Statistics 2023-09-14 Evan T. R. Rosenman , Francesca Dominici , Luke Miratrix

In this paper, a new ridge-type shrinkage estimator for the precision matrix has been proposed. The asymptotic optimal shrinkage coefficients and the theoretical loss were derived. Data-driven estimators for the shrinkage coefficients were…

Methodology · Statistics 2019-09-04 Cheng Wang , Guangming Pan , Longbing Cao

In this article, we investigate certain asymptotic optimality properties of a very broad class of one-group continuous shrinkage priors for simultaneous estimation and testing of a sparse normal mean vector. Asymptotic optimality of Bayes…

Statistics Theory · Mathematics 2015-11-11 Prasenjit Ghosh , Arijit Chakrabarti