English
Related papers

Related papers: Matrix norm shrinkage estimators and priors

200 papers

Estimation of low-rank matrices is of significant interest in a range of contemporary applications. In this paper, we introduce a rank-one projection model for low-rank matrix recovery and propose a constrained nuclear norm minimization…

Statistics Theory · Mathematics 2014-12-10 T. Tony Cai , Anru Zhang

The paper proposes a method for constructing a sparse estimator for the inverse covariance (concentration) matrix in high-dimensional settings. The estimator uses a penalized normal likelihood approach and forces sparsity by using a…

Statistics Theory · Mathematics 2008-06-26 Adam J. Rothman , Peter J. Bickel , Elizaveta Levina , Ji Zhu

We present a new version of the truncated harmonic mean estimator (THAMES) for univariate or multivariate mixture models. The estimator computes the marginal likelihood from Markov chain Monte Carlo (MCMC) samples, is consistent,…

This paper addresses the weak instruments problem in linear instrumental variable models from a Bayesian perspective. The new approach has two components. First, a novel predictor-dependent shrinkage prior is developed for the many…

Methodology · Statistics 2014-08-05 P. Richard Hahn , Hedibert Lopes

We consider the problem of estimating the mean vector $\theta$ of a $d$-dimensional spherically symmetric distributed $X$ based on balanced loss functions of the forms: {\bf (i)} $\omega \rho(\|\de-\de_{0}\|^{2}) +(1-\omega)\rho(\|\de -…

Statistics Theory · Mathematics 2021-02-26 Lahoucine Hobbad , Éric Marchand , Idir Ouassou

A new shrinkage-based construction is developed for a compressible vector $\boldsymbol{x}\in\mathbb{R}^n$, for cases in which the components of $\xv$ are naturally associated with a tree structure. Important examples are when $\xv$…

Machine Learning · Statistics 2014-01-14 Xin Yuan , Vinayak Rao , Shaobo Han , Lawrence Carin

The Thompson metric provides key geometric insights in the study or non-linear matrix equations and in many optimization problems. However, knowing that an approximate solution is within d_T units of the actual solution in the Thompson…

Functional Analysis · Mathematics 2016-08-12 David A. Snyder

The theory of low-rank tensor-train approximation is well understood when the approximation error is measured in the Frobenius norm. The entrywise maximum norm is equally important but is significantly weaker for large tensors, making the…

Numerical Analysis · Mathematics 2025-04-09 Stanislav Budzinskiy

Many statistical settings call for estimating a population parameter, most typically the population mean, based on a sample of matrices. The most natural estimate of the population mean is the arithmetic mean, but there are many other…

Statistics Theory · Mathematics 2021-07-16 Asad Lodhia , Keith Levin , Elizaveta Levina

A method for implicit variable selection in mixture of experts frameworks is proposed. We introduce a prior structure where information is taken from a set of independent covariates. Robust class membership predictors are identified using a…

Econometrics · Economics 2019-01-15 Gregor Zens

Over the past two decades, shrinkage priors have become increasingly popular, and many proposals can be found in the literature. These priors aim to shrink small effects to zero while maintaining true large effects. Horseshoe-type priors…

Statistics Theory · Mathematics 2025-01-14 Maria De Iorio , Andreas Heinecke , Beatrice Franzolini , Rafael Cabral

This paper communicates recent results in theory of complex symmetric operators and shows, through two non-trivial examples, their potential usefulness in the study of Schr\"odinger operators. In particular, we propose a formula for…

Mathematical Physics · Physics 2008-06-10 Emil Prodan , Stephan R. Garcia , Mihai Putinar

We revisit the classical, full-fledged Bayesian model averaging (BMA) paradigm to ensemble pre-trained and/or lightly-finetuned foundation models to enhance the classification performance on image and text data. To make BMA tractable under…

Machine Learning · Computer Science 2025-05-29 Mijung Park

The paper addresses asymptotic estimation of normal means under sparsity. The primary focus is estimation of multivariate normal means where we obtain exact asymptotic minimax error under global-local shrinkage prior. This extends the…

Statistics Theory · Mathematics 2023-10-31 Zikun Qin , Malay Ghosh

In this paper, we establish the following perturbation result concerning the singular values of a matrix: Let $A,B \in \mathbb{R}^{m\times n}$ be given matrices, and let $f:\mathbb{R}_+\rightarrow\mathbb{R}_+$ be a concave function…

Optimization and Control · Mathematics 2014-06-30 Man-Chung Yue , Anthony Man-Cho So

In wavelet shrinkage and thresholding, most of the standard techniques do not consider information that wavelet coefficients might be bounded, although information about bounded energy in signals can be readily available. To address this,…

Methodology · Statistics 2020-11-12 Alex Rodrigo dos Santos Sousa , Nancy Lopes Garcia , Branislav Vidakovic

We introduce a new class of distributions named log-adjusted shrinkage priors for the analysis of sparse signals, which extends the three parameter beta priors by multiplying an additional log-term to their densities. The proposed prior has…

Methodology · Statistics 2020-01-28 Yasuyuki Hamura , Kaoru Irie , Shonosuke Sugasawa

We consider the matrix completion problem of recovering a structured low rank matrix with partially observed entries with mixed data types. Vast majority of the solutions have proposed computationally feasible estimators with strong…

Machine Learning · Statistics 2020-05-27 Daqian Sun , Martin T. Wells

Bayes estimators are well known to provide a means to incorporate prior knowledge that can be expressed in terms of a single prior distribution. However, when this knowledge is too vague to express with a single prior, an alternative…

Methodology · Statistics 2023-09-04 Hongxiang Qiu , Alex Luedtke

We consider the problem of Bayesian density estimation on the positive semiline for possibly unbounded densities. We propose a hierarchical Bayesian estimator based on the gamma mixture prior which can be viewed as a location mixture. We…

Statistics Theory · Mathematics 2020-02-25 Natalia Bochkina , Judith Rousseau