English

Posterior consistency in multi-response regression models with non-informative priors for the error covariance matrix in growing dimensions

Statistics Theory 2025-07-03 v3 Statistics Theory

Abstract

The Inverse-Wishart (IW) distribution is a standard and popular choice of priors for covariance matrices and has attractive properties such as conditional conjugacy. However, the IW family of priors has crucial drawbacks, including the lack of effective choices for non-informative priors. Several classes of priors for covariance matrices that alleviate these drawbacks, while preserving computational tractability, have been proposed in the literature. These priors can be obtained through appropriate scale mixtures of IW priors. However, in the era of increasing dimensionality, the posterior consistency of models that incorporate such priors has not been investigated. We address this issue for the multi-response regression setting (qq responses, nn samples) under a wide variety of IW scale mixture priors for the error covariance matrix. Posterior consistency and contraction rates for both the regression coefficient matrix and the error covariance matrix are established in the ``large qq, large nn'' setting under mild assumptions on the true data-generating covariance matrix and relevant hyperparameters. In particular, the number of responses qnq_n is allowed to grow with nn, but with qn=o(n)q_n = o(n). Also, some results related to the inconsistency of the posterior distribution and posterior mean for qn/nγq_n/n \to \gamma, where γ(0,)\gamma \in (0,\infty) are provided.

Keywords

Cite

@article{arxiv.2305.13743,
  title  = {Posterior consistency in multi-response regression models with non-informative priors for the error covariance matrix in growing dimensions},
  author = {Partha Sarkar and Kshitij Khare and Malay Ghosh},
  journal= {arXiv preprint arXiv:2305.13743},
  year   = {2025}
}

Comments

30 pages, 3 figures