English
Related papers

Related papers: Bayes linear adjustment for variance matrices

200 papers

As a classical problem, covariance estimation has drawn much attention from the statistical community for decades. Much work has been done under the frequentist and the Bayesian frameworks. Aiming to quantify the uncertainty of the…

Methodology · Statistics 2017-08-17 W. Jenny Shi , Jan Hannig , Randy C. S. Lai , Thomas C. M. Lee

We consider the problem of joint estimation of structured inverse covariance matrices. We perform the estimation using groups of measurements with different covariances of the same unknown structure. Assuming the inverse covariances to span…

Machine Learning · Statistics 2015-11-23 Ilya Soloveychik , Ami Wiesel

We study the distribution of singular values of product of random matrices pertinent to the analysis of deep neural networks. The matrices resemble the product of the sample covariance matrices, however, an important difference is that the…

Mathematical Physics · Physics 2022-07-05 L. Pastur , V. Slavin

We construct a probabilistic coherence measure for information sets which determines a partial coherence ordering. This measure is applied in constructing a criterion for expanding our beliefs in the face of new information. A number of…

Artificial Intelligence · Computer Science 2007-05-23 Luc Bovens , Stephan Hartmann

The paper deals with distribution of singular values of product of random matrices arising in the analysis of deep neural networks. The matrices resemble the product analogs of the sample covariance matrices, however, an important…

Mathematical Physics · Physics 2020-11-23 Leonid Pastur

An algebraic investigation on bicomplex numbers is carried out here. Particularly matrices and linear maps defined on them are discussed. A new kind of cartesian product, referred to as an idempotent product, is introduced and studied. The…

Representation Theory · Mathematics 2023-12-04 Anjali , Fahed Zulfeqarr , Akhil Prakash , Prabhat Kumar

Machine Learning is becoming more prevalent in science and engineering, but many approaches do not provide meaningful uncertainty estimates and predictions may also violate known physical knowledge. We propose a Bayesian framework to embed…

Machine Learning · Computer Science 2026-04-29 Matthew Marsh , Benoît Chachuat , Antonio del Rio Chanona

Covariance is used as an inner product on a formal vector space built on n random variables to define measures of correlation Md across a set of vectors in a d-dimensional space. For d = 1, one has the diameter; for d = 2, one has an area.…

Applications · Statistics 2011-08-29 David H. Douglass , Jonathan Pakianathan , Adam Towsley

We propose a modeling framework for time-varying covariance matrices based on the assumption that the logarithm of a realized covariance matrix follows a matrix-variate oNrmal distribution. By operating in the space of symmetric matrices,…

Methodology · Statistics 2026-01-30 Edoardo Otranto

Assumptions about invariances or symmetries in data can significantly increase the predictive power of statistical models. Many commonly used models in machine learning are constraint to respect certain symmetries in the data, such as…

Machine Learning · Statistics 2022-08-03 Tycho F. A. van der Ouderaa , Mark van der Wilk

In covariance matrix estimation, one of the challenges lies in finding a suitable model and an efficient estimation method. Two commonly used modelling approaches in the literature involve imposing linear restrictions on the covariance…

Statistics Theory · Mathematics 2024-05-09 Piotr Zwiernik

Bayesian calibration of black-box computer models offers an established framework to obtain a posterior distribution over model parameters. Traditional Bayesian calibration involves the emulation of the computer model and an additive model…

Machine Learning · Statistics 2018-10-30 Sébastien Marmin , Maurizio Filippone

The estimation of large covariance matrices has a high dimensional bias. Correcting for this bias can be reformulated via the tool of Free Probability Theory as a free deconvolution. The goal of this work is a computational and statistical…

Probability · Mathematics 2023-05-10 Reda Chhaibi , Fabrice Gamboa , Slim Kammoun , Mauricio Velasco

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

A Lorentz covariant matrix regularization of membrane thories is studied.It is shown that the action for a bosonic membrane can be defined by matrix regularization in a Lorentz covariant manner. The generator of area preserving…

High Energy Physics - Theory · Physics 2011-07-19 Kazuo Fujikawa , Kazumi Okuyama

This paper introduces a subspace method for the estimation of an array covariance matrix. It is shown that when the received signals are uncorrelated, the true array covariance matrices lie in a specific subspace whose dimension is…

Numerical Analysis · Computer Science 2014-11-04 Mostafa Rahmani , George Atia

Statistical modeling of spatiotemporal phenomena often requires selecting a covariance matrix from a covariance class. Yet standard parametric covariance families can be insufficiently flexible for practical applications, while…

Computation · Statistics 2020-12-24 Antoni Musolas , Steven T. Smith , Youssef Marzouk

Bayesian inverse problems use observed data to update a prior probability distribution for an unknown state or parameter of a scientific system to a posterior distribution conditioned on the data. In many applications, the unknown parameter…

Numerical Analysis · Mathematics 2026-05-12 Josie König , Elizabeth Qian , Melina A. Freitag

Covariance matrix estimation is a fundamental statistical task in many applications, but the sample covariance matrix is sub-optimal when the sample size is comparable to or less than the number of features. Such high-dimensional settings…

Methodology · Statistics 2022-06-06 Huiqin Xin , Sihai Dave Zhao

Uncertainty relations are usually stated as bounds on selected combinations of variances, but the full covariance matrix contains substantially richer information about the geometry of quantum state space and about the operational…

Quantum Physics · Physics 2026-05-13 Dimpi Thakuria , Shuheng Liu , Giuseppe Vitagliano , Konrad Szymański