English
Related papers

Related papers: Estimating accurate covariance matrices on fitted …

200 papers

The problem of estimating a normal covariance matrix is considered from a decision-theoretic point of view, where the dimension of the covariance matrix is larger than the sample size. This paper addresses not only the nonsingular case but…

Statistics Theory · Mathematics 2015-06-03 Hisayuki Tsukuma

We present new algorithms and fast implementations to find efficient approximations for modelling stochastic processes. For many numerical computations it is essential to develop finite approximations for stochastic processes. While the…

Optimization and Control · Mathematics 2020-12-03 Kipngeno Benard Kirui , Georg Ch. Pflug , Alois Pichler

This paper focuses on Bayesian shrinkage for covariance matrix estimation. We examine posterior properties and frequentist risks of Bayesian estimators based on new hierarchical inverse-Wishart priors. More precisely, we give the existence…

Methodology · Statistics 2011-06-17 Mathilde Bouriga , Olivier Féron

We develop a general method to quantify the uncertainties of parton distribution functions and their physical predictions, with emphasis on incorporating all relevant experimental constraints. The method uses the Hessian formalism to study…

High Energy Physics - Phenomenology · Physics 2008-12-18 J. Pumplin , D. Stump , R. Brock , D. Casey , J. Huston , J. Kalk , H. L. Lai , W. K. Tung

For large nonlinear least squares loss functions in machine learning we exploit the property that the number of model parameters typically exceeds the data in one batch. This implies a low-rank structure in the Hessian of the loss, which…

Machine Learning · Computer Science 2021-07-13 Johannes J. Brust

Statistical matching methods are widely used in the social and health sciences to estimate causal effects using observational data. Often the objective is to find comparable groups with similar covariate distributions in a dataset, with the…

Applications · Statistics 2021-01-19 Felix Bestehorn , Maike Bestehorn , Christian Kirches

We consider stochastic volatility models using piecewise constant parameters. We suggest a hybrid optimization algorithm for fitting the models to a volatility surface and provide some numerical results. Finally, we provide an outlook on…

Pricing of Securities · Quantitative Finance 2010-10-07 Wolfgang Putschoegl

Extracting parameter constraints from cosmological observations requires accurate determination of the covariance matrix for use in the likelihood function. We show here that uncertainties in the elements of the covariance matrix propagate…

Cosmology and Nongalactic Astrophysics · Physics 2013-10-30 Scott Dodelson , Michael D. Schneider

Undirected graphs can be used to describe matrix variate distributions. In this paper, we develop new methods for estimating the graphical structures and underlying parameters, namely, the row and column covariance and inverse covariance…

Machine Learning · Statistics 2014-05-26 Shuheng Zhou

The statistical analysis of covariance matrices occurs in many important applications, e.g. in diffusion tensor imaging and longitudinal data analysis. We consider the situation where it is of interest to estimate an average covariance…

Methodology · Statistics 2010-10-20 Ian L. Dryden , Alexey Kolydenko , Diwei Zhou , Bai Li

We propose efficient computational methods to fit multivariate Gaussian additive models, where the mean vector and the covariance matrix are allowed to vary with covariates, in an empirical Bayes framework. To guarantee the…

Computation · Statistics 2025-04-07 Vincenzo Gioia , Matteo Fasiolo , Ruggero Bellio , Simon N. Wood

Almost all fields of science rely upon statistical inference to estimate unknown parameters in theoretical and computational models. While the performance of modern computer hardware continues to grow, the computational requirements for the…

Computation · Statistics 2022-10-25 David J. Warne , Ruth E. Baker , Matthew J. Simpson

In many signal processing problems, it may be fruitful to represent the signal under study in a frame. If a probabilistic approach is adopted, it becomes then necessary to estimate the hyper-parameters characterizing the probability…

Methodology · Statistics 2015-05-14 L. Chaâri , J. -C. Pesquet , J. -Y. Tourneret , Ph. Ciuciu , A. Benazza-Benyahia

When a mathematical or computational model is used to analyse some system, it is usual that some parameters resp.\ functions or fields in the model are not known, and hence uncertain. These parametric quantities are then identified by…

Probability · Mathematics 2016-07-01 Hermann G. Matthies , Elmar Zander , Bojana Rosic , Alexander Litvinenko

We develop a multi-level restricted Gaussian maximum likelihood method for estimating the covariance function parameters and computing the best unbiased predictor. Our approach produces a new set of multi-level contrasts where the…

Computation · Statistics 2016-03-29 Julio E. Castrillon-Candas , Marc G. Genton , Rio Yokota

In many cases, the values of some model parameters are determined by maximising the likelihood of a set of data points given the parameter values. The presence of outliers in the data and correlations between data points complicate this…

Numerical Analysis · Computer Science 2017-08-28 M. de Jong

To accurately reproduce measurements from the real world, simulators need to have an adequate model of the physical system and require the parameters of the model be identified. We address the latter problem of estimating parameters through…

Robotics · Computer Science 2022-03-01 Eric Heiden , Christopher E. Denniston , David Millard , Fabio Ramos , Gaurav S. Sukhatme

Classical regression analysis relates the expectation of a response variable to a linear combination of explanatory variables. In this article, we propose a covariance regression model that parameterizes the covariance matrix of a…

Methodology · Statistics 2011-03-01 Peter D. Hoff , Xiaoyue Niu

Common workflows in machine learning and statistics rely on the ability to partition the information in a data set into independent portions. Recent work has shown that this may be possible even when conventional sample splitting is not…

Methodology · Statistics 2025-12-16 Ameer Dharamshi , Anna Neufeld , Lucy L. Gao , Jacob Bien , Daniela Witten

Gaussian processes are a powerful framework for quantifying uncertainty and for sequential decision-making but are limited by the requirement of solving linear systems. In general, this has a cubic cost in dataset size and is sensitive to…