English
Related papers

Related papers: Trouble shooting for covariance fitting in highly …

200 papers

Time-dependent ensemble averages, i.e., trajectory-based averages of some observable, are of importance in many fields of science. A crucial objective when interpreting such data is to fit these averages (for instance, squared…

Data Analysis, Statistics and Probability · Physics 2018-05-09 Karl Fogelmark , Michael A. Lomholt , Anders Irback , Tobias Ambjornsson

We propose a flexible dual functional factor model for modelling high-dimensional functional time series. In this model, a high-dimensional fully functional factor parametrisation is imposed on the observed functional processes, whereas a…

Econometrics · Economics 2024-01-15 Chenlei Leng , Degui Li , Hanlin Shang , Yingcun Xia

This paper deals with the problem of estimating the covariance matrix of a series of independent multivariate observations, in the case where the dimension of each observation is of the same order as the number of observations. Although…

Information Theory · Computer Science 2015-06-03 Jianfeng Yao , Abla Kammoun , Jamal Najim

Variational approximation methods have proven to be useful for scaling Bayesian computations to large data sets and highly parametrized models. Applying variational methods involves solving an optimization problem, and recent research in…

Methodology · Statistics 2017-01-13 Victor M. -H. Ong , David J. Nott , Michael S. Smith

Repeated measurements are common in many fields, where random variables are observed repeatedly across different subjects. Such data have an underlying hierarchical structure, and it is of interest to learn covariance/correlation at…

Methodology · Statistics 2023-06-13 Sunpeng Duan , Guo Yu , Juntao Duan , Yuedong Wang

We propose a method for testing whether hierarchically ordered groups of potentially correlated variables are significant for explaining a response in a high-dimensional linear model. In presence of highly correlated variables, as is very…

Statistics Theory · Mathematics 2014-09-04 Jacopo Mandozzi , Peter Bühlmann

In this paper, we study the problem of high-dimensional approximately low-rank covariance matrix estimation with missing observations. We propose a simple procedure computationally tractable in high-dimension and that does not require…

Statistics Theory · Mathematics 2012-05-14 Karim Lounici

Deviations between the form of trajectory assumed in a fit to a set of measurements and the actual form of the trajectory can give rise to sequential correlations in the residuals from the fit. These correlations can provide a more powerful…

High Energy Physics - Experiment · Physics 2009-10-31 Robert V. Kowalewski , Paul D. Jackson

It is common in machine learning and statistics to use symmetries derived from expert knowledge to simplify problems or improve performance, using methods like data augmentation or penalties. In this paper we consider the unsupervised and…

Machine Learning · Computer Science 2022-04-05 Colin Hagemeyer

Sparse models for high-dimensional linear regression and machine learning have received substantial attention over the past two decades. Model selection, or determining which features or covariates are the best explanatory variables, is…

Machine Learning · Statistics 2019-10-15 Yuan Li , Benjamin Mark , Garvesh Raskutti , Rebecca Willett , Hyebin Song , David Neiman

We use available measurements to estimate the unknown parameters (variance, smoothness parameter, and covariance length) of a covariance function by maximizing the joint Gaussian log-likelihood function. To overcome cubic complexity in the…

Computation · Statistics 2018-09-13 Alexander Litvinenko , Ying Sun , Marc G. Genton , David Keyes

A significant obstacle in the development of robust machine learning models is covariate shift, a form of distribution shift that occurs when the input distributions of the training and test sets differ while the conditional label…

Machine Learning · Statistics 2021-11-17 Nilesh Tripuraneni , Ben Adlam , Jeffrey Pennington

We introduce an estimation method of covariance matrices in a high-dimensional setting, i.e., when the dimension of the matrix, , is larger than the sample size . Specifically, we propose an orthogonally equivariant estimator. The…

Statistics Theory · Mathematics 2020-12-04 Samprit Banerjee , Stefano Monni

The global minimum-variance portfolio is a typical choice for investors because of its simplicity and broad applicability. Although it requires only one input, namely the covariance matrix of asset returns, estimating the optimal solution…

Portfolio Management · Quantitative Finance 2021-01-08 Sven Husmann , Antoniya Shivarova , Rick Steinert

Estimating large covariance and precision matrices are fundamental in modern multivariate analysis. The problems arise from statistical analysis of large panel economics and finance data. The covariance matrix reveals marginal correlations…

Methodology · Statistics 2015-04-17 Jianqing Fan , Yuan Liao , Han Liu

A common problem in analysis of experiments or in lattice QCD simulations is fitting a parameterized model to the average over a number of samples of correlated data values. If the number of samples is not infinite, estimates of the…

High Energy Physics - Lattice · Physics 2008-08-27 D. Toussaint , W. Freeman

Straightforward methods for adapting the familiar chi^2 statistic to histograms of discrete events and other Poisson distributed data generally yield biased estimates of the parameters of a model. The bias can be important even when the…

Data Analysis, Statistics and Probability · Physics 2014-03-12 Joseph W. Fowler

The problem of detecting changes in covariance for a single pair of features has been studied in some detail, but may be limited in importance or general applicability. In contrast, testing equality of covariance matrices of a {\it set} of…

Methodology · Statistics 2017-12-12 Yi-Hui Zhou

For data sets with similar features, for example highly correlated features, most existing stability measures behave in an undesired way: They consider features that are almost identical but have different identifiers as different features.…

Machine Learning · Statistics 2021-01-18 Andrea Bommert , Jörg Rahnenführer

Data-fusion involves the integration of multiple related datasets. The statistical file-matching problem is a canonical data-fusion problem in multivariate analysis, where the objective is to characterise the joint distribution of a set of…

Methodology · Statistics 2021-04-08 Daniel Ahfock , Saumyadipta Pyne , Geoffrey J. McLachlan