English
Related papers

Related papers: Shrinkage = Factor Model

200 papers

We study a novel spline-like basis, which we name the "falling factorial basis", bearing many similarities to the classic truncated power basis. The advantage of the falling factorial basis is that it enables rapid, linear-time computations…

Machine Learning · Statistics 2014-10-29 Yu-Xiang Wang , Alex Smola , Ryan J. Tibshirani

Fund models are statistical descriptions of markets where all asset returns are spanned by the returns of a lower-dimensional collection of funds, modulo orthogonal noise. Equivalently, they may be characterised as models where the global…

Portfolio Management · Quantitative Finance 2022-08-05 Constantinos Kardaras , Hyeng Keun Koo , Johannes Ruf

The confusion matrix is a standard tool for evaluating classifiers by providing insights into class-level errors. In heterogeneous settings, its values are shaped by two main factors: class similarity -- how easily the model confuses two…

Machine Learning · Computer Science 2026-03-31 Johan Erbani , Pierre-Edouard Portier , Elod Egyed-Zsigmond , Sonia Ben Mokhtar , Diana Nurbakova

In many domains such as healthcare or finance, data often come in different assays or measurement modalities, with features in each assay having a common theme. Simply concatenating these assays together and performing prediction can be…

Methodology · Statistics 2018-07-17 J. Kenneth Tay , Robert Tibshirani

A simple model of a frustrated disordered system is presented. Apart from the (very different) physical interpretation, the model shares many features with that of Sherrington-Kirkpatrick for spin glasses, but, as a consequence of its…

Condensed Matter · Physics 2007-05-23 Giovanni Ferraro

To recover a low rank structure from a noisy matrix, truncated singular value decomposition has been extensively used and studied. Recent studies suggested that the signal can be better estimated by shrinking the singular values. We pursue…

Methodology · Statistics 2014-11-25 Julie Josse , Sylvain Sardy

According to recent findings [1,2], empirical covariance matrices deduced from financial return series contain such a high amount of noise that, apart from a few large eigenvalues and the corresponding eigenvectors, their structure can…

Statistical Mechanics · Physics 2009-11-07 Szilard Pafka , Imre Kondor

Modeling the time-varying covariance structures of high-dimensional variables is critical across diverse scientific and industrial applications; however, existing approaches exhibit notable limitations in either modeling flexibility or…

Methodology · Statistics 2026-01-21 Taehee Lee , Jun S. Liu

In this paper, we study the convergent limits and rates of the eigenvalues and eigenvectors for spiked sample covariance matrices whose spectrum can have multiple bulk components. Our model is an extension of Johnstone's spiked covariance…

Probability · Mathematics 2020-01-01 Xiucai Ding

The negative multinomial distribution is a multivariate generalization of the negative binomial distribution. In this paper, we consider the problem of estimating an unknown matrix of probabilities on the basis of observations of negative…

Statistics Theory · Mathematics 2020-10-30 Yasuyuki Hamura , Tatsuya Kubokawa

In this paper we construct a shrinkage estimator of the global minimum variance (GMV) portfolio by a combination of two techniques: Tikhonov regularization and direct shrinkage of portfolio weights. More specifically, we employ a double…

Statistical Finance · Quantitative Finance 2024-07-08 Taras Bodnar , Nestor Parolya , Erik Thorsén

We consider estimating the population covariance matrix when the number of available samples is less than the size of the observations. The sample covariance matrix (SCM) being singular, regularization is mandatory in this case. For this…

Statistics Theory · Mathematics 2025-06-16 Olivier Besson

Multivariate analysis of fMRI data has benefited substantially from advances in machine learning. Most recently, a range of probabilistic latent variable models applied to fMRI data have been successful in a variety of tasks, including…

In this paper we propose a perturbative method for the reconstruction of the covariance matrix of a multinormal distribution, under the assumption that the only available information amounts to the covariance matrix of a spherically…

Statistics Theory · Mathematics 2019-07-19 Filippo Palombi , Simona Toti

Accidental damage is a typical component of motor insurance claim. Modeling of this nature generally involves analysis of past claim history and different characteristics of the insured objects and the policyholders. Generalized linear…

Applications · Statistics 2017-10-11 Sen Hu , Adrian O'Hagan , Thomas Brendan Murphy

We address a classical problem in statistics: adding two-way interaction terms to a regression model. As the covariate dimension increases quadratically, we develop an estimator that adapts well to this increase, while providing accurate…

Methodology · Statistics 2023-09-26 Mark A. van de Wiel , Matteo Amestoy , Jeroen Hoogland

Matrix factorization is a popular approach to solving matrix estimation problems based on partial observations. Existing matrix factorization is based on least squares and aims to yield a low-rank matrix to interpret the conditional sample…

Machine Learning · Statistics 2017-03-06 Rui Zhu , Di Niu , Linglong Kong , Zongpeng Li

A physical model which describes the CKM matrix is analyzed. The elements of such a matrix are field-strength renormalization factors. Each column gives the probability amplitude for the field operators of the coupled Lagrangian to create a…

High Energy Physics - Phenomenology · Physics 2007-05-23 E. Sassaroli

This paper tackles the problem of robust covariance matrix estimation when the data is incomplete. Classical statistical estimation methodologies are usually built upon the Gaussian assumption, whereas existing robust estimation ones assume…

Finding a sparse representation of a possibly noisy signal can be modeled as a variational minimization with l_q-sparsity constraints for q less than one. Especially for real-time, on-line, or iterative applications, in which problems of…

Numerical Analysis · Mathematics 2017-09-04 Martin Ehler