English
Related papers

Related papers: Matching Criterion for Identifiability in Sparse F…

200 papers

Identifying structural parameters in linear simultaneous-equation models is a longstanding challenge. Recent work exploits information in higher-order moments of non-Gaussian data. In this literature, the structural errors are typically…

Econometrics · Economics 2025-09-11 Ziyu Jiang

Score Predictor Factor Analysis (SPFA) was introduced as a method that allows to compute factor score predictors that are -- under some conditions -- more highly correlated with the common factors resulting from factor analysis than the…

Applications · Statistics 2020-04-07 André Beauducel , Norbert Hilger

In the context of confirmatory factor analysis, the independent clusters model has been found to be overly restrictive in several research contexts. Therefore, a less restrictive criterion for parsimony of non-salient loadings in…

Applications · Statistics 2015-12-22 Andre Beauducel

We propose a novel approach to estimating the precision matrix of multivariate Gaussian data that relies on decomposing them into a low-rank and a diagonal component. Such decompositions are very popular for modeling large covariance…

Methodology · Statistics 2022-08-18 Noirrit Kiran Chandra , Peter Mueller , Abhra Sarkar

We propose a combined model, which integrates the latent factor model and the logistic regression model, for the citation network. It is noticed that neither a latent factor model nor a logistic regression model alone is sufficient to…

Machine Learning · Statistics 2019-12-03 Namjoon Suh , Xiaoming Huo , Eric Heim , Lee Seversky

This paper studies the principal component (PC) method-based estimation of weak factor models with sparse loadings. We uncover an intrinsic near-sparsity preservation property for the PC estimators of loadings, which comes from the…

Econometrics · Economics 2024-11-08 Jie Wei , Yonghui Zhang

Sparse principal component analysis addresses the problem of finding a linear combination of the variables in a given data set with a sparse coefficients vector that maximizes the variability of the data. This model enhances the ability to…

Optimization and Control · Mathematics 2017-03-09 Amir Beck , Yakov Vaisbourd

An old problem in multivariate statistics is that linear Gaussian models are often unidentifiable, i.e. some parameters cannot be uniquely estimated. In factor (component) analysis, an orthogonal rotation of the factors is unidentifiable,…

Machine Learning · Statistics 2023-05-04 Aapo Hyvärinen , Ilyes Khemakhem , Ricardo Monti

In (exploratory) factor analysis, the loading matrix is identified only up to orthogonal rotation. For identifiability, one thus often takes the loading matrix to be lower triangular with positive diagonal entries. In Bayesian inference, a…

Methodology · Statistics 2014-09-29 Dennis Leung , Mathias Drton

The techniques suggested in Fr\"uhwirth-Schnatter et al. (2024) concern sparsity and factor selection and have enormous potential beyond standard factor analysis applications. We show how these techniques can be applied to Latent Space (LS)…

Methodology · Statistics 2024-11-15 Roberto Casarin , Antonio Peruzzi

Matrix factorization exploits the idea that, in complex high-dimensional data, the actual signal typically lies in lower-dimensional structures. These lower dimensional objects provide useful insight, with interpretability favored by sparse…

Methodology · Statistics 2022-12-14 Lorenzo Schiavon , Bernardo Nipoti , Antonio Canale

We consider small factor analysis models with one or two factors. Fixing the number of factors, we prove a finiteness result about the covariance matrix parameter space when the size of the covariance matrix increases. According to this…

Statistics Theory · Mathematics 2009-08-13 Mathias Drton , Han Xiao

The replication crisis in social and behavioral sciences has raised concerns about the reliability and validity of empirical studies. While research in the literature has explored contributing factors to this crisis, the issues related to…

Methodology · Statistics 2024-06-13 Dandan Tang , Steven M. Boker , Xin Tong

Sparse coding--that is, modelling data vectors as sparse linear combinations of basis elements--is widely used in machine learning, neuroscience, signal processing, and statistics. This paper focuses on the large-scale matrix factorization…

Machine Learning · Statistics 2010-02-11 Julien Mairal , Francis Bach , Jean Ponce , Guillermo Sapiro

Data-fusion involves the integration of multiple related datasets. The statistical file-matching problem is a canonical data-fusion problem in multivariate analysis, where the objective is to characterise the joint distribution of a set of…

Methodology · Statistics 2021-04-08 Daniel Ahfock , Saumyadipta Pyne , Geoffrey J. McLachlan

We reconcile the two worlds of dense and sparse modeling by exploiting the positive aspects of both. We employ a factor model and assume {the dynamic of the factors is non-pervasive while} the idiosyncratic term follows a sparse vector…

Methodology · Statistics 2022-05-25 Jonas Krampe , Luca Margaritella

Confirmatory factor analysis (CFA) is a statistical method for identifying and confirming the presence of latent factors among observed variables through the analysis of their covariance structure. Compared to alternative factor models, CFA…

Methodology · Statistics 2024-10-08 Yifan Yang , Tianzhou Ma , Chuan Bi , Shuo Chen

Factor modeling is an essential tool for exploring intrinsic dependence structures among high-dimensional random variables. Much progress has been made for estimating the covariance matrix from a high-dimensional factor model. However, the…

Statistics Theory · Mathematics 2016-10-26 Quefeng Li , Guang Cheng , Jianqing Fan , Yuyan Wang

This paper provides a theoretical analysis of a new learning problem for recommender systems where users provide feedback by comparing pairs of items instead of rating them individually. We assume that comparisons stem from latent user and…

Machine Learning · Computer Science 2025-08-20 Suryanarayana Sankagiri , Jalal Etesami , Matthias Grossglauser

A novel unsupervised learning method is proposed in this paper for biclustering large-dimensional matrix-valued time series based on an entirely new latent two-way factor structure. Each block cluster is characterized by its own row and…

Methodology · Statistics 2025-02-11 Yong He , Xiaoyang Ma , Xingheng Wang , Yalin Wang