English
Related papers

Related papers: Statistical properties of matrix decomposition fac…

200 papers

We introduce \underline{F}actor-\underline{A}ugmented \underline{Ma}trix \underline{R}egression (FAMAR) to address the growing applications of matrix-variate data and their associated challenges, particularly with high-dimensionality and…

Methodology · Statistics 2024-05-29 Elynn Chen , Jianqing Fan , Xiaonan Zhu

Principal component analysis (PCA) is recognised as a quintessential data analysis technique when it comes to describing linear relationships between the features of a dataset. However, the well-known sensitivity of PCA to non-Gaussian…

Machine Learning · Statistics 2019-10-28 Jean P. Chereau , Bruno Scalzo Dees , Danilo P. Mandic

Factor Analysis has traditionally been utilized across diverse disciplines to extrapolate latent traits that influence the behavior of multivariate observed variables. Historically, the focus has been on analyzing data from a single study,…

Methodology · Statistics 2026-01-22 Elena Bortolato , Antonio Canale

Constrained low-rank matrix approximations have been known for decades as powerful linear dimensionality reduction techniques to be able to extract the information contained in large data sets in a relevant way. However, such low-rank…

Machine Learning · Computer Science 2021-12-20 Pierre De Handschutter , Nicolas Gillis , Xavier Siebert

We propose a novel approach to estimating the precision matrix of multivariate Gaussian data that relies on decomposing them into a low-rank and a diagonal component. Such decompositions are very popular for modeling large covariance…

Methodology · Statistics 2022-08-18 Noirrit Kiran Chandra , Peter Mueller , Abhra Sarkar

Various Non-negative Matrix factorization (NMF) based methods add new terms to the cost function to adapt the model to specific tasks, such as clustering, or to preserve some structural properties in the reduced space (e.g., local…

The proposed article aims at offering a comprehensive tutorial for the computational aspects of structured matrix and tensor factorization. Unlike existing tutorials that mainly focus on {\it algorithmic procedures} for a small set of…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Xiao Fu , Nico Vervliet , Lieven De Lathauwer , Kejun Huang , Nicolas Gillis

In addition to recent developments in computing speed and memory, methodological advances have contributed to significant gains in the performance of stochastic simulation. In this paper, we focus on variance reduction for matrix…

Machine Learning · Statistics 2023-03-28 Anant Mathur , Sarat Moka , Zdravko Botev

Principal component analysis (PCA) requires the computation of a low-rank approximation to a matrix containing the data being analyzed. In many applications of PCA, the best possible accuracy of any rank-deficient approximation is at most a…

Computation · Statistics 2010-06-04 Vladimir Rokhlin , Arthur Szlam , Mark Tygert

Factor analysis is a flexible technique for assessment of multivariate dependence and codependence. Besides being an exploratory tool used to reduce the dimensionality of multivariate data, it allows estimation of common factors that often…

Methodology · Statistics 2020-02-19 Kelly C. M. Gonçalves , Afonso C. B. Silva

Incorporating covariates into functional principal component analysis (PCA) can substantially improve the representation efficiency of the principal components and predictive performance. However, many existing functional PCA methods do not…

Methodology · Statistics 2023-08-22 Fei Ding , Shiyuan He , David E. Jones , Jianhua Z. Huang

In climate studies, detecting spatial patterns that largely deviate from the sample mean still remains a statistical challenge. Although a Principal Component Analysis (PCA), or equivalently a Empirical Orthogonal Functions (EOF)…

Statistics Theory · Mathematics 2020-01-29 Alberto Bernacchia , Philippe Naveau

Probability density models based on deep networks have achieved remarkable success in modeling complex high-dimensional datasets. However, unlike kernel density estimators, modern neural models do not yield marginals or conditionals in…

Machine Learning · Statistics 2021-06-10 Dar Gilboa , Ari Pakman , Thibault Vatter

Collaborative filtering is one of the most popular techniques in designing recommendation systems, and its most representative model, matrix factorization, has been wildly used by researchers and the industry. However, this model suffers…

Information Retrieval · Computer Science 2019-12-17 Yixin Su , Sarah Monazam Erfani , Rui Zhang

We present a unifying framework which reduces the construction of probabilistic component analysis techniques to a mere selection of the latent neighbourhood, thus providing an elegant and principled framework for creating novel component…

Machine Learning · Computer Science 2014-11-17 Mihalis A. Nicolaou , Stefanos Zafeiriou , Maja Pantic

Given a collection of data points, non-negative matrix factorization (NMF) suggests to express them as convex combinations of a small set of `archetypes' with non-negative entries. This decomposition is unique only if the true archetypes…

Machine Learning · Statistics 2017-05-09 Hamid Javadi , Andrea Montanari

Exploratory factor analysis (EFA) is useful to identify the number and mapping of the hidden factors that could dominantly represent the features in the dataset. Principal component analysis (PCA) is the first step as part of the two-step…

Social and Information Networks · Computer Science 2024-03-07 Natarajan Meghanathan

We examine several recently suggested methods for the detection of long-range correlations in data series based on similar ideas as the well-established Detrended Fluctuation Analysis (DFA). In particular, we present a detailed comparison…

Statistical Finance · Quantitative Finance 2009-11-13 Amir Bashan , Ronny Bartsch , Jan W. Kantelhardt , Shlomo Havlin

Multifractal detrended fluctuation analysis (MFDFA) has become a central method to characterise the variability and uncertainty in empiric time series. Extracting the fluctuations on different temporal scales allows quantifying the strength…

Computational Physics · Physics 2022-01-05 Leonardo Rydin Gorjão , Galib Hassan , Jürgen Kurths , Dirk Witthaut

Data integration, or the strategic analysis of multiple sources of data simultaneously, can often lead to discoveries that may be hidden in individualistic analyses of a single data source. We develop a new unsupervised data integration…

Methodology · Statistics 2021-04-06 Tiffany M. Tang , Genevera I. Allen