English
Related papers

Related papers: Designing various component analysis at will

200 papers

Generalized additive models (GAMs) are a widely used class of models of interest to statisticians as they provide a flexible way to design interpretable models of data beyond linear models. We here propose a scalable and well-calibrated…

Machine Learning · Computer Science 2018-12-31 Vincent Adam , Nicolas Durrande , ST John

Transformations of covariates are widely used in applied statistics to improve interpretability and to satisfy assumptions required for valid inference. More broadly, feature engineering encompasses a wider set of practices aimed at…

Methodology · Statistics 2026-03-30 Claudia Collarin , Matteo Fasiolo , Yannig Goude , Simon N. Wood

Treatment non-compliance, where individuals deviate from their assigned experimental conditions, frequently complicates the estimation of causal effects. To address this, we introduce a novel learning framework based on a mixture of experts…

Methodology · Statistics 2025-06-25 François Grolleau , Céline Béji , Raphaël Porcher , François Petit

In this work, we propose a generalized product of experts (gPoE) framework for combining the predictions of multiple probabilistic models. We identify four desirable properties that are important for scalability, expressiveness and…

Machine Learning · Computer Science 2015-11-25 Yanshuai Cao , David J. Fleet

We propose a generalized multiscale finite element method (GMsFEM) based on clustering algorithm to study the elliptic PDEs with random coefficients in the multi-query setting. Our method consists of offline and online stages. In the…

Numerical Analysis · Mathematics 2018-08-01 Eric T. Chung , Yalchin Efendiev , Wing Tat Leung , Zhiwen Zhang

The synthesis of antenna arrays in presence of mutual coupling using generalized scattering matrices in terms of characteristic modes is proposed. For the synthesis, the array is built of synthetic elements that are described by their modal…

Signal Processing · Electrical Eng. & Systems 2025-01-07 Leonardo Mörlein , Dirk Manteuffel

Probabilistic principal component analysis (PPCA) is a probabilistic reformulation of principal component analysis (PCA), under the framework of a Gaussian latent variable model. To improve the robustness of PPCA, it has been proposed to…

Methodology · Statistics 2023-11-28 Yiping Guo , Howard D. Bondell

A general asymptotic framework is developed for studying consis- tency properties of principal component analysis (PCA). Our frame- work includes several previously studied domains of asymptotics as special cases and allows one to…

Statistics Theory · Mathematics 2016-11-26 Dan Shen , Haipeng Shen , J. S. Marron

Principal components analysis (PCA) is a classical method for the reduction of dimensionality of data in the form of n observations (or cases) of a vector with p variables. For a simple model of factor analysis type, it is proved that…

Statistics Theory · Mathematics 2009-01-29 Iain M Johnstone , Arthur Yu Lu

A new look on the principal component analysis has been presented. Firstly, a geometric interpretation of determination coefficient was shown. In turn, the ability to represent the analyzed data and their interdependencies in the form of…

Methodology · Statistics 2017-11-29 Zenon Gniazdowski

We propose new linear combinations of compositions of a basic second-order scheme with appropriately chosen coefficients to construct higher order numerical integrators for differential equations. They can be considered as a generalization…

Numerical Analysis · Mathematics 2024-04-25 Sergio Blanes , Fernando Casas , Luke Shaw

We consider the matrix composite materials (CM) of either random (statistically homogeneous or inhomogeneous), periodic, or deterministic (neither random nor periodic) structures. CMs exhibit linear or nonlinear behavior, coupled or…

Classical Physics · Physics 2025-12-23 Valeriy A. Buryachenko

Principal Component Analysis (PCA) is the most widely used tool for linear dimensionality reduction and clustering. Still it is highly sensitive to outliers and does not scale well with respect to the number of data samples. Robust PCA…

Computer Vision and Pattern Recognition · Computer Science 2015-04-24 Nauman Shahid , Vassilis Kalofolias , Xavier Bresson , Michael Bronstein , Pierre Vandergheynst

Principal component analysis (PCA) is a widely used method for data processing, such as for dimension reduction and visualization. Standard PCA is known to be sensitive to outliers, and thus, various robust PCA methods have been proposed.…

Machine Learning · Statistics 2020-08-11 Keishi Sando , Hideitsu Hino

A principal component analysis based on the generalized Gini correlation index is proposed (Gini PCA). The Gini PCA generalizes the standard PCA based on the variance. It is shown, in the Gaussian case, that the standard PCA is equivalent…

Methodology · Statistics 2019-10-23 Charpentier , Arthur , Mussard , Stephane , Tea Ouraga

Principal component analysis (PCA) is recognised as a quintessential data analysis technique when it comes to describing linear relationships between the features of a dataset. However, the well-known sensitivity of PCA to non-Gaussian…

Machine Learning · Statistics 2019-10-28 Jean P. Chereau , Bruno Scalzo Dees , Danilo P. Mandic

Sparse principal component analysis (SPCA) has emerged as a powerful technique for modern data analysis, providing improved interpretation of low-rank structures by identifying localized spatial structures in the data and disambiguating…

Factorization models express a statistical object of interest in terms of a collection of simpler objects. For example, a matrix or tensor can be expressed as a sum of rank-one components. However, in practice, it can be challenging to…

Methodology · Statistics 2022-12-06 Lorenzo Schiavon , Antonio Canale , David B. Dunson

Methods for analysis of principal components in discrete data have existed for some time under various names such as grade of membership modelling, probabilistic latent semantic analysis, and genotype inference with admixture. In this paper…

Machine Learning · Computer Science 2012-07-19 Wray L. Buntine , Aleks Jakulin

Conventional principal component analysis (PCA) finds a principal vector that maximizes the sum of second powers of principal components. We consider a generalized PCA that aims at maximizing the sum of an arbitrary convex function of…

Machine Learning · Computer Science 2019-11-19 Samuele Battaglino , Erdem Koyuncu