English
Related papers

Related papers: Whitening-Free Least-Squares Non-Gaussian Componen…

200 papers

Given two data matrices $X$ and $Y$, sparse canonical correlation analysis (SCCA) is to seek two sparse canonical vectors $u$ and $v$ to maximize the correlation between $Xu$ and $Yv$. However, classical and sparse CCA models consider the…

Machine Learning · Computer Science 2017-10-16 Wenwen Min , Juan Liu , Shihua Zhang

Linear principal component analysis (PCA) learns (semi-)orthogonal transformations by orienting the axes to maximize variance. Consequently, it can only identify orthogonal axes whose variances are clearly distinct, but it cannot identify…

Machine Learning · Computer Science 2024-07-02 Fahdi Kanavati , Lucy Katsnith , Masayuki Tsuneki

Background: Independent Component Analysis (ICA) is a widespread tool for exploration and denoising of electroencephalography (EEG) or magnetoencephalography (MEG) signals. In its most common formulation, ICA assumes that the signal matrix…

Signal Processing · Electrical Eng. & Systems 2020-08-25 Pierre Ablin , Jean-François Cardoso , Alexandre Gramfort

Principal Component Analysis (PCA) is a widely utilized technique for dimensionality reduction; however, its inherent lack of interpretability-stemming from dense linear combinations of all feature-limits its applicability in many domains.…

Machine Learning · Computer Science 2025-04-01 Loc Hoang Tran

Independent Component Analysis (ICA) is a classical method for recovering latent variables with useful identifiability properties. For independent variables, cumulant tensors are diagonal; relaxing independence yields tensors whose zero…

Statistics Theory · Mathematics 2025-10-10 Alvaro Ribot , Anna Seigal , Piotr Zwiernik

Stretched Gaussian distribution is the fundamental solution of the Hausdorff derivative diffusion equation and its corresponding stretched Gaussian noise is a widely encountered non-Gaussian noise in science and engineering. The least…

Numerical Analysis · Mathematics 2019-06-17 Wei Xu , Yingjie Liang , Wen Chen

In our previous work, a reduced order model (ROM) for a stochastic system was made, where noisy data was projected onto principal component analysis (PCA)-derived basis vectors to obtain an accurate reconstruction of the noise-free data.…

Numerical Analysis · Mathematics 2017-02-07 Indika Udagedara , Brian Helenbrook , Aaron Luttman , Jared Catenacci

Performing stochastic inversion on a computationally expensive forward simulation model with a high-dimensional uncertain parameter space (e.g. a spatial random field) is computationally prohibitive even with gradient information provided.…

Computation · Statistics 2018-03-19 Charanraj A. Thimmisetty , Wenju Zhao , Xiao Chen , Charles H. Tong , Joshua A. White

We propose a new general method of extracting non-Gaussian features in a given field. It sets the mean of the field to zero and renormalizes its Fourier (or multipole) power to white noise, while keeping the phase information unchanged.…

Astrophysics · Physics 2007-05-23 Jiun-Huei Proty Wu

We present a technique for spatiotemporal data analysis called nonlinear Laplacian spectral analysis (NLSA), which generalizes singular spectrum analysis (SSA) to take into account the nonlinear manifold structure of complex data sets. The…

Data Analysis, Statistics and Probability · Physics 2012-07-18 Dimitrios Giannakis , Andrew J. Majda

Canonical Correlation Analysis (CCA) is a classical tool for finding correlations among the components of two random vectors. In recent years, CCA has been widely applied to the analysis of genomic data, where it is common for researchers…

Machine Learning · Computer Science 2012-06-22 Sivaraman Balakrishnan , Kriti Puniyani , John Lafferty

We consider multi-class classification problems for high dimensional data. Following the idea of reduced-rank linear discriminant analysis (LDA), we introduce a new dimension reduction tool with a flavor of supervised principal component…

Methodology · Statistics 2017-03-28 Yue Selena Niu , Ning Hao , Bin Dong

Linear latent variable models such as principal component analysis (PCA), independent component analysis (ICA), canonical correlation analysis (CCA), and factor analysis (FA) identify latent directions (or loadings) either ordered or…

Machine Learning · Statistics 2023-07-13 Jesse Stevens , Daniel N. Wilke , Itumeleng Setshedi

We propose MNPCA, a novel non-linear generalization of (2D)$^2${PCA}, a classical linear method for the simultaneous dimension reduction of both rows and columns of a set of matrix-valued data. MNPCA is based on optimizing over separate…

Statistics Theory · Mathematics 2023-10-11 Joni Virta , Andreas Artemiou

Principal Component Analysis (PCA) is the workhorse tool for dimensionality reduction in this era of big data. While often overlooked, the purpose of PCA is not only to reduce data dimensionality, but also to yield features that are…

Machine Learning · Computer Science 2021-11-30 Arpita Gang , Waheed U. Bajwa

An increasing number of data science and machine learning problems rely on computation with tensors, which better capture the multi-way relationships and interactions of data than matrices. When tapping into this critical advantage, a key…

Machine Learning · Statistics 2023-02-23 Harry Dong , Tian Tong , Cong Ma , Yuejie Chi

Dictionary learning and component analysis models are fundamental for learning compact representations that are relevant to a given task (feature extraction, dimensionality reduction, denoising, etc.). The model complexity is encoded by…

Machine Learning · Statistics 2018-11-13 Mehdi Bahri , Yannis Panagakis , Stefanos Zafeiriou

Gaussian noise removal is an interesting area in digital image processing not only to improve the visual quality, but for its impact on other post-processing algorithms like image registration or segmentation. Many presented…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Mojtaba Kazemi , Ehsan Mohammadi. P , Parichehr shahidi sadeghi , Mohamad B. Menhaj

Principal Component Analysis (PCA)-based techniques can separate data into different uncorrelated components and facilitate the statistical analysis as a pre-processing step. Independent Component Analysis (ICA) can separate statistically…

Instrumentation and Methods for Astrophysics · Physics 2023-01-03 Güray Hatipoğlu

This paper proposes an extension of principal component analysis for Gaussian process (GP) posteriors, denoted by GP-PCA. Since GP-PCA estimates a low-dimensional space of GP posteriors, it can be used for meta-learning, which is a…

Machine Learning · Statistics 2023-04-07 Hideaki Ishibashi , Shotaro Akaho