English
Related papers

Related papers: Singular Value Decomposition and Principal Compone…

200 papers

The Principal Component Analysis (PCA) is a data dimensionality reduction technique well-suited for processing data from sensor networks. It can be applied to tasks like compression, event detection, and event recognition. This technique is…

Networking and Internet Architecture · Computer Science 2010-03-13 Yann-Aël Le Borgne , Sylvain Raybaud , Gianluca Bontempi

Given a sample covariance matrix, we examine the problem of maximizing the variance explained by a linear combination of the input variables while constraining the number of nonzero coefficients in this combination. This is known as sparse…

Optimization and Control · Mathematics 2010-12-24 Youwei Zhang , Alexandre d'Aspremont , Laurent El Ghaoui

Convolutional Neural Networks (CNNs) have made significant progress on several computer vision benchmarks, but are fraught with numerous non-human biases such as vulnerability to adversarial samples. Their lack of explainability makes…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Malhar Jere , Maghav Kumar , Farinaz Koushanfar

Principal Component Analysis is a novel way of of dimensionality reduction. This problem essentially boils down to finding the top k eigen vectors of the data covariance matrix. A considerable amount of literature is found on algorithms…

Machine Learning · Computer Science 2019-01-08 Jian Vora

Principal Component Analysis (PCA) is a popular tool for dimensionality reduction and feature extraction in data analysis. There is a probabilistic version of PCA, known as Probabilistic PCA (PPCA). However, standard PCA and PPCA are not…

Machine Learning · Computer Science 2019-04-16 Bowen Zhao , Xi Xiao , Wanpeng Zhang , Bin Zhang , Shutao Xia

Sequential or online dimensional reduction is of interests due to the explosion of streaming data based applications and the requirement of adaptive statistical modeling, in many emerging fields, such as the modeling of energy end-use…

Machine Learning · Statistics 2014-07-17 Zhaoyi Kang , Costas J. Spanos

Principal Component Analysis (PCA) is a powerful and popular dimensionality reduction technique. However, due to its linear nature, it often fails to capture the complex underlying structure of real-world data. While Kernel PCA (kPCA)…

Machine Learning · Computer Science 2026-02-05 Thomas Uriot , Elise Chung

In this article, we consider the sparse tensor singular value decomposition, which aims for dimension reduction on high-dimensional high-order data with certain sparsity structure. A method named Sparse Tensor Alternating Thresholding for…

Statistics Theory · Mathematics 2024-07-09 Anru Zhang , Rungang Han

Sparse Principal Component Analysis (SPCA) is an important technique for high-dimensional data analysis, improving interpretability by imposing sparsity on principal components. However, existing methods often fail to simultaneously…

Machine Learning · Computer Science 2026-03-03 Difei Cheng , Qiao Hu

Principal components analysis (PCA) is a well-known technique for approximating a tabular data set by a low rank matrix. Here, we extend the idea of PCA to handle arbitrary data sets consisting of numerical, Boolean, categorical, ordinal,…

Machine Learning · Statistics 2015-05-06 Madeleine Udell , Corinne Horn , Reza Zadeh , Stephen Boyd

Single-cell RNA sequencing (scRNA-seq) has revolutionized our ability to analyze gene expression at the cellular level. By providing data on gene expression for each individual cell, scRNA-seq generates large datasets with thousands of…

Computational Complexity · Computer Science 2025-02-11 Md Romizul Islam , Swakkhar Shatabda

Data integration, or the strategic analysis of multiple sources of data simultaneously, can often lead to discoveries that may be hidden in individualistic analyses of a single data source. We develop a new unsupervised data integration…

Methodology · Statistics 2021-04-06 Tiffany M. Tang , Genevera I. Allen

The generalized singular value decomposition (GSVD) of a matrix pair $\{A, L\}$ with $A\in\mathbb{R}^{m\times n}$ and $L\in\mathbb{R}^{p\times n}$ generalizes the singular value decomposition (SVD) of a single matrix. In this paper, we…

Numerical Analysis · Mathematics 2024-04-02 Haibo Li

Regularized variants of Principal Components Analysis, especially Sparse PCA and Functional PCA, are among the most useful tools for the analysis of complex high-dimensional data. Many examples of massive data, have both sparse and…

Machine Learning · Statistics 2019-08-21 Genevera I. Allen , Michael Weylandt

The high-dimensional feature space of the hyperspectral imagery poses major challenges to the processing and analysis of the hyperspectral data sets. In such a case, dimensionality reduction is necessary to decrease the computational…

Image and Video Processing · Electrical Eng. & Systems 2024-06-06 Mustafa Ustuner

In this paper, we use semi-definite programming and generalized principal component analysis (GPCA) to distinguish between two or more different facial expressions. In the first step, semi-definite programming is used to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2009-06-10 Behnood Gholami , Allen R. Tannenbaum , Wassim M. Haddad

We extend the principal component analysis (PCA) to second-order stationary vector time series in the sense that we seek for a contemporaneous linear transformation for a $p$-variate time series such that the transformed series is segmented…

Methodology · Statistics 2018-12-21 Jinyuan Chang , Bin Guo , Qiwei Yao

The tensor Singular Value Decomposition (t-SVD) for third order tensors that was proposed by Kilmer and Martin~\cite{2011kilmer} has been applied successfully in many fields, such as computed tomography, facial recognition, and video…

Numerical Analysis · Mathematics 2016-09-23 Jiani Zhang , Arvind K. Saibaba , Misha Kilmer , Shuchin Aeron

Dimensionality reduction (DR) is an important technique for data exploration and knowledge discovery. However, most of the main DR methods are either linear (e.g., PCA), do not provide an explicit mapping between the original data and its…

Neural and Evolutionary Computing · Computer Science 2022-03-15 Thomas Uriot , Marco Virgolin , Tanja Alderliesten , Peter Bosman

We present an alternative method for carrying out a principal-component analysis of Wilson coefficients in standard model effective field theory (SMEFT). The method is based on singular-value decomposition (SVD). The SVD method provides…

High Energy Physics - Phenomenology · Physics 2020-07-03 Geoffrey T. Bodwin , Hee Sok Chung