English
Related papers

Related papers: Two improved algorithms for sparse generalized can…

200 papers

We study the robust principal component analysis (RPCA) problem in a distributed setting. The goal of RPCA is to find an underlying low-rank estimation for a raw data matrix when the data matrix is subject to the corruption of gross sparse…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-16 Wenda Chu

This paper presents a robust matrix elastic net based canonical correlation analysis (RMEN-CCA) for multiple view unsupervised learning problems, which emphasizes the combination of CCA and the robust matrix elastic net (RMEN) used as…

Machine Learning · Computer Science 2017-11-16 Peng-Bo Zhang , Zhi-Xin Yang

Sparse Principal Component Analysis (Sparse PCA) is a pivotal tool in data analysis and dimensionality reduction. However, Sparse PCA is a challenging problem in both theory and practice: it is known to be NP-hard and current exact methods…

Machine Learning · Computer Science 2025-03-06 Alberto Del Pia , Dekun Zhou , Yinglun Zhu

In this paper, a new method is proposed for sparse PCA based on the recursive divide-and-conquer methodology. The main idea is to separate the original sparse PCA problem into a series of much simpler sub-problems, each having a closed-form…

Computer Vision and Pattern Recognition · Computer Science 2012-12-03 Qian Zhao , Deyu Meng , Zongben Xu

Robust principal component analysis (RPCA) seeks a low-rank component and a sparse component from their summation. Yet, in many applications of interest, the sparse foreground actually replaces, or occludes, elements from the low-rank…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Yinjian Wang , Wei Li , Yuanyuan Gui , James E. Fowler , Gemine Vivone

Canonical correlation analysis (CCA) is a technique for finding correlated sets of features between two datasets. In this paper, we propose a novel extension of CCA to the online, streaming data setting: Sliding Window Informative Canonical…

Machine Learning · Statistics 2026-05-12 Arvind Prasadan

Interpreting the internal reasoning of vision-language models is essential for deploying AI in safety-critical domains. Concept-based explainability provides a human-aligned lens by representing a model's behavior through semantically…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Ehud Gordon , Meir Yossef Levi , Guy Gilboa

In this study, an advanced CCA-based algorithn called hybrid template canonical correlation analysis (HTCCA) was proposed to improve the performance of brain-computer interface (BCI) based on steady state visual evoked potential (SSVEP)…

Signal Processing · Electrical Eng. & Systems 2021-05-04 Runfeng Miao , Li Zhang , Qiang Sun

Canonical correlation analysis (CCA) is a fundamental statistical tool for exploring the correlation structure between two sets of random variables. In this paper, motivated by recent success of applying CCA to learn low dimensional…

Statistics Theory · Mathematics 2018-01-23 Zhuang Ma , Xiaodong Li

Classical methods such as Principal Component Analysis (PCA) and Canonical Correlation Analysis (CCA) are ubiquitous in statistics. However, these techniques are only able to reveal linear relationships in data. Although nonlinear variants…

Machine Learning · Statistics 2014-05-14 David Lopez-Paz , Suvrit Sra , Alex Smola , Zoubin Ghahramani , Bernhard Schölkopf

Recently the widely used multi-view learning model, Canonical Correlation Analysis (CCA) has been generalised to the non-linear setting via deep neural networks. Existing deep CCA models typically first decorrelate the feature dimensions of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Xiaobin Chang , Tao Xiang , Timothy M. Hospedales

The availability of multi-modality datasets provides a unique opportunity to characterize the same object of interest using multiple viewpoints more comprehensively. In this work, we investigate the use of canonical correlation analysis…

Machine Learning · Computer Science 2024-10-28 Vaishnavi Subramanian , Tanveer Syeda-Mahmood , Minh N. Do

Sparse principal component analysis (PCA), an important variant of PCA, attempts to find sparse loading vectors when conducting dimension reduction. This paper considers the nonsmooth Riemannian optimization problem associated with the…

Optimization and Control · Mathematics 2021-09-03 Wen Huang , Ke Wei

We introduce a technique based on the singular vector canonical correlation analysis (SVCCA) for measuring the generality of neural network layers across a continuously-parametrized set of tasks. We illustrate this method by studying…

Machine Learning · Statistics 2018-07-03 Martin Magill , Faisal Qureshi , Hendrick W. de Haan

Principal Component Analysis (PCA) has been used to study the pathogenesis of diseases. To enhance the interpretability of classical PCA, various improved PCA methods have been proposed to date. Among these, a typical method is the…

Machine Learning · Computer Science 2019-05-29 Chun-Mei Feng , Yong Xu , Jin-Xing Liu , Ying-Lian Gao , Chun-Hou Zheng

Multi-cellular programs (MCPs) are coordinated patterns of gene expression across interacting cell types that collectively drive complex biological processes such as tissue development and immune responses. While MCPs are typically…

Methodology · Statistics 2026-02-05 Qi Xu , Jing Lei , Kathryn Roeder

We present deep variational canonical correlation analysis (VCCA), a deep multi-view learning model that extends the latent variable model interpretation of linear CCA to nonlinear observation models parameterized by deep neural networks.…

Machine Learning · Computer Science 2017-02-28 Weiran Wang , Xinchen Yan , Honglak Lee , Karen Livescu

Principal component analysis (PCA) is a well-established tool in machine learning and data processing. The principal axes in PCA were shown to be equivalent to the maximum marginal likelihood estimator of the factor loading matrix in a…

Methodology · Statistics 2019-10-25 Mengyang Gu , Weining Shen

We develop a scalable algorithmic framework for sparse convex quantile regression (SCQR), addressing key computational challenges in the literature. Enhancing the classical CQR model, we introduce L2-norm regularization and an…

Optimization and Control · Mathematics 2025-09-03 Xiaoyu Luo , Chuanhou Gao

We develop a novel randomized conjugate gradient least squares (RCGLS) method for solving least-squares problems, in which iterative sketching is employed at each step to reduce the dimension and hence the computational cost. In particular,…

Numerical Analysis · Mathematics 2026-05-26 Yun Zeng , Jian-Feng Cai , Deren Han , Jiaxin Xie