English
Related papers

Related papers: Efficient Canonical Correlation Analysis with Spar…

200 papers

In clinical and biomedical research, multiple high-dimensional datasets are nowadays routinely collected from omics and imaging devices. Multivariate methods, such as Canonical Correlation Analysis (CCA), integrate two (or more) datasets to…

Methodology · Statistics 2025-03-20 Nuria Senar , Mark van de Wiel , Aeilko Zwinderman , Michel Hof

Sparse Canonical Correlation Analysis (CCA) has received considerable attention in high-dimensional data analysis to study the relationship between two sets of random variables. However, there has been remarkably little theoretical…

Statistics Theory · Mathematics 2013-11-26 Mengjie Chen , Chao Gao , Zhao Ren , Harrison H. Zhou

We consider the scenario where one observes an outcome variable and sets of features from multiple assays, all measured on the same set of samples. One approach that has been proposed for dealing with this type of data is ``sparse multiple…

Quantitative Methods · Quantitative Biology 2014-01-24 Samuel M. Gross , Robert Tibshirani

Canonical Correlation Analysis (CCA) models are powerful for studying the associations between two sets of variables. The canonically correlated representations, termed \textit{canonical variates} are widely used in unsupervised learning to…

Machine Learning · Computer Science 2021-06-09 Ofir Lindenbaum , Moshe Salhov , Amir Averbuch , Yuval Kluger

Reducing the number of false discoveries is presently one of the most pressing issues in the life sciences. It is of especially great importance for many applications in neuroimaging and genomics, where datasets are typically…

Methodology · Statistics 2018-06-26 Alexej Gossmann , Pascal Zille , Vince Calhoun , Yu-Ping Wang

Given two data matrices $X$ and $Y$, sparse canonical correlation analysis (SCCA) is to seek two sparse canonical vectors $u$ and $v$ to maximize the correlation between $Xu$ and $Yv$. However, classical and sparse CCA models consider the…

Machine Learning · Computer Science 2017-10-16 Wenwen Min , Juan Liu , Shihua Zhang

We present a novel method for solving Canonical Correlation Analysis (CCA) in a sparse convex framework using a least squares approach. The presented method focuses on the scenario when one is interested in (or limited to) a primal…

Machine Learning · Statistics 2009-08-20 David R. Hardoon , John Shawe-Taylor

Sparse canonical correlation analysis (CCA) is a useful statistical tool to detect latent information with sparse structures. However, sparse CCA works only for two datasets, i.e., there are only two views or two distinct objects. To…

Machine Learning · Computer Science 2020-04-24 Jia Cai , Kexin Lv , Junyi Huo , Xiaolin Huang , Jie Yang

Canonical correlation analysis (CCA) is a technique to find statistical dependencies between a pair of multivariate data. However, its application to high dimensional data is limited due to the resulting time complexity. While the…

Machine Learning · Computer Science 2020-12-29 Naoko Koide-Majima , Kei Majima

Canonical correlation analysis (CCA) is a widely used technique for estimating associations between two sets of multi-dimensional variables. Recent advancements in CCA methods have expanded their application to decipher the interactions of…

Machine Learning · Statistics 2025-02-05 Hongju Park , Shuyang Bai , Zhenyao Ye , Hwiyoung Lee , Tianzhou Ma , Shuo Chen

This paper investigates fairness and bias in Canonical Correlation Analysis (CCA), a widely used statistical technique for examining the relationship between two sets of variables. We present a framework that alleviates unfairness by…

Machine Learning · Computer Science 2023-09-28 Zhuoping Zhou , Davoud Ataee Tarzanagh , Bojian Hou , Boning Tong , Jia Xu , Yanbo Feng , Qi Long , Li Shen

Recent developments in regularized Canonical Correlation Analysis (CCA) promise powerful methods for high-dimensional, multiview data analysis. However, justifying the structural assumptions behind many popular approaches remains a…

Methodology · Statistics 2025-11-18 Lennie Wells , Kumar Thurimella , Sergio Bacallado

Canonical correlation analysis (CCA) is a classical representation learning technique for finding correlated variables in multi-view data. Several nonlinear extensions of the original linear CCA have been proposed, including kernel and deep…

Machine Learning · Computer Science 2016-02-09 Tomer Michaeli , Weiran Wang , Karen Livescu

Sparse Canonical Correlation Analysis (SCCA) is a fundamental statistical tool for identifying linear relationships in high-dimensional, multi-view data. While minimax theory establishes an optimal sample complexity scaling additively with…

Signal Processing · Electrical Eng. & Systems 2026-04-21 Mengchu Xu , Jian Wang , Yonina C. Eldar

We study the stochastic optimization of canonical correlation analysis (CCA), whose objective is nonconvex and does not decouple over training samples. Although several stochastic gradient based optimization algorithms have been recently…

Machine Learning · Computer Science 2016-11-15 Weiran Wang , Jialei Wang , Dan Garber , Nathan Srebro

Canonical Correlation Analysis (CCA) is a widely used spectral technique for finding correlation structures in multi-view datasets. In this paper, we tackle the problem of large scale CCA, where classical algorithms, usually requiring…

Machine Learning · Statistics 2015-06-29 Zhuang Ma , Yichao Lu , Dean Foster

Canonical correlation analysis investigates linear relationships between two sets of variables, but often works poorly on modern data sets due to high-dimensionality and mixed data types such as continuous, binary and zero-inflated. To…

Methodology · Statistics 2021-04-01 Grace Yoon , Raymond J. Carroll , Irina Gaynanova

This paper considers the problem of canonical-correlation analysis (CCA) (Hotelling, 1936) and, more broadly, the generalized eigenvector problem for a pair of symmetric matrices. These are two fundamental problems in data analysis and…

Machine Learning · Computer Science 2016-05-30 Rong Ge , Chi Jin , Sham M. Kakade , Praneeth Netrapalli , Aaron Sidford

Canonical correlation analysis (CCA) is a technique for measuring the association between two multivariate data matrices. A regularized modification of canonical correlation analysis (RCCA) which imposes an $\ell_2$ penalty on the CCA…

Methodology · Statistics 2021-07-30 Elena Tuzhilina , Leonardo Tozzi , Trevor Hastie

The Canonical Correlation Analysis (CCA) family of methods is foundational in multiview learning. Regularised linear CCA methods can be seen to generalise Partial Least Squares (PLS) and be unified with a Generalized Eigenvalue Problem…

Machine Learning · Computer Science 2024-05-02 James Chapman , Lennie Wells , Ana Lawry Aguila