English
Related papers

Related papers: Sparse canonical correlation analysis from a predi…

200 papers

Recent developments in regularized Canonical Correlation Analysis (CCA) promise powerful methods for high-dimensional, multiview data analysis. However, justifying the structural assumptions behind many popular approaches remains a…

Methodology · Statistics 2025-11-18 Lennie Wells , Kumar Thurimella , Sergio Bacallado

Canonical correlation analysis (CCA) is a powerful technique for discovering whether or not hidden sources are commonly present in two (or more) datasets. Its well-appreciated merits include dimensionality reduction, clustering,…

Machine Learning · Computer Science 2018-08-15 Jia Chen , Gang Wang , Yanning Shen , Georgios B. Giannakis

Sparse Principal Component Analysis (sPCA) is a cardinal technique for obtaining combinations of features, or principal components (PCs), that explain the variance of high-dimensional datasets in an interpretable manner. This involves…

Optimization and Control · Mathematics 2025-12-02 Ryan Cory-Wright , Jean Pauphilet

Background: Canonical correlation analysis (CCA) is a classic statistical tool for investigating complex multivariate data. Correspondingly, it has found many diverse applications, ranging from molecular biology and medicine to social…

Methodology · Statistics 2019-01-14 Takoua Jendoubi , Korbinian Strimmer

Principal component analysis (PCA) has been widely applied to dimensionality reduction and data pre-processing for different applications in engineering, biology and social science. Classical PCA and its variants seek for linear projections…

Machine Learning · Computer Science 2017-07-11 Xiaojun Chang , Feiping Nie , Yi Yang , Heng Huang

We study the sample complexity of canonical correlation analysis (CCA), \ie, the number of samples needed to estimate the population canonical correlation and directions up to arbitrarily small error. With mild assumptions on the data…

Machine Learning · Computer Science 2019-10-22 Chao Gao , Dan Garber , Nathan Srebro , Jialei Wang , Weiran Wang

Canonical correlation analysis is a statistical technique that is used to find relations between two sets of variables. An important extension in pattern analysis is to consider more than two sets of variables. This problem can be expressed…

Machine Learning · Computer Science 2013-02-06 Jan Rupnik , Primoz Skraba , John Shawe-Taylor , Sabrina Guettes

We study the stochastic optimization of canonical correlation analysis (CCA), whose objective is nonconvex and does not decouple over training samples. Although several stochastic gradient based optimization algorithms have been recently…

Machine Learning · Computer Science 2016-11-15 Weiran Wang , Jialei Wang , Dan Garber , Nathan Srebro

Motivation: Biomedical studies increasingly produce multi-view high-dimensional datasets (e.g., multi-omics) that demand integrative analysis. Existing canonical correlation analysis (CCA) and generalized CCA methods address at most two of…

Machine Learning · Statistics 2025-02-27 Rong Wu , Ziqi Chen , Gen Li , Hai Shu

Since the beginning of the 21st century, the size, breadth, and granularity of data in biology and medicine has grown rapidly. In the example of neuroscience, studies with thousands of subjects are becoming more common, which provide…

We give an information-theoretic interpretation of Canonical Correlation Analysis (CCA) via (relaxed) Wyner's common information. CCA permits to extract from two high-dimensional data sets low-dimensional descriptions (features) that…

Information Theory · Computer Science 2020-03-02 Michael Gastpar , Erixhen Sula

Sparse principal component analysis (PCA) is a popular dimensionality reduction technique for obtaining principal components which are linear combinations of a small subset of the original features. Existing approaches cannot supply…

Optimization and Control · Mathematics 2022-02-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Investigating the relationships between two sets of variables helps to understand their interactions and can be done with canonical correlation analysis (CCA). However, the correlation between the two sets can sometimes depend on a third…

Canonical Correlation Analysis (CCA) is a classic technique for multi-view data analysis. To overcome the deficiency of linear correlation in practical multi-view learning tasks, various CCA variants were proposed to capture nonlinear…

Machine Learning · Computer Science 2019-07-05 Yaxin Shi , Yuangang Pan , Donna Xu , Ivor Tsang

Canonical correlation analysis (CCA) is a technique for finding correlated sets of features between two datasets. In this paper, we propose a novel extension of CCA to the online, streaming data setting: Sliding Window Informative Canonical…

Machine Learning · Statistics 2026-05-12 Arvind Prasadan

For multiple multivariate data sets, we derive conditions under which Generalized Canonical Correlation Analysis (GCCA) improves classification performance of the projected datasets, compared to standard Canonical Correlation Analysis (CCA)…

Machine Learning · Statistics 2024-06-27 Cencheng Shen , Ming Sun , Minh Tang , Carey E. Priebe

This paper studies high-dimensional canonical correlation analysis (CCA) with an emphasis on the vectors that define canonical variables. The paper shows that when two dimensions of data grow to infinity jointly and proportionally, the…

Econometrics · Economics 2025-01-24 Anna Bykhovskaya , Vadim Gorin

Networks pervade many disciplines of science for analyzing complex systems with interacting components. In particular, this concept is commonly used to model interactions between genes and identify closely associated genes forming…

Methodology · Statistics 2015-06-02 Y. X. Rachel Wang , Keni Jiang , Lewis J. Feldman , Peter J. Bickel , Haiyan Huang

Sparse principal component analysis (SPCA) has emerged as a powerful technique for modern data analysis, providing improved interpretation of low-rank structures by identifying localized spatial structures in the data and disambiguating…

We present a fast algorithm for approximate Canonical Correlation Analysis (CCA). Given a pair of tall-and-thin matrices, the proposed algorithm first employs a randomized dimensionality reduction transform to reduce the size of the input…

Data Structures and Algorithms · Computer Science 2013-05-03 Haim Avron , Christos Boutsidis , Sivan Toledo , Anastasios Zouzias