English
Related papers

Related papers: Efficient Algorithms for Large-scale Generalized E…

200 papers

Canonical Correlation Analysis (CCA) is a linear representation learning method that seeks maximally correlated variables in multi-view data. Non-linear CCA extends this notion to a broader family of transformations, which are more powerful…

Machine Learning · Computer Science 2020-02-11 Amichai Painsky , Meir Feder , Naftali Tishby

Canonical correlation analysis is a statistical technique that is used to find relations between two sets of variables. An important extension in pattern analysis is to consider more than two sets of variables. This problem can be expressed…

Machine Learning · Computer Science 2013-02-06 Jan Rupnik , Primoz Skraba , John Shawe-Taylor , Sabrina Guettes

We consider the problem of sparse canonical correlation analysis (CCA), i.e., the search for two linear combinations, one for each multivariate, that yield maximum correlation using a specified number of variables. We propose an efficient…

Computation · Statistics 2008-01-18 Ami Wiesel , Mark Kliger , Alfred O. Hero

Regularized generalized canonical correlation analysis (RGCCA) is a generalization of regularized canonical correlation analysis to three or more sets of variables, which is a component-based approach aiming to study the relationships…

Statistics Theory · Mathematics 2025-03-21 Kuo-Yue Li , Qi-Ye Zhang , Yong-Han Sun

We study the sample complexity of canonical correlation analysis (CCA), \ie, the number of samples needed to estimate the population canonical correlation and directions up to arbitrarily small error. With mild assumptions on the data…

Machine Learning · Computer Science 2019-10-22 Chao Gao , Dan Garber , Nathan Srebro , Jialei Wang , Weiran Wang

Canonical Correlation Analysis (CCA) is a statistical technique used to extract common information from multiple data sources or views. It has been used in various representation learning problems, such as dimensionality reduction, word…

Machine Learning · Computer Science 2020-06-18 Benjamin Dutton

Canonical correlation analysis (CCA) has proven an effective tool for two-view dimension reduction due to its profound theoretical foundation and success in practical applications. In respect of multi-view learning, however, it is limited…

Machine Learning · Statistics 2015-02-10 Yong Luo , Dacheng Tao , Yonggang Wen , Kotagiri Ramamohanarao , Chao Xu

Canonical correlation analysis (CCA) is a statistical learning method that seeks to build view-independent latent representations from multi-view data. This method has been successfully applied to several pattern analysis tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2018-12-24 Hichem Sahbi

This paper studies high-dimensional canonical correlation analysis (CCA) with an emphasis on the vectors that define canonical variables. The paper shows that when two dimensions of data grow to infinity jointly and proportionally, the…

Econometrics · Economics 2025-01-24 Anna Bykhovskaya , Vadim Gorin

Given two data matrices $X$ and $Y$, sparse canonical correlation analysis (SCCA) is to seek two sparse canonical vectors $u$ and $v$ to maximize the correlation between $Xu$ and $Yv$. However, classical and sparse CCA models consider the…

Machine Learning · Computer Science 2017-10-16 Wenwen Min , Juan Liu , Shihua Zhang

Canonical correlation analysis (CCA) is a standard tool for studying associations between two data sources; however, it is not designed for data with count or proportion measurement types. In addition, while CCA uncovers common signals, it…

Computation · Statistics 2022-08-02 Dongbang Yuan , Yunfeng Zhang , Shuai Guo , Wenyi Wang , Irina Gaynanova

Classic and deep generalized canonical correlation analysis (GCCA) algorithms seek low-dimensional common representations of data entities from multiple ``views'' (e.g., audio and image) using linear transformations and neural networks,…

Machine Learning · Computer Science 2023-04-05 Sagar Shrestha , Xiao Fu

There are a multitude of methods to perform multi-set correlated component analysis (MCCA), including some that require iterative solutions. The methods differ on the criterion they optimize and the constraints placed on the solutions. This…

Machine Learning · Statistics 2018-02-13 Lucas C Parra

The pose problem is one of the bottlenecks in automatic face recognition. We argue that one of the diffculties in this problem is the severe misalignment in face images or feature vectors with different poses. In this paper, we propose that…

Computer Vision and Pattern Recognition · Computer Science 2015-07-30 Annan Li , Shiguang Shan , Xilin Chen , Bingpeng Ma , Shuicheng Yan , Wen Gao

The sum-of-correlations (SUMCOR) formulation of generalized canonical correlation analysis (GCCA) seeks highly correlated low-dimensional representations of different views via maximizing pairwise latent similarity of the views. SUMCOR is…

Machine Learning · Computer Science 2018-12-26 Charilaos I. Kanatsoulis , Xiao Fu , Nicholas D. Sidiropoulos , Mingyi Hong

Canonical correlation analysis (CCA) is a multivariate statistical method which describes the associations between two sets of variables. The objective is to find linear combinations of the variables in each data set having maximal…

Methodology · Statistics 2015-01-07 Ines Wilms , Christophe Croux

Recent work has sought to understand the behavior of neural networks by comparing representations between layers and between different trained models. We examine methods for comparing neural network representations based on canonical…

Machine Learning · Computer Science 2019-07-22 Simon Kornblith , Mohammad Norouzi , Honglak Lee , Geoffrey Hinton

Canonical correlation analysis (CCA) describes the associations between two sets of variables by maximizing the correlation between linear combinations of the variables in each data set. However, in high-dimensional settings where the…

Methodology · Statistics 2015-01-07 Ines Wilms , Christophe Croux

Massive data analysis calls for distributed algorithms and theories. We design a multi-round distributed algorithm for canonical correlation analysis. We construct principal directions through the convex formulation of canonical correlation…

Computation · Statistics 2024-12-24 Canyi Chen , Liping Zhu

For multiple multivariate data sets, we derive conditions under which Generalized Canonical Correlation Analysis (GCCA) improves classification performance of the projected datasets, compared to standard Canonical Correlation Analysis (CCA)…

Machine Learning · Statistics 2024-06-27 Cencheng Shen , Ming Sun , Minh Tang , Carey E. Priebe