English
Related papers

Related papers: Sparse Kernel Canonical Correlation Analysis via $…

200 papers

We propose novel first-order stochastic approximation algorithms for canonical correlation analysis (CCA). Algorithms presented are instances of inexact matrix stochastic gradient (MSG) and inexact matrix exponentiated gradient (MEG), and…

Machine Learning · Computer Science 2018-02-27 Raman Arora , Teodor V. Marinov , Poorya Mianjy , Nathan Srebro

Canonical Correlation Analysis (CCA) is a statistical technique used to extract common information from multiple data sources or views. It has been used in various representation learning problems, such as dimensionality reduction, word…

Machine Learning · Computer Science 2020-06-18 Benjamin Dutton

Canonical correlation analysis (CCA) has proven an effective tool for two-view dimension reduction due to its profound theoretical foundation and success in practical applications. In respect of multi-view learning, however, it is limited…

Machine Learning · Statistics 2015-02-10 Yong Luo , Dacheng Tao , Yonggang Wen , Kotagiri Ramamohanarao , Chao Xu

The Canonical Correlation Analysis (CCA) family of methods is foundational in multiview learning. Regularised linear CCA methods can be seen to generalise Partial Least Squares (PLS) and be unified with a Generalized Eigenvalue Problem…

Machine Learning · Computer Science 2024-05-02 James Chapman , Lennie Wells , Ana Lawry Aguila

Canonical correlation analysis is a technique to extract common features from a pair of multivariate data. In complex situations, however, it does not extract useful features because of its linearity. On the other hand, kernel method used…

Machine Learning · Computer Science 2007-05-23 Shotaro Akaho

Random features approach has been widely used for kernel approximation in large-scale machine learning. A number of recent studies have explored data-dependent sampling of features, modifying the stochastic oracle from which random features…

Machine Learning · Computer Science 2021-11-03 Yinsong Wang , Shahin Shahrampour

Multi-view learning (MVL) is a strategy for fusing data from different sources or subsets. Canonical correlation analysis (CCA) is very important in MVL, whose main idea is to map data from different views onto a common space with maximum…

Machine Learning · Computer Science 2021-05-04 Chenfeng Guo , Dongrui Wu

This article critically assesses the utility of the classical statistical technique of Canonical Correlation Analysis (CCA) for studying spatial associations and proposes a new approach to enhance it. Unlike bivariate correlation analysis,…

Methodology · Statistics 2026-02-12 Zhenzhi Jiao , Angela Yao , Ran Tao , Jean-Claude Thill

In this paper linear canonical correlation analysis (LCCA) is generalized by applying a structured transform to the joint probability distribution of the considered pair of random vectors, i.e., a transformation of the joint probability…

Methodology · Statistics 2015-06-03 Koby Todros , Alfred O. Hero

We propose a new technique, Singular Vector Canonical Correlation Analysis (SVCCA), a tool for quickly comparing two representations in a way that is both invariant to affine transform (allowing comparison between different layers and…

Machine Learning · Statistics 2017-11-09 Maithra Raghu , Justin Gilmer , Jason Yosinski , Jascha Sohl-Dickstein

Recent work has sought to understand the behavior of neural networks by comparing representations between layers and between different trained models. We examine methods for comparing neural network representations based on canonical…

Machine Learning · Computer Science 2019-07-22 Simon Kornblith , Mohammad Norouzi , Honglak Lee , Geoffrey Hinton

Tensor canonical correlation analysis (TCCA) has garnered significant attention due to its effectiveness in capturing high-order correlations in multi-view learning. However, existing TCCA methods often underemphasize the characterization…

Optimization and Control · Mathematics 2025-12-10 Yanjiao Zhu , Wanquan Liu , Xianchao Xiu , Jianqin Sun

Discriminative Canonical Correlation Analysis (DCCA) is a powerful supervised feature extraction technique for two sets of multivariate data, which has wide applications in pattern recognition. DCCA consists of two parts: (i) mean-centering…

Quantum Physics · Physics 2022-06-14 Yong-Mei Li , Hai-Ling Liu , Shi-Jie Pan , Su-Juan Qin , Fei Gao , Qiao-Yan Wen

Since the beginning of the 21st century, the size, breadth, and granularity of data in biology and medicine has grown rapidly. In the example of neuroscience, studies with thousands of subjects are becoming more common, which provide…

Background: Canonical correlation analysis (CCA) is a classic statistical tool for investigating complex multivariate data. Correspondingly, it has found many diverse applications, ranging from molecular biology and medicine to social…

Methodology · Statistics 2019-01-14 Takoua Jendoubi , Korbinian Strimmer

Combining the predictions of multiple trained models through ensembling is generally a good way to improve accuracy by leveraging the different learned features of the models, however it comes with high computational and storage costs.…

Machine Learning · Computer Science 2024-07-09 Stefan Horoi , Albert Manuel Orozco Camacho , Eugene Belilovsky , Guy Wolf

We give an information-theoretic interpretation of Canonical Correlation Analysis (CCA) via (relaxed) Wyner's common information. CCA permits to extract from two high-dimensional data sets low-dimensional descriptions (features) that…

Information Theory · Computer Science 2020-03-02 Michael Gastpar , Erixhen Sula

Canonical correlation analysis (CCA) is a method for reducing the dimension of data represented using two views. It has been previously used to derive word embeddings, where one view indicates a word, and the other view indicates its…

Computation and Language · Computer Science 2016-07-28 Dominique Osborne , Shashi Narayan , Shay B. Cohen

Manifold matching works to identify embeddings of multiple disparate data spaces into the same low-dimensional space, where joint inference can be pursued. It is an enabling methodology for fusion and inference from multiple and massive…

Machine Learning · Statistics 2012-09-18 Ming Sun , Carey E. Priebe , Minh Tang

This paper considers the problem of canonical-correlation analysis (CCA) (Hotelling, 1936) and, more broadly, the generalized eigenvector problem for a pair of symmetric matrices. These are two fundamental problems in data analysis and…

Machine Learning · Computer Science 2016-05-30 Rong Ge , Chi Jin , Sham M. Kakade , Praneeth Netrapalli , Aaron Sidford