English
Related papers

Related papers: Canonical Correlation Analysis as Reduced Rank Reg…

200 papers

We study the stochastic optimization of canonical correlation analysis (CCA), whose objective is nonconvex and does not decouple over training samples. Although several stochastic gradient based optimization algorithms have been recently…

Machine Learning · Computer Science 2016-11-15 Weiran Wang , Jialei Wang , Dan Garber , Nathan Srebro

Manifold matching works to identify embeddings of multiple disparate data spaces into the same low-dimensional space, where joint inference can be pursued. It is an enabling methodology for fusion and inference from multiple and massive…

Machine Learning · Statistics 2012-09-18 Ming Sun , Carey E. Priebe , Minh Tang

Canonical correlation analysis (CCA) is a technique for finding correlations between different data modalities and learning low-dimensional representations. As fairness becomes crucial in machine learning, fair CCA has gained attention.…

Machine Learning · Computer Science 2025-10-02 Bojian Hou , Zhanliang Wang , Zhuoping Zhou , Boning Tong , Zexuan Wang , Jingxuan Bao , Duy Duong-Tran , Qi Long , Li Shen

Modern vision pipelines increasingly rely on pretrained image encoders whose representations are reused across tasks and models, yet these representations are often overcomplete and model-specific. We propose a simple, training-free method…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Dylan B. Lewis , Jens Gregor , Hector Santos-Villalobos

We aim to analyze the relation between two random vectors that may potentially have both different number of attributes as well as realizations, and which may even not have a joint distribution. This problem arises in many practical…

Machine Learning · Statistics 2015-11-12 Hoang-Vu Nguyen , Jilles Vreeken

Multi-view learning (MVL) is a strategy for fusing data from different sources or subsets. Canonical correlation analysis (CCA) is very important in MVL, whose main idea is to map data from different views onto a common space with maximum…

Machine Learning · Computer Science 2021-05-04 Chenfeng Guo , Dongrui Wu

Sparse canonical correlation analysis (CCA) is a useful statistical tool to detect latent information with sparse structures. However, sparse CCA works only for two datasets, i.e., there are only two views or two distinct objects. To…

Machine Learning · Computer Science 2020-04-24 Jia Cai , Kexin Lv , Junyi Huo , Xiaolin Huang , Jie Yang

Canonical correlation analysis (CCA) is a popular technique for learning representations that are maximally correlated across multiple views in data. In this paper, we extend the CCA based framework for learning a multiview mixture model.…

Machine Learning · Computer Science 2020-01-01 Nils Holzenberger , Raman Arora

Linking between two data sources is a basic building block in numerous computer vision problems. In this paper, we set to answer a fundamental cognitive question: are prior correspondences necessary for linking between different domains?…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Yedid Hoshen , Lior Wolf

Sparse Canonical Correlation Analysis (CCA) has received considerable attention in high-dimensional data analysis to study the relationship between two sets of random variables. However, there has been remarkably little theoretical…

Statistics Theory · Mathematics 2013-11-26 Mengjie Chen , Chao Gao , Zhao Ren , Harrison H. Zhou

Investigating the relationships between two sets of variables helps to understand their interactions and can be done with canonical correlation analysis (CCA). However, the correlation between the two sets can sometimes depend on a third…

Canonical correlation analysis (CCA) is a popular statistical technique for exploring relationships between datasets. In recent years, the estimation of sparse canonical vectors has emerged as an important but challenging variant of the CCA…

Machine Learning · Statistics 2023-11-06 Qiuyun Zhu , Yves Atchade

In this paper, we formulate the Canonical Correlation Analysis (CCA) problem on matrix manifolds. This framework provides a natural way for dealing with matrix constraints and tools for building efficient algorithms even in an adaptive…

Machine Learning · Computer Science 2012-07-03 Florian Yger , Maxime Berar , Gilles Gasso , Alain Rakotomamonjy

Learning representations of two views of data such that the resulting representations are highly linearly correlated is appealing in machine learning. In this paper, we present a canonical correlation guided learning framework, which allows…

Machine Learning · Computer Science 2024-10-01 Zhiwen Chen , Siwen Mo , Haobin Ke , Steven X. Ding , Zhaohui Jiang , Chunhua Yang , Weihua Gui

Motivation: Biomedical studies increasingly produce multi-view high-dimensional datasets (e.g., multi-omics) that demand integrative analysis. Existing canonical correlation analysis (CCA) and generalized CCA methods address at most two of…

Machine Learning · Statistics 2025-02-27 Rong Wu , Ziqi Chen , Gen Li , Hai Shu

Canonical correlation analysis was proposed by Hotelling [6] and it measures linear relationship between two multidimensional variables. In high dimensional setting, the classical canonical correlation analysis breaks down. We propose a…

Machine Learning · Statistics 2017-06-06 Xiaotong Suo , Victor Minden , Bradley Nelson , Robert Tibshirani , Michael Saunders

We consider the scenario where one observes an outcome variable and sets of features from multiple assays, all measured on the same set of samples. One approach that has been proposed for dealing with this type of data is ``sparse multiple…

Quantitative Methods · Quantitative Biology 2014-01-24 Samuel M. Gross , Robert Tibshirani

Discriminative Canonical Correlation Analysis (DCCA) is a powerful supervised feature extraction technique for two sets of multivariate data, which has wide applications in pattern recognition. DCCA consists of two parts: (i) mean-centering…

Quantum Physics · Physics 2022-06-14 Yong-Mei Li , Hai-Ling Liu , Shi-Jie Pan , Su-Juan Qin , Fei Gao , Qiao-Yan Wen

The pose problem is one of the bottlenecks in automatic face recognition. We argue that one of the diffculties in this problem is the severe misalignment in face images or feature vectors with different poses. In this paper, we propose that…

Computer Vision and Pattern Recognition · Computer Science 2015-07-30 Annan Li , Shiguang Shan , Xilin Chen , Bingpeng Ma , Shuicheng Yan , Wen Gao

Recent work has sought to understand the behavior of neural networks by comparing representations between layers and between different trained models. We examine methods for comparing neural network representations based on canonical…

Machine Learning · Computer Science 2019-07-22 Simon Kornblith , Mohammad Norouzi , Honglak Lee , Geoffrey Hinton