English
Related papers

Related papers: Multiview Representation Learning for a Union of S…

200 papers

Canonical correlation analysis (CCA) is a multivariate statistical technique for finding the linear relationship between two sets of variables. The kernel generalization of CCA named kernel CCA has been proposed to find nonlinear relations…

Machine Learning · Statistics 2017-01-17 Xiaowei Zhang , Delin Chu , Li-Zhi Liao , Michael K. Ng

Canonical correlation analysis (CCA) describes the associations between two sets of variables by maximizing the correlation between linear combinations of the variables in each data set. However, in high-dimensional settings where the…

Methodology · Statistics 2015-01-07 Ines Wilms , Christophe Croux

Classic and deep generalized canonical correlation analysis (GCCA) algorithms seek low-dimensional common representations of data entities from multiple ``views'' (e.g., audio and image) using linear transformations and neural networks,…

Machine Learning · Computer Science 2023-04-05 Sagar Shrestha , Xiao Fu

Canonical Correlation Analysis (CCA) is a widely used statistical tool with both well established theory and favorable performance for a wide range of machine learning problems. However, computing CCA for huge datasets can be very slow…

Machine Learning · Statistics 2014-12-31 Yichao Lu , Dean P. Foster

Canonical Correlation Analysis (CCA) is a widely used spectral technique for finding correlation structures in multi-view datasets. In this paper, we tackle the problem of large scale CCA, where classical algorithms, usually requiring…

Machine Learning · Statistics 2015-06-29 Zhuang Ma , Yichao Lu , Dean Foster

Canonical Correlation Analysis (CCA) models are powerful for studying the associations between two sets of variables. The canonically correlated representations, termed \textit{canonical variates} are widely used in unsupervised learning to…

Machine Learning · Computer Science 2021-06-09 Ofir Lindenbaum , Moshe Salhov , Amir Averbuch , Yuval Kluger

Sparse canonical correlation analysis (CCA) is a useful statistical tool to detect latent information with sparse structures. However, sparse CCA works only for two datasets, i.e., there are only two views or two distinct objects. To…

Machine Learning · Computer Science 2020-04-24 Jia Cai , Kexin Lv , Junyi Huo , Xiaolin Huang , Jie Yang

In this paper, we propose the Discriminative Multiple Canonical Correlation Analysis (DMCCA) for multimodal information analysis and fusion. DMCCA is capable of extracting more discriminative characteristics from multimodal information…

Machine Learning · Computer Science 2021-03-02 Lei Gao , Lin Qi , Enqing Chen , Ling Guan

We consider the scenario where one observes an outcome variable and sets of features from multiple assays, all measured on the same set of samples. One approach that has been proposed for dealing with this type of data is ``sparse multiple…

Quantitative Methods · Quantitative Biology 2014-01-24 Samuel M. Gross , Robert Tibshirani

Multiview canonical correlation analysis (MCCA) seeks latent low-dimensional representations encountered with multiview data of shared entities (a.k.a. common sources). However, existing MCCA approaches do not exploit the geometry of the…

Signal Processing · Electrical Eng. & Systems 2019-05-22 Jia Chen , Gang Wang , Georgios B. Giannakis

We propose a new technique, Singular Vector Canonical Correlation Analysis (SVCCA), a tool for quickly comparing two representations in a way that is both invariant to affine transform (allowing comparison between different layers and…

Machine Learning · Statistics 2017-11-09 Maithra Raghu , Justin Gilmer , Jason Yosinski , Jascha Sohl-Dickstein

We study the problem of acoustic feature learning in the setting where we have access to another (non-acoustic) modality for feature learning but not at test time. We use deep variational canonical correlation analysis (VCCA), a recently…

Computer Vision and Pattern Recognition · Computer Science 2017-09-01 Qingming Tang , Weiran Wang , Karen Livescu

Recently proposed automatic pathological speech detection approaches rely on spectrogram input representations or wav2vec2 embeddings. These representations may contain pathology irrelevant uncorrelated information, such as changing…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-27 Yacouba Kaloga , Shakeel A. Sheikh , Ina Kodrasi

Cross-modality retrieval encompasses retrieval tasks where the fetched items are of a different type than the search query, e.g., retrieving pictures relevant to a given text query. The state-of-the-art approach to cross-modality retrieval…

Information Retrieval · Computer Science 2018-04-17 Matthias Dorfer , Jan Schlüter , Andreu Vall , Filip Korzeniowski , Gerhard Widmer

Multi-view learning leverages correlations between different sources of data to make predictions in one view based on observations in another view. A popular approach is to assume that, both, the correlations between the views and the…

Machine Learning · Computer Science 2014-04-29 Behrouz Behmardi , Cedric Archambeau , Guillaume Bouchard

The objective of multimodal information fusion is to mathematically analyze information carried in different sources and create a new representation which will be more effectively utilized in pattern recognition and other multimedia…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Lei Gao , Rui Zhang , Lin Qi , Enqing Chen , Ling Guan

We introduce a conceptually simple yet effective model for self-supervised representation learning with graph data. It follows the previous methods that generate two views of an input graph through data augmentation. However, unlike…

Machine Learning · Computer Science 2021-10-29 Hengrui Zhang , Qitian Wu , Junchi Yan , David Wipf , Philip S. Yu

We consider learning representations (features) in the setting in which we have access to multiple unlabeled views of the data for learning while only one view is available for downstream tasks. Previous work on this problem has proposed…

Machine Learning · Computer Science 2016-02-03 Weiran Wang , Raman Arora , Karen Livescu , Jeff Bilmes

In this paper, we propose an approach for learning binary hash codes for image retrieval. Canonical Correlation Analysis (CCA) is used to design two loss functions for training a neural network such that the correlation between the two…

Image and Video Processing · Electrical Eng. & Systems 2021-06-14 Abin Jose , Daniel Filbert , Christian Rohlfing , Jens-Rainer Ohm

Recent developments in regularized Canonical Correlation Analysis (CCA) promise powerful methods for high-dimensional, multiview data analysis. However, justifying the structural assumptions behind many popular approaches remains a…

Methodology · Statistics 2025-11-18 Lennie Wells , Kumar Thurimella , Sergio Bacallado