English
Related papers

Related papers: Canonical Correlation Guided Deep Neural Network

200 papers

The classical Canonical Correlation Analysis (CCA) identifies the correlations between two sets of multivariate variables based on their covariance, which has been widely applied in diverse fields such as computer vision, natural language…

Optimization and Control · Mathematics 2024-01-02 Yongchun Li , Santanu S. Dey , Weijun Xie

In classical canonical correlation analysis (CCA), the goal is to determine the linear transformations of two random vectors into two new random variables that are most strongly correlated. Canonical variables are pairs of these new random…

Methodology · Statistics 2025-10-24 Tomasz Górecki , Mirosław Krzyśko , Felix Gnettner , Piotr Kokoszka

We introduce a conceptually simple yet effective model for self-supervised representation learning with graph data. It follows the previous methods that generate two views of an input graph through data augmentation. However, unlike…

Machine Learning · Computer Science 2021-10-29 Hengrui Zhang , Qitian Wu , Junchi Yan , David Wipf , Philip S. Yu

We study the stochastic optimization of canonical correlation analysis (CCA), whose objective is nonconvex and does not decouple over training samples. Although several stochastic gradient based optimization algorithms have been recently…

Machine Learning · Computer Science 2016-11-15 Weiran Wang , Jialei Wang , Dan Garber , Nathan Srebro

We consider learning representations (features) in the setting in which we have access to multiple unlabeled views of the data for learning while only one view is available for downstream tasks. Previous work on this problem has proposed…

Machine Learning · Computer Science 2016-02-03 Weiran Wang , Raman Arora , Karen Livescu , Jeff Bilmes

Extracting meaningful latent representations from high-dimensional sequential data is a crucial challenge in machine learning, with applications spanning natural science and engineering. We introduce InfoDPCCA, a dynamic probabilistic…

Machine Learning · Computer Science 2025-06-11 Shiqin Tang , Shujian Yu

We examine Deep Canonically Correlated LSTMs as a way to learn nonlinear transformations of variable length sequences and embed them into a correlated, fixed dimensional space. We use LSTMs to transform multi-view time-series data…

Machine Learning · Statistics 2018-01-17 Neil Mallinar , Corbin Rosset

Deep learning techniques have been successfully used in learning a common representation for multi-view data, wherein the different modalities are projected onto a common subspace. In a broader perspective, the techniques used to…

Computer Vision and Pattern Recognition · Computer Science 2017-11-02 Gaurav Bhatt , Piyush Jha , Balasubramanian Raman

Canonical Correlation Analysis (CCA) models are powerful for studying the associations between two sets of variables. The canonically correlated representations, termed \textit{canonical variates} are widely used in unsupervised learning to…

Machine Learning · Computer Science 2021-06-09 Ofir Lindenbaum , Moshe Salhov , Amir Averbuch , Yuval Kluger

Generalized Canonical Correlation Analysis (GCCA) is an important tool that finds numerous applications in data mining, machine learning, and artificial intelligence. It aims at finding `common' random variables that are strongly correlated…

Machine Learning · Computer Science 2021-05-19 Mikael Sørensen , Charilaos I. Kanatsoulis , Nicholas D. Sidiropoulos

Canonical correlation analysis (CCA) is a technique for measuring the association between two multivariate data matrices. A regularized modification of canonical correlation analysis (RCCA) which imposes an $\ell_2$ penalty on the CCA…

Methodology · Statistics 2021-07-30 Elena Tuzhilina , Leonardo Tozzi , Trevor Hastie

In this paper, we propose the Discriminative Multiple Canonical Correlation Analysis (DMCCA) for multimodal information analysis and fusion. DMCCA is capable of extracting more discriminative characteristics from multimodal information…

Machine Learning · Computer Science 2021-03-02 Lei Gao , Lin Qi , Enqing Chen , Ling Guan

Canonical correlation analysis (CCA) is a powerful technique for discovering whether or not hidden sources are commonly present in two (or more) datasets. Its well-appreciated merits include dimensionality reduction, clustering,…

Machine Learning · Computer Science 2018-08-15 Jia Chen , Gang Wang , Yanning Shen , Georgios B. Giannakis

Manifold matching works to identify embeddings of multiple disparate data spaces into the same low-dimensional space, where joint inference can be pursued. It is an enabling methodology for fusion and inference from multiple and massive…

Machine Learning · Statistics 2012-09-18 Ming Sun , Carey E. Priebe , Minh Tang

Deep learning architectures are showing great promise in various computer vision domains including image classification, object detection, event detection and action recognition. In this study, we investigate various aspects of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-08 Hilal Ergun , Mustafa Sert

Multi-View Representation Learning (MVRL) aims to learn a unified representation of an object from multi-view data. Deep Canonical Correlation Analysis (DCCA) and its variants share simple formulations and demonstrate state-of-the-art…

Machine Learning · Computer Science 2024-11-04 Junlin He , Jinxiao Du , Susu Xu , Wei Ma

A cross-modal retrieval process is to use a query in one modality to obtain relevant data in another modality. The challenging issue of cross-modal retrieval lies in bridging the heterogeneous gap for similarity computation, which has been…

Information Retrieval · Computer Science 2019-08-22 Donghuo Zeng

Incorporating prior knowledge into a data-driven modeling problem can drastically improve performance, reliability, and generalization outside of the training sample. The stronger the structural properties, the more effective these…

Robotics · Computer Science 2023-11-20 Wooyoung Chung , Daniel Polani , Stas Tiomkin

We present a fast algorithm for approximate Canonical Correlation Analysis (CCA). Given a pair of tall-and-thin matrices, the proposed algorithm first employs a randomized dimensionality reduction transform to reduce the size of the input…

Data Structures and Algorithms · Computer Science 2013-05-03 Haim Avron , Christos Boutsidis , Sivan Toledo , Anastasios Zouzias

Canonical correlation analysis (CCA) is a multivariate statistical method which describes the associations between two sets of variables. The objective is to find linear combinations of the variables in each data set having maximal…

Methodology · Statistics 2015-01-07 Ines Wilms , Christophe Croux