English
Related papers

Related papers: A Generalized EigenGame with Extensions to Multivi…

200 papers

Canonical Correlation Analysis (CCA) is a method for feature extraction of two views by finding maximally correlated linear projections of them. Several variants of CCA have been introduced in the literature, in particular, variants based…

Machine Learning · Computer Science 2022-03-25 Tomer Friedlander , Lior Wolf

We study the stochastic optimization of canonical correlation analysis (CCA), whose objective is nonconvex and does not decouple over training samples. Although several stochastic gradient based optimization algorithms have been recently…

Machine Learning · Computer Science 2016-11-15 Weiran Wang , Jialei Wang , Dan Garber , Nathan Srebro

Despite the rapid development of computational hardware, the treatment of large and high dimensional data sets is still a challenging problem. This paper provides a twofold contribution to the topic. First, we propose a Gaussian Mixture…

We study $k$-GenEV, the problem of finding the top $k$ generalized eigenvectors, and $k$-CCA, the problem of finding the top $k$ vectors in canonical-correlation analysis. We propose algorithms $\mathtt{LazyEV}$ and $\mathtt{LazyCCA}$ to…

Optimization and Control · Mathematics 2017-01-24 Zeyuan Allen-Zhu , Yuanzhi Li

Canonical correlation analysis (CCA) is a classical representation learning technique for finding correlated variables in multi-view data. Several nonlinear extensions of the original linear CCA have been proposed, including kernel and deep…

Machine Learning · Computer Science 2016-02-09 Tomer Michaeli , Weiran Wang , Karen Livescu

In this paper, we study the problems of principal Generalized Eigenvector computation and Canonical Correlation Analysis in the stochastic setting. We propose a simple and efficient algorithm, Gen-Oja, for these problems. We prove the…

Machine Learning · Computer Science 2020-02-04 Kush Bhatia , Aldo Pacchiano , Nicolas Flammarion , Peter L. Bartlett , Michael I. Jordan

Learning representations of two views of data such that the resulting representations are highly linearly correlated is appealing in machine learning. In this paper, we present a canonical correlation guided learning framework, which allows…

Machine Learning · Computer Science 2024-10-01 Zhiwen Chen , Siwen Mo , Haobin Ke , Steven X. Ding , Zhaohui Jiang , Chunhua Yang , Weihua Gui

Canonical Correlation Analysis (CCA) is a widely used spectral technique for finding correlation structures in multi-view datasets. In this paper, we tackle the problem of large scale CCA, where classical algorithms, usually requiring…

Machine Learning · Statistics 2015-06-29 Zhuang Ma , Yichao Lu , Dean Foster

The Canonical Polyadic (CP) tensor decomposition is a well-known method for interpretable analysis of high-dimensional data. Recently, the Generalized CP method (GCP) was introduced by Hong and Kolda to allow for flexible choice of the loss…

Numerical Analysis · Mathematics 2026-05-21 Jeremy M. Myers , Eric T. Phipps

We propose a unified class of calibration weighting methods based on weighted generalized entropy to handle missing at random (MAR) data with improved stability and efficiency. The proposed generalized entropy calibration (GEC) formulates…

Methodology · Statistics 2025-11-07 Yonghyun Kwon , Jae Kwang Kim , Yumou Qiu

Kernel canonical correlation analysis (KCCA) is a nonlinear multi-view representation learning technique with broad applicability in statistics and machine learning. Although there is a closed-form solution for the KCCA objective, it…

Machine Learning · Computer Science 2016-03-01 Weiran Wang , Karen Livescu

In this paper, we propose a deep probabilistic multi-view model that is composed of a linear multi-view layer based on probabilistic canonical correlation analysis (CCA) description in the latent space together with deep generative networks…

Machine Learning · Computer Science 2020-03-10 Mahdi Karami , Dale Schuurmans

Modern vision pipelines increasingly rely on pretrained image encoders whose representations are reused across tasks and models, yet these representations are often overcomplete and model-specific. We propose a simple, training-free method…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Dylan B. Lewis , Jens Gregor , Hector Santos-Villalobos

Canonical Correlation Analysis (CCA) models are powerful for studying the associations between two sets of variables. The canonically correlated representations, termed \textit{canonical variates} are widely used in unsupervised learning to…

Machine Learning · Computer Science 2021-06-09 Ofir Lindenbaum , Moshe Salhov , Amir Averbuch , Yuval Kluger

Canonical Correlation Analysis (CCA) is a widespread technique for discovering linear relationships between two sets of variables $X \in \mathbb{R}^{n \times p}$ and $Y \in \mathbb{R}^{n \times q}$. In high dimensions however, standard…

Methodology · Statistics 2024-05-31 Claire Donnat , Elena Tuzhilina

Canonical correlation analysis (CCA) is a popular technique for learning representations that are maximally correlated across multiple views in data. In this paper, we extend the CCA based framework for learning a multiview mixture model.…

Machine Learning · Computer Science 2020-01-01 Nils Holzenberger , Raman Arora

Canonical Correlation Analysis (CCA) is widely used for multimodal data analysis and, more recently, for discriminative tasks such as multi-view learning; however, it makes no use of class labels. Recent CCA methods have started to address…

Machine Learning · Computer Science 2019-07-19 Heather D. Couture , Roland Kwitt , J. S. Marron , Melissa Troester , Charles M. Perou , Marc Niethammer

Recent developments in regularized Canonical Correlation Analysis (CCA) promise powerful methods for high-dimensional, multiview data analysis. However, justifying the structural assumptions behind many popular approaches remains a…

Methodology · Statistics 2025-11-18 Lennie Wells , Kumar Thurimella , Sergio Bacallado

Several goal-oriented problems in the real-world can be naturally expressed as Stochastic Shortest Path Problems (SSPs). However, the computational complexity of solving SSPs makes finding solutions to even moderately sized problems…

Artificial Intelligence · Computer Science 2022-10-12 Rushang Karia , Rashmeet Kaur Nayyar , Siddharth Srivastava

Sparse Canonical Correlation Analysis (SCCA) is a fundamental statistical tool for identifying linear relationships in high-dimensional, multi-view data. While minimax theory establishes an optimal sample complexity scaling additively with…

Signal Processing · Electrical Eng. & Systems 2026-04-21 Mengchu Xu , Jian Wang , Yonina C. Eldar