English
Related papers

Related papers: Efficient Globally Convergent Stochastic Optimizat…

200 papers

In high-dimensional settings, Canonical Correlation Analysis (CCA) often fails, and existing sparse methods force an untenable choice between computational speed and statistical rigor. This work introduces a fast and provably consistent…

Methodology · Statistics 2025-07-16 Zixuan Wu , Elena Tuzhilina , Claire Donnat

Sparse canonical correlation analysis (CCA) is a useful statistical tool to detect latent information with sparse structures. However, sparse CCA works only for two datasets, i.e., there are only two views or two distinct objects. To…

Machine Learning · Computer Science 2020-04-24 Jia Cai , Kexin Lv , Junyi Huo , Xiaolin Huang , Jie Yang

Classical canonical correlation analysis (CCA) requires matrices to be low dimensional, i.e. the number of features cannot exceed the sample size. Recent developments in CCA have mainly focused on the high-dimensional setting, where the…

Methodology · Statistics 2021-06-09 Wenjia Wang , Yi-Hui Zhou

Canonical correlation analysis (CCA) is a classical representation learning technique for finding correlated variables in multi-view data. Several nonlinear extensions of the original linear CCA have been proposed, including kernel and deep…

Machine Learning · Computer Science 2016-02-09 Tomer Michaeli , Weiran Wang , Karen Livescu

Deep CCA is a recently proposed deep neural network extension to the traditional canonical correlation analysis (CCA), and has been successful for multi-view representation learning in several domains. However, stochastic optimization of…

Machine Learning · Computer Science 2015-10-08 Weiran Wang , Raman Arora , Karen Livescu , Nathan Srebro

Canonical Correlation Analysis (CCA) is a widely used spectral technique for finding correlation structures in multi-view datasets. In this paper, we tackle the problem of large scale CCA, where classical algorithms, usually requiring…

Machine Learning · Statistics 2015-06-29 Zhuang Ma , Yichao Lu , Dean Foster

Canonical Correlation Analysis (CCA) is a widespread technique for discovering linear relationships between two sets of variables $X \in \mathbb{R}^{n \times p}$ and $Y \in \mathbb{R}^{n \times q}$. In high dimensions however, standard…

Methodology · Statistics 2024-05-31 Claire Donnat , Elena Tuzhilina

Canonical correlation analysis is a classical technique for exploring the relationship between two sets of variables. It has important applications in analyzing high dimensional datasets originated from genomics, imaging and other fields.…

Methodology · Statistics 2016-04-05 Chao Gao , Zongming Ma , Harrison H. Zhou

Canonical Correlation Analysis (CCA) has been widely applied to jointly embed multiple views of data in a maximally correlated latent space. However, the alignment between various data perspectives, which is required by traditional…

Machine Learning · Computer Science 2023-12-11 Biqian Cheng , Evangelos E. Papalexakis , Jia Chen

In this paper, we formulate the Canonical Correlation Analysis (CCA) problem on matrix manifolds. This framework provides a natural way for dealing with matrix constraints and tools for building efficient algorithms even in an adaptive…

Machine Learning · Computer Science 2012-07-03 Florian Yger , Maxime Berar , Gilles Gasso , Alain Rakotomamonjy

Canonical correlation analysis (CCA) describes the associations between two sets of variables by maximizing the correlation between linear combinations of the variables in each data set. However, in high-dimensional settings where the…

Methodology · Statistics 2015-01-07 Ines Wilms , Christophe Croux

Canonical correlation analysis (CCA) has proven an effective tool for two-view dimension reduction due to its profound theoretical foundation and success in practical applications. In respect of multi-view learning, however, it is limited…

Machine Learning · Statistics 2015-02-10 Yong Luo , Dacheng Tao , Yonggang Wen , Kotagiri Ramamohanarao , Chao Xu

We consider the problem of sparse canonical correlation analysis (CCA), i.e., the search for two linear combinations, one for each multivariate, that yield maximum correlation using a specified number of variables. We propose an efficient…

Computation · Statistics 2008-01-18 Ami Wiesel , Mark Kliger , Alfred O. Hero

Canonical Correlation Analysis (CCA) is a classical tool for finding correlations among the components of two random vectors. In recent years, CCA has been widely applied to the analysis of genomic data, where it is common for researchers…

Machine Learning · Computer Science 2012-06-22 Sivaraman Balakrishnan , Kriti Puniyani , John Lafferty

This paper focuses on finding approximate solutions to stochastic optimal control problems with control domains being not necessarily convex, where the state trajectory is subject to controlled stochastic differential equations. The…

Optimization and Control · Mathematics 2025-07-15 Shaolin Ji , Rundong Xu

We present an efficient stochastic algorithm (RSG+) for canonical correlation analysis (CCA) using a reparametrization of the projection matrices. We show how this reparametrization (into structured matrices), simple in hindsight, directly…

Machine Learning · Computer Science 2021-06-15 Zihang Meng , Rudrasis Chakraborty , Vikas Singh

Canonical correlation analysis (CCA) is a classic statistical method for discovering latent co-variation that underpins two or more observed random vectors. Several extensions and variations of CCA have been proposed that have strengthened…

Machine Learning · Computer Science 2023-12-22 Paris A. Karakasis , Nicholas D. Sidiropoulos

Numerical global optimization methods are often very time consuming and could not be applied for high-dimensional nonconvex/nonsmooth optimization problems. Due to the nonconvexity/nonsmoothness, directly solving the primal problems…

Mathematical Physics · Physics 2012-09-03 Jiapu Zhang

Canonical Correlation Analysis (CCA) is widely used for multimodal data analysis and, more recently, for discriminative tasks such as multi-view learning; however, it makes no use of class labels. Recent CCA methods have started to address…

Machine Learning · Computer Science 2019-07-19 Heather D. Couture , Roland Kwitt , J. S. Marron , Melissa Troester , Charles M. Perou , Marc Niethammer

In this paper, we study the problems of principal Generalized Eigenvector computation and Canonical Correlation Analysis in the stochastic setting. We propose a simple and efficient algorithm, Gen-Oja, for these problems. We prove the…

Machine Learning · Computer Science 2020-02-04 Kush Bhatia , Aldo Pacchiano , Nicolas Flammarion , Peter L. Bartlett , Michael I. Jordan