中文
相关论文

相关论文: Efficient Globally Convergent Stochastic Optimizat…

200 篇论文

In high-dimensional settings, Canonical Correlation Analysis (CCA) often fails, and existing sparse methods force an untenable choice between computational speed and statistical rigor. This work introduces a fast and provably consistent…

统计方法学 · 统计学 2025-07-16 Zixuan Wu , Elena Tuzhilina , Claire Donnat

Sparse canonical correlation analysis (CCA) is a useful statistical tool to detect latent information with sparse structures. However, sparse CCA works only for two datasets, i.e., there are only two views or two distinct objects. To…

机器学习 · 计算机科学 2020-04-24 Jia Cai , Kexin Lv , Junyi Huo , Xiaolin Huang , Jie Yang

Classical canonical correlation analysis (CCA) requires matrices to be low dimensional, i.e. the number of features cannot exceed the sample size. Recent developments in CCA have mainly focused on the high-dimensional setting, where the…

统计方法学 · 统计学 2021-06-09 Wenjia Wang , Yi-Hui Zhou

Canonical correlation analysis (CCA) is a classical representation learning technique for finding correlated variables in multi-view data. Several nonlinear extensions of the original linear CCA have been proposed, including kernel and deep…

机器学习 · 计算机科学 2016-02-09 Tomer Michaeli , Weiran Wang , Karen Livescu

Deep CCA is a recently proposed deep neural network extension to the traditional canonical correlation analysis (CCA), and has been successful for multi-view representation learning in several domains. However, stochastic optimization of…

机器学习 · 计算机科学 2015-10-08 Weiran Wang , Raman Arora , Karen Livescu , Nathan Srebro

Canonical Correlation Analysis (CCA) is a widely used spectral technique for finding correlation structures in multi-view datasets. In this paper, we tackle the problem of large scale CCA, where classical algorithms, usually requiring…

机器学习 · 统计学 2015-06-29 Zhuang Ma , Yichao Lu , Dean Foster

Canonical Correlation Analysis (CCA) is a widespread technique for discovering linear relationships between two sets of variables $X \in \mathbb{R}^{n \times p}$ and $Y \in \mathbb{R}^{n \times q}$. In high dimensions however, standard…

统计方法学 · 统计学 2024-05-31 Claire Donnat , Elena Tuzhilina

Canonical correlation analysis is a classical technique for exploring the relationship between two sets of variables. It has important applications in analyzing high dimensional datasets originated from genomics, imaging and other fields.…

统计方法学 · 统计学 2016-04-05 Chao Gao , Zongming Ma , Harrison H. Zhou

Canonical Correlation Analysis (CCA) has been widely applied to jointly embed multiple views of data in a maximally correlated latent space. However, the alignment between various data perspectives, which is required by traditional…

机器学习 · 计算机科学 2023-12-11 Biqian Cheng , Evangelos E. Papalexakis , Jia Chen

In this paper, we formulate the Canonical Correlation Analysis (CCA) problem on matrix manifolds. This framework provides a natural way for dealing with matrix constraints and tools for building efficient algorithms even in an adaptive…

机器学习 · 计算机科学 2012-07-03 Florian Yger , Maxime Berar , Gilles Gasso , Alain Rakotomamonjy

Canonical correlation analysis (CCA) describes the associations between two sets of variables by maximizing the correlation between linear combinations of the variables in each data set. However, in high-dimensional settings where the…

统计方法学 · 统计学 2015-01-07 Ines Wilms , Christophe Croux

Canonical correlation analysis (CCA) has proven an effective tool for two-view dimension reduction due to its profound theoretical foundation and success in practical applications. In respect of multi-view learning, however, it is limited…

机器学习 · 统计学 2015-02-10 Yong Luo , Dacheng Tao , Yonggang Wen , Kotagiri Ramamohanarao , Chao Xu

We consider the problem of sparse canonical correlation analysis (CCA), i.e., the search for two linear combinations, one for each multivariate, that yield maximum correlation using a specified number of variables. We propose an efficient…

统计计算 · 统计学 2008-01-18 Ami Wiesel , Mark Kliger , Alfred O. Hero

Canonical Correlation Analysis (CCA) is a classical tool for finding correlations among the components of two random vectors. In recent years, CCA has been widely applied to the analysis of genomic data, where it is common for researchers…

机器学习 · 计算机科学 2012-06-22 Sivaraman Balakrishnan , Kriti Puniyani , John Lafferty

This paper focuses on finding approximate solutions to stochastic optimal control problems with control domains being not necessarily convex, where the state trajectory is subject to controlled stochastic differential equations. The…

最优化与控制 · 数学 2025-07-15 Shaolin Ji , Rundong Xu

We present an efficient stochastic algorithm (RSG+) for canonical correlation analysis (CCA) using a reparametrization of the projection matrices. We show how this reparametrization (into structured matrices), simple in hindsight, directly…

机器学习 · 计算机科学 2021-06-15 Zihang Meng , Rudrasis Chakraborty , Vikas Singh

Canonical correlation analysis (CCA) is a classic statistical method for discovering latent co-variation that underpins two or more observed random vectors. Several extensions and variations of CCA have been proposed that have strengthened…

机器学习 · 计算机科学 2023-12-22 Paris A. Karakasis , Nicholas D. Sidiropoulos

Numerical global optimization methods are often very time consuming and could not be applied for high-dimensional nonconvex/nonsmooth optimization problems. Due to the nonconvexity/nonsmoothness, directly solving the primal problems…

数学物理 · 物理学 2012-09-03 Jiapu Zhang

Canonical Correlation Analysis (CCA) is widely used for multimodal data analysis and, more recently, for discriminative tasks such as multi-view learning; however, it makes no use of class labels. Recent CCA methods have started to address…

机器学习 · 计算机科学 2019-07-19 Heather D. Couture , Roland Kwitt , J. S. Marron , Melissa Troester , Charles M. Perou , Marc Niethammer

In this paper, we study the problems of principal Generalized Eigenvector computation and Canonical Correlation Analysis in the stochastic setting. We propose a simple and efficient algorithm, Gen-Oja, for these problems. We prove the…

机器学习 · 计算机科学 2020-02-04 Kush Bhatia , Aldo Pacchiano , Nicolas Flammarion , Peter L. Bartlett , Michael I. Jordan