English
Related papers

Related papers: Gen-Oja: A Two-time-scale approach for Streaming C…

200 papers

We develop and analyze algorithms for instrumental variable regression by viewing the problem as a conditional stochastic optimization problem. In the context of least-squares instrumental variable regression, our algorithms neither require…

Machine Learning · Statistics 2024-05-31 Xuxing Chen , Abhishek Roy , Yifan Hu , Krishnakumar Balasubramanian

Canonical correlation analysis is a classical technique for exploring the relationship between two sets of variables. It has important applications in analyzing high dimensional datasets originated from genomics, imaging and other fields.…

Methodology · Statistics 2016-04-05 Chao Gao , Zongming Ma , Harrison H. Zhou

Massive data analysis calls for distributed algorithms and theories. We design a multi-round distributed algorithm for canonical correlation analysis. We construct principal directions through the convex formulation of canonical correlation…

Computation · Statistics 2024-12-24 Canyi Chen , Liping Zhu

The compact Genetic Algorithm (cGA) is an Estimation of Distribution Algorithm that generates offspring population according to the estimated probabilistic model of the parent population instead of using traditional recombination and…

Neural and Evolutionary Computing · Computer Science 2009-01-07 Reza Rastegar , Arash Hariri

We present Deep Generalized Canonical Correlation Analysis (DGCCA) -- a method for learning nonlinear transformations of arbitrarily many views of data, such that the resulting transformations are maximally informative of each other. While…

Machine Learning · Computer Science 2017-06-16 Adrian Benton , Huda Khayrallah , Biman Gujral , Dee Ann Reisinger , Sheng Zhang , Raman Arora

We propose an efficient algorithm for solving orthogonal canonical correlation analysis (OCCA) in the form of trace-fractional structure and orthogonal linear projections. Even though orthogonality has been widely used and proved to be a…

Machine Learning · Computer Science 2019-09-26 Leihong Zhang , Li Wang , Zhaojun Bai , Ren-cang Li

Principal Component Analysis is a novel way of of dimensionality reduction. This problem essentially boils down to finding the top k eigen vectors of the data covariance matrix. A considerable amount of literature is found on algorithms…

Machine Learning · Computer Science 2019-01-08 Jian Vora

Canonical Correlation Analysis, CCA, is a widely used multivariate method in omics research for integrating high dimensional datasets. CCA identifies hidden links by deriving linear projections of features maximally correlating datasets.…

Methodology · Statistics 2025-10-31 Nuria Senar , Aeilko H. Zwinderman , Michel H. Hof and

In this paper, we develop a method which we call OnlineGCP for computing the Generalized Canonical Polyadic (GCP) tensor decomposition of streaming data. GCP differs from traditional canonical polyadic (CP) tensor decompositions as it…

Numerical Analysis · Mathematics 2021-10-28 Eric Phipps , Nick Johnson , Tamara G. Kolda

Canonical Correlation Analysis (CCA) is a statistical technique used to extract common information from multiple data sources or views. It has been used in various representation learning problems, such as dimensionality reduction, word…

Machine Learning · Computer Science 2020-06-18 Benjamin Dutton

A new approach to the sparse Canonical Correlation Analysis (sCCA)is proposed with the aim of discovering interpretable associations in very high-dimensional multi-view, i.e.observations of multiple sets of variables on the same subjects,…

Machine Learning · Statistics 2019-09-18 Omid S. Solari , James B. Brown , Peter J. Bickel

Motivation: Biomedical studies increasingly produce multi-view high-dimensional datasets (e.g., multi-omics) that demand integrative analysis. Existing canonical correlation analysis (CCA) and generalized CCA methods address at most two of…

Machine Learning · Statistics 2025-02-27 Rong Wu , Ziqi Chen , Gen Li , Hai Shu

We consider the problem of sparse canonical correlation analysis (CCA), i.e., the search for two linear combinations, one for each multivariate, that yield maximum correlation using a specified number of variables. We propose an efficient…

Computation · Statistics 2008-01-18 Ami Wiesel , Mark Kliger , Alfred O. Hero

Canonical Correlation Analysis (CCA) is widely used for multimodal data analysis and, more recently, for discriminative tasks such as multi-view learning; however, it makes no use of class labels. Recent CCA methods have started to address…

Machine Learning · Computer Science 2019-07-19 Heather D. Couture , Roland Kwitt , J. S. Marron , Melissa Troester , Charles M. Perou , Marc Niethammer

Canonical correlation analysis (CCA) is a multivariate statistical technique for finding the linear relationship between two sets of variables. The kernel generalization of CCA named kernel CCA has been proposed to find nonlinear relations…

Machine Learning · Statistics 2017-01-17 Xiaowei Zhang , Delin Chu , Li-Zhi Liao , Michael K. Ng

We present a novel approach for adaptive, differentiable parameterization of large-scale random fields. If the approach is coupled with any gradient-based optimization algorithm, it can be applied to a variety of optimization problems,…

Machine Learning · Computer Science 2020-06-09 Maksim Elizarev , Andrei Mukhin , Aleksey Khlyupin

In this paper, we propose a stochastic Gauss-Newton (SGN) algorithm to study the online principal component analysis (OPCA) problem, which is formulated by using the symmetric low-rank product (SLRP) model for dominant eigenspace…

Optimization and Control · Mathematics 2022-10-25 Siyun Zhou , Xin Liu , Liwei Xu

In classical canonical correlation analysis (CCA), the goal is to determine the linear transformations of two random vectors into two new random variables that are most strongly correlated. Canonical variables are pairs of these new random…

Methodology · Statistics 2025-10-24 Tomasz Górecki , Mirosław Krzyśko , Felix Gnettner , Piotr Kokoszka

This paper introduces an efficient algorithm for finding the dominant generalized eigenvectors of a pair of symmetric matrices. Combining tools from approximation theory and convex optimization, we develop a simple scalable algorithm with…

Optimization and Control · Mathematics 2019-06-26 Vien V. Mai , Mikael Johansson

We introduce a generalized Spiking Locally Competitive Algorithm (LCA) that is biologically plausible and exhibits adaptability to a large variety of neuron models and network connectivity structures. In addition, we provide theoretical…

Optimization and Control · Mathematics 2024-07-08 Xuexing Du , Zhong-qi K. Tian , Songting Li , Douglas Zhou