English
Related papers

Related papers: High-Dimensional Canonical Correlation Analysis

200 papers

We present a novel method for solving Canonical Correlation Analysis (CCA) in a sparse convex framework using a least squares approach. The presented method focuses on the scenario when one is interested in (or limited to) a primal…

Machine Learning · Statistics 2009-08-20 David R. Hardoon , John Shawe-Taylor

Correspondence analysis (CA) is a multivariate statistical tool used to visualize and interpret data dependencies. CA has found applications in fields ranging from epidemiology to social sciences. However, current methods used to perform CA…

Machine Learning · Statistics 2019-02-22 Hsiang Hsu , Salman Salamatian , Flavio P. Calmon

The sum-of-correlations (SUMCOR) formulation of generalized canonical correlation analysis (GCCA) seeks highly correlated low-dimensional representations of different views via maximizing pairwise latent similarity of the views. SUMCOR is…

Machine Learning · Computer Science 2018-12-26 Charilaos I. Kanatsoulis , Xiao Fu , Nicholas D. Sidiropoulos , Mingyi Hong

Understanding associations between paired high-dimensional longitudinal datasets is a fundamental yet challenging problem that arises across scientific domains, including longitudinal multi-omic studies. The difficulty stems from the…

Methodology · Statistics 2026-01-21 Jianbin Tan , Pixu Shi

We consider graphical models based on a recursive system of linear structural equations. This implies that there is an ordering, $\sigma$, of the variables such that each observed variable $Y_v$ is a linear function of a variable specific…

Methodology · Statistics 2019-06-28 Y. Samuel Wang , Mathias Drton

Extracting meaningful latent representations from high-dimensional sequential data is a crucial challenge in machine learning, with applications spanning natural science and engineering. We introduce InfoDPCCA, a dynamic probabilistic…

Machine Learning · Computer Science 2025-06-11 Shiqin Tang , Shujian Yu

Factor models are a class of powerful statistical models that have been widely used to deal with dependent measurements that arise frequently from various applications from genomics and neuroscience to economics and finance. As data are…

Methodology · Statistics 2018-08-14 Jianqing Fan , Kaizheng Wang , Yiqiao Zhong , Ziwei Zhu

Comparing different neural network representations and determining how representations evolve over time remain challenging open questions in our understanding of the function of neural networks. Comparing representations in neural networks…

Machine Learning · Statistics 2018-10-25 Ari S. Morcos , Maithra Raghu , Samy Bengio

Principal Component Analysis (PCA) is an important tool of dimension reduction especially when the dimension (or the number of variables) is very high. Asymptotic studies where the sample size is fixed, and the dimension grows [i.e., High…

Statistics Theory · Mathematics 2009-11-20 Sungkyu Jung , J. S. Marron

Principal component analysis (PCA) is a widespread technique for data analysis that relies on the covariance-correlation matrix of the analyzed data. However to properly work with high-dimensional data, PCA poses severe mathematical…

Quantitative Methods · Quantitative Biology 2018-10-18 Luigi Leonardo Palese

We introduce three novel semi-parametric extensions of probabilistic canonical correlation analysis with identifiability guarantees. We consider moment matching techniques for estimation in these models. For that, by drawing explicit links…

Machine Learning · Statistics 2016-06-06 Anastasia Podosinnikova , Francis Bach , Simon Lacoste-Julien

Principal component analysis (PCA) is arguably the most widely used approach for large-dimensional factor analysis. While it is effective when the factors are sufficiently strong, it can be inconsistent when the factors are weak and/or the…

Methodology · Statistics 2025-08-22 Zhongyuan Lyu , Ming Yuan

The sparse canonical correlation analysis (SCCA) is a bi-multivariate association model that finds sparse linear combinations of two sets of variables that are maximally correlated with each other. In addition to the standard SCCA model, a…

Methodology · Statistics 2020-08-11 Kefei Liu , Qi Long , Li Shen

In this paper, we propose a mixture of probabilistic partial canonical correlation analysis (MPPCCA) that extracts the Causal Patterns from two multivariate time series. Causal patterns refer to the signal patterns within interactions of…

Methodology · Statistics 2017-12-13 Hiroki Mori , Keisuke Kawano , Hiroki Yokoyama

Accurate estimation for extent of cross{sectional dependence in large panel data analysis is paramount to further statistical analysis on the data under study. Grouping more data with weak relations (cross{sectional dependence) together…

Econometrics · Economics 2019-04-16 Jiti Gao , Guangming Pan , Yanrong Yang , Bo Zhang

We make a detailed study of the infinite dimensional Galilean Conformal Algebra (GCA) in the case of two spacetime dimensions. Classically, this algebra is precisely obtained from a contraction of the generators of the relativistic…

High Energy Physics - Theory · Physics 2010-10-08 Arjun Bagchi , Rajesh Gopakumar , Ipsita Mandal , Akitsugu Miwa

This paper considers the estimation and inference of the low-rank components in high-dimensional matrix-variate factor models, where each dimension of the matrix-variates ($p \times q$) is comparable to or greater than the number of…

Statistics Theory · Mathematics 2022-10-20 Elynn Y. Chen , Jianqing Fan

Many high dimensional and high-throughput biological datasets have complex sample correlation structures, which include longitudinal and multiple tissue data, as well as data with multiple treatment conditions or related individuals. These…

Methodology · Statistics 2018-08-20 Chris McKennan , Dan Nicolae

We examine Deep Canonically Correlated LSTMs as a way to learn nonlinear transformations of variable length sequences and embed them into a correlated, fixed dimensional space. We use LSTMs to transform multi-view time-series data…

Machine Learning · Statistics 2018-01-17 Neil Mallinar , Corbin Rosset

Canonical correlation analysis was proposed by Hotelling [6] and it measures linear relationship between two multidimensional variables. In high dimensional setting, the classical canonical correlation analysis breaks down. We propose a…

Machine Learning · Statistics 2017-06-06 Xiaotong Suo , Victor Minden , Bradley Nelson , Robert Tibshirani , Michael Saunders