English
Related papers

Related papers: Nonlinear Multiview Analysis: Identifiability and …

200 papers

Recent advances in citation recommendation have improved accuracy by leveraging multi-view representation learning to integrate the various modalities present in scholarly documents. However, effectively combining multiple data views…

Information Retrieval · Computer Science 2025-07-24 Conor McNamara , Effirul Ramlan

In this paper, we address the problem of hidden common variables discovery from multimodal data sets of nonlinear high-dimensional observations. We present a metric based on local applications of canonical correlation analysis (CCA) and…

Machine Learning · Computer Science 2017-07-12 Or Yair , Ronen Talmon

Canonical Correlation Analysis (CCA) is a linear representation learning method that seeks maximally correlated variables in multi-view data. Non-linear CCA extends this notion to a broader family of transformations, which are more powerful…

Machine Learning · Computer Science 2020-02-11 Amichai Painsky , Meir Feder , Naftali Tishby

We present deep variational canonical correlation analysis (VCCA), a deep multi-view learning model that extends the latent variable model interpretation of linear CCA to nonlinear observation models parameterized by deep neural networks.…

Machine Learning · Computer Science 2017-02-28 Weiran Wang , Xinchen Yan , Honglak Lee , Karen Livescu

Multi-view alignment, achieving one-to-one correspondence of multi-view inputs, is critical in many real-world multi-view applications, especially for cross-view data analysis problems. Recently, an increasing number of works study this…

Machine Learning · Computer Science 2020-05-26 Yaxin Shi , Yuangang Pan , Donna Xu , Ivor W. Tsang

Cross-view classification that means to classify samples from heterogeneous views is a significant yet challenging problem in computer vision. A promising approach to handle this problem is the multi-view subspace learning (MvSL), which…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Xinge You , Jiamiao Xu , Wei Yuan , Xiao-Yuan Jing , Dacheng Tao , Taiping Zhang

Finding relationships between multiple views of data is essential both for exploratory analysis and as pre-processing for predictive tasks. A prominent approach is to apply variants of Canonical Correlation Analysis (CCA), a classical…

Machine Learning · Statistics 2016-01-11 Ziyuan Lin , Jaakko Peltonen

We extend multi-way, multivariate ANOVA-type analysis to cases where one covariate is the view, with features of each view coming from different, high-dimensional domains. The different views are assumed to be connected by having paired…

Machine Learning · Statistics 2009-12-17 Ilkka Huopaniemi , Tommi Suvitaival , Janne Nikkilä , Matej Orešič , Samuel Kaski

A central problem in unsupervised deep learning is how to find useful representations of high-dimensional data, sometimes called "disentanglement". Most approaches are heuristic and lack a proper theoretical foundation. In linear…

Machine Learning · Computer Science 2023-09-06 Aapo Hyvarinen , Ilyes Khemakhem , Hiroshi Morioka

Linear principal component analysis (PCA) can be extended to a nonlinear PCA by using artificial neural networks. But the benefit of curved components requires a careful control of the model complexity. Moreover, standard techniques for…

Machine Learning · Computer Science 2012-04-04 Matthias Scholz

We present a novel multiview canonical correlation analysis model based on a variational approach. This is the first nonlinear model that takes into account the available graph-based geometric constraints while being scalable for processing…

Machine Learning · Computer Science 2021-10-05 Yacouba Kaloga , Pierre Borgnat , Sundeep Prabhakar Chepuri , Patrice Abry , Amaury Habrard

Canonical Correlation Analysis (CCA) is a method for feature extraction of two views by finding maximally correlated linear projections of them. Several variants of CCA have been introduced in the literature, in particular, variants based…

Machine Learning · Computer Science 2022-03-25 Tomer Friedlander , Lior Wolf

We present Deep Generalized Canonical Correlation Analysis (DGCCA) -- a method for learning nonlinear transformations of arbitrarily many views of data, such that the resulting transformations are maximally informative of each other. While…

Machine Learning · Computer Science 2017-06-16 Adrian Benton , Huda Khayrallah , Biman Gujral , Dee Ann Reisinger , Sheng Zhang , Raman Arora

Multi-view representation learning has developed rapidly over the past decades and has been applied in many fields. However, most previous works assumed that each view is complete and aligned. This leads to an inevitable deterioration in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Yiming Wang , Dongxia Chang , Zhiqiang Fu , Jie Wen , Yao Zhao

Nonlinear ICA is a fundamental problem for unsupervised representation learning, emphasizing the capacity to recover the underlying latent variables generating the data (i.e., identifiability). Recently, the very first identifiability…

Machine Learning · Statistics 2019-02-05 Aapo Hyvarinen , Hiroaki Sasaki , Richard E. Turner

Canonical correlation analysis (CCA) is a classic statistical method for discovering latent co-variation that underpins two or more observed random vectors. Several extensions and variations of CCA have been proposed that have strengthened…

Machine Learning · Computer Science 2023-12-22 Paris A. Karakasis , Nicholas D. Sidiropoulos

Recent work has sought to understand the behavior of neural networks by comparing representations between layers and between different trained models. We examine methods for comparing neural network representations based on canonical…

Machine Learning · Computer Science 2019-07-22 Simon Kornblith , Mohammad Norouzi , Honglak Lee , Geoffrey Hinton

Although multi-view learning has made signifificant progress over the past few decades, it is still challenging due to the diffificulty in modeling complex correlations among different views, especially under the context of view missing. To…

Machine Learning · Computer Science 2020-11-13 Changqing Zhang , Yajie Cui , Zongbo Han , Joey Tianyi Zhou , Huazhu Fu , Qinghua Hu

Disease prediction or classification using health datasets involve using well-known predictors associated with the disease as features for the models. This study considers multiple data components of an individual's health, using the…

Machine Learning · Computer Science 2016-08-18 Aileme Omogbai

Canonical Correlation Analysis (CCA) is a statistical technique used to extract common information from multiple data sources or views. It has been used in various representation learning problems, such as dimensionality reduction, word…

Machine Learning · Computer Science 2020-06-18 Benjamin Dutton