English
Related papers

Related papers: DCID: Deep Canonical Information Decomposition

200 papers

Canonical correlation analysis (CCA) is a popular technique for learning representations that are maximally correlated across multiple views in data. In this paper, we extend the CCA based framework for learning a multiview mixture model.…

Machine Learning · Computer Science 2020-01-01 Nils Holzenberger , Raman Arora

The canonical correlation analysis (CCA) is commonly used to analyze data sets with paired data, e.g. measurements of gene expression and metabolomic intensities of the same experiments. This allows to find interesting relationships between…

For linear models with a diverging number of parameters, it has recently been shown that modified versions of Bayesian information criterion (BIC) can identify the true model consistently. However, in many cases there is little…

Methodology · Statistics 2011-07-26 Heng Lian

Coupled tensor decompositions (CTDs) perform data fusion by linking factors from different datasets. Although many CTDs have been already proposed, current works do not address important challenges of data fusion, where: 1) the datasets are…

Machine Learning · Computer Science 2024-12-13 Ricardo Augusto Borsoi , Konstantin Usevich , David Brie , Tülay Adali

Deep neural networks (DNNs) often struggle with out-of-distribution data, limiting their reliability in diverse realworld applications. To address this issue, domain generalization methods have been developed to learn domain-invariant…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Jiaxi Li , Di Lin , Hao Chen , Hongying Liu , Liang Wan , Wei Feng

We present an extension of sparse Canonical Correlation Analysis (CCA) designed for finding multiple-to-multiple linear correlations within a single set of variables. Unlike CCA, which finds correlations between two sets of data where the…

Machine Learning · Statistics 2015-11-23 Maria De-Arteaga , Artur Dubrawski , Peter Huggins

This paper studies high-dimensional canonical correlation analysis (CCA) with an emphasis on the vectors that define canonical variables. The paper shows that when two dimensions of data grow to infinity jointly and proportionally, the…

Econometrics · Economics 2025-01-24 Anna Bykhovskaya , Vadim Gorin

Classical methods such as Principal Component Analysis (PCA) and Canonical Correlation Analysis (CCA) are ubiquitous in statistics. However, these techniques are only able to reveal linear relationships in data. Although nonlinear variants…

Machine Learning · Statistics 2014-05-14 David Lopez-Paz , Suvrit Sra , Alex Smola , Zoubin Ghahramani , Bernhard Schölkopf

Combining the predictions of multiple trained models through ensembling is generally a good way to improve accuracy by leveraging the different learned features of the models, however it comes with high computational and storage costs.…

Machine Learning · Computer Science 2024-07-09 Stefan Horoi , Albert Manuel Orozco Camacho , Eugene Belilovsky , Guy Wolf

The classical Canonical Correlation Analysis (CCA) identifies the correlations between two sets of multivariate variables based on their covariance, which has been widely applied in diverse fields such as computer vision, natural language…

Optimization and Control · Mathematics 2024-01-02 Yongchun Li , Santanu S. Dey , Weijun Xie

The integration and transfer of information from multiple sources to multiple targets is a core motive of neural systems. The emerging field of partial information decomposition (PID) provides a novel information-theoretic lens into these…

Information Theory · Computer Science 2021-10-28 Ari Pakman , Amin Nejatbakhsh , Dar Gilboa , Abdullah Makkeh , Luca Mazzucato , Michael Wibral , Elad Schneidman

Deep learning based approaches to Computer Aided Diagnosis (CAD) typically pose the problem as an image classification (Normal or Abnormal) problem. These systems achieve high to very high accuracy in specific disease detection for which…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Aniket Joshi , Gaurav Mishra , Jayanthi Sivaswamy

The interdependence and high dimensionality of multivariate signals present significant challenges for denoising, as conventional univariate methods often struggle to capture the complex interactions between variables. A successful approach…

Machine Learning · Computer Science 2024-07-29 Jaesung Choi , Pilwon Kim

Dynamic Causal Modeling (DCM) is a Bayesian framework for inferring on hidden (latent) neuronal states, based on measurements of brain activity. Since its introduction in 2003 for functional magnetic resonance imaging data, DCM has been…

Quantitative Methods · Quantitative Biology 2021-04-08 Inês Pereira , Stefan Frässle , Jakob Heinzle , Dario Schöbi , Cao Tri Do , Moritz Gruber , Klaas E. Stephan

Humans can learn concepts or recognize items from just a handful of examples, while machines require many more samples to perform the same task. In this paper, we build a computational model to investigate the possibility of this kind of…

Artificial Intelligence · Computer Science 2016-11-09 Wen-Chieh Fang , Yi-ting Chiang

Dynamic Mode Decomposition (DMD) is an unsupervised machine learning method that has attracted considerable attention in recent years owing to its equation-free structure, ability to easily identify coherent spatio-temporal structures in…

Machine Learning · Computer Science 2022-02-16 Alex Viguerie , Gabriel F. Barros , Malú Grave , Alessandro Reali , Alvaro L. G. A. Coutinho

Recently, deep learning-based compressive imaging (DCI) has surpassed the conventional compressive imaging in reconstruction quality and faster running time. While multi-scale has shown superior performance over single-scale, research in…

Image and Video Processing · Electrical Eng. & Systems 2020-08-04 Thuong Nguyen Canh , Byeungwoo Jeon

We examine Deep Canonically Correlated LSTMs as a way to learn nonlinear transformations of variable length sequences and embed them into a correlated, fixed dimensional space. We use LSTMs to transform multi-view time-series data…

Machine Learning · Statistics 2018-01-17 Neil Mallinar , Corbin Rosset

We investigate the identifiability of nonlinear Canonical Correlation Analysis (CCA) in a multi-view setup, where each view is generated by an unknown nonlinear map applied to a linear mixture of shared latents and view-private noise.…

Machine Learning · Computer Science 2026-03-02 Zhiwei Han , Stefan Matthes , Hao Shen

We propose a novel multivariate signal denoising method that performs long-range correlation analysis of multiple modes in input data by considering inherent inter-channel dependencies of the data. That is achieved through a novel and…

Signal Processing · Electrical Eng. & Systems 2023-05-04 Khuram Naveed , Sidra Mukhtar , Naveed ur Rehman