English
Related papers

Related papers: DCID: Deep Canonical Information Decomposition

200 papers

Without using extra 3-D data like points cloud or depth images for providing 3-D information, we retrieve the 3-D object information from single monocular images. The high-quality predicted depth images are recovered from single monocular…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Zifan Yu , Suya You

Canonical correlation analysis (CCA) is a technique to find statistical dependencies between a pair of multivariate data. However, its application to high dimensional data is limited due to the resulting time complexity. While the…

Machine Learning · Computer Science 2020-12-29 Naoko Koide-Majima , Kei Majima

Multi-regional interaction among neuronal populations underlies the brain's processing of rich sensory information in our daily lives. Recent neuroscience and neuroimaging studies have increasingly used naturalistic stimuli and experimental…

Neurons and Cognition · Quantitative Biology 2021-06-08 Yu Takagi , Laurence T. Hunt , Ryu Ohata , Hiroshi Imamizu , Jun-ichiro Hirayama

Learning representations of two views of data such that the resulting representations are highly linearly correlated is appealing in machine learning. In this paper, we present a canonical correlation guided learning framework, which allows…

Machine Learning · Computer Science 2024-10-01 Zhiwen Chen , Siwen Mo , Haobin Ke , Steven X. Ding , Zhaohui Jiang , Chunhua Yang , Weihua Gui

We give an information-theoretic interpretation of Canonical Correlation Analysis (CCA) via (relaxed) Wyner's common information. CCA permits to extract from two high-dimensional data sets low-dimensional descriptions (features) that…

Information Theory · Computer Science 2020-03-02 Michael Gastpar , Erixhen Sula

A representative model in integrative analysis of two high-dimensional correlated datasets is to decompose each data matrix into a low-rank common matrix generated by latent factors shared across datasets, a low-rank distinctive matrix…

Machine Learning · Statistics 2022-04-06 Hai Shu , Zhe Qu

Variational dimensionality reduction methods are widely used for their accuracy, generative capabilities, and robustness. We introduce a unifying framework that generalizes both such as traditional and state-of-the-art methods. The…

Machine Learning · Computer Science 2025-09-04 Eslam Abdelaleem , Ilya Nemenman , K. Michael Martini

Canonical correlation analysis (CCA) is a standard tool for studying associations between two data sources; however, it is not designed for data with count or proportion measurement types. In addition, while CCA uncovers common signals, it…

Computation · Statistics 2022-08-02 Dongbang Yuan , Yunfeng Zhang , Shuai Guo , Wenyi Wang , Irina Gaynanova

Deep learning algorithms mine knowledge from the training data and thus would likely inherit the dataset's bias information. As a result, the obtained model would generalize poorly and even mislead the decision process in real-life…

Machine Learning · Computer Science 2021-08-16 Wei Zhu , Haitian Zheng , Haofu Liao , Weijian Li , Jiebo Luo

Multimodal signals are more powerful than unimodal data for emotion recognition since they can represent emotions more comprehensively. In this paper, we introduce deep canonical correlation analysis (DCCA) to multimodal emotion…

Machine Learning · Computer Science 2019-08-16 Wei Liu , Jie-Lin Qiu , Wei-Long Zheng , Bao-Liang Lu

Recently the widely used multi-view learning model, Canonical Correlation Analysis (CCA) has been generalised to the non-linear setting via deep neural networks. Existing deep CCA models typically first decorrelate the feature dimensions of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Xiaobin Chang , Tao Xiang , Timothy M. Hospedales

The framework of Partial Information Decomposition (PID) unveils complex nonlinear interactions in network systems by dissecting the mutual information (MI) between a target variable and several source variables. While PID measures have…

Data Analysis, Statistics and Probability · Physics 2024-09-23 Chiara Barà , Yuri Antonacci , Marta Iovino , Ivan Lazic , Luca Faes

Canonical correlation analysis (CCA) is a widely used technique for estimating associations between two sets of multi-dimensional variables. Recent advancements in CCA methods have expanded their application to decipher the interactions of…

Machine Learning · Statistics 2025-02-05 Hongju Park , Shuyang Bai , Zhenyao Ye , Hwiyoung Lee , Tianzhou Ma , Shuo Chen

Describing the dimension reduction (DR) techniques by means of probabilistic models has recently been given special attention. Probabilistic models, in addition to a better interpretability of the DR methods, provide a framework for further…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Mehran Safayani , Saeid Momenzadeh

Learning causal structure from observational data is a fundamental challenge in machine learning. However, the majority of commonly used differentiable causal discovery methods are non-identifiable, turning this problem into a continuous…

Machine Learning · Computer Science 2022-09-30 Yu Wang , An Zhang , Xiang Wang , Yancheng Yuan , Xiangnan He , Tat-Seng Chua

Quantifying the dependence between high-dimensional random variables is central to statistical learning and inference. Two classical methods are canonical correlation analysis (CCA), which identifies maximally correlated projected versions…

Machine Learning · Computer Science 2023-09-29 Dor Tsur , Ziv Goldfeld , Kristjan Greenewald

While mutual information effectively quantifies dependence between two variables, it does not by itself reveal the complex, fine-grained interactions among variables, i.e., how multiple sources contribute redundantly, uniquely, or…

Information Theory · Computer Science 2026-05-05 Aobo Lyu , Andrew Clark , Netanel Raviv

Multimodal language analysis often considers relationships between features based on text and those based on acoustical and visual properties. Text features typically outperform non-text features in sentiment analysis or emotion recognition…

Machine Learning · Computer Science 2019-12-03 Zhongkai Sun , Prathusha Sarma , William Sethares , Yingyu Liang

Given data obtained under two sampling conditions, it is often of interest to identify variables that behave differently in one condition than in the other. We introduce a method for differential analysis of second-order behavior called…

Methodology · Statistics 2016-02-26 Kelly Bodwin , Kai Zhang , Andrew Nobel

Reducing the number of false discoveries is presently one of the most pressing issues in the life sciences. It is of especially great importance for many applications in neuroimaging and genomics, where datasets are typically…

Methodology · Statistics 2018-06-26 Alexej Gossmann , Pascal Zille , Vince Calhoun , Yu-Ping Wang