English
Related papers

Related papers: A Variational Information Bottleneck Approach to M…

200 papers

In recent years, incomplete multi-view clustering, which studies the challenging multi-view clustering problem on missing views, has received growing research interests. Although a series of methods have been proposed to address this issue,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Jie Wen , Zheng Zhang , Yong Xu , Bob Zhang , Lunke Fei , Guo-Sen Xie

In the era of big data, it is common to have data with multiple modalities or coming from multiple sources, known as "multi-view data". Multi-view clustering provides a natural way to generate clusters from such data. Since different views…

Machine Learning · Computer Science 2016-11-08 Weixiang Shao , Lifang He , Chun-Ta Lu , Philip S. Yu

Modular object-centric representations are essential for *human-like reasoning* but are challenging to obtain under spatial ambiguities, *e.g. due to occlusions and view ambiguities*. However, addressing challenges presents both theoretical…

Machine Learning · Computer Science 2025-06-10 Avinash Kori , Francesca Toni , Ben Glocker

In this paper, we study a remote source coding scenario in which binary phase shift keying (BPSK) modulation sources are corrupted by additive white Gaussian noise (AWGN). An intermediate node, such as a relay, receives these observations…

Information Theory · Computer Science 2024-05-14 Yi Song , Kai Wan , Zhenyu Liao , Giuseppe Caire

Developing high-performing, yet interpretable models remains a critical challenge in modern AI. Concept-based models (CBMs) attempt to address this by extracting human-understandable concepts from a global encoding (e.g., image encoding)…

Machine Learning · Computer Science 2025-10-08 David Steinmann , Wolfgang Stammer , Antonia Wüst , Kristian Kersting

Multiview clustering has been extensively studied to take advantage of multi-source information to improve the clustering performance. In general, most of the existing works typically compute an n * n affinity graph by some…

Machine Learning · Computer Science 2022-08-30 Man-Sheng Chen , Tuo Liu , Chang-Dong Wang , Dong Huang , Jian-Huang Lai

Resting-state functional magnetic resonance imaging (fMRI) has emerged as a cornerstone for psychiatric diagnosis, yet most approaches rely on pairwise brain cortical or sub-cortical connectivities that overlooks higher-order interactions…

Machine Learning · Computer Science 2026-04-21 Kunyu Zhang , Qiang Li , Vince D. Calhoun , Shujian Yu

Although deep learning models have achieved state-of-the-art performance on a number of vision tasks, generalization over high dimensional multi-modal data, and reliable predictive uncertainty estimation are still active areas of research.…

Machine Learning · Computer Science 2020-12-10 Samarth Sinha , Homanga Bharadhwaj , Anirudh Goyal , Hugo Larochelle , Animesh Garg , Florian Shkurti

The identification of influential observations is an important part of data analysis that can prevent erroneous conclusions drawn from biased estimators. However, in high dimensional data, this identification is challenging. Classical and…

The presence of symmetries imposes a stringent set of constraints on a system. This constrained structure allows intelligent agents interacting with such a system to drastically improve the efficiency of learning and generalization, through…

Information Theory · Computer Science 2024-10-03 Hippolyte Charvin , Nicola Catenacci Volpi , Daniel Polani

Graph out-of-distribution (OOD) generalization remains a major challenge in graph learning since graph neural networks (GNNs) often suffer from severe performance degradation under distribution shifts. Invariant learning, aiming to extract…

Machine Learning · Computer Science 2025-02-14 Wenyu Mao , Jiancan Wu , Haoyang Liu , Yongduo Sui , Xiang Wang

The invariance principle from causality is at the heart of notable approaches such as invariant risk minimization (IRM) that seek to address out-of-distribution (OOD) generalization failures. Despite the promising theory, invariance…

Multimodal learning significantly benefits cancer survival prediction, especially the integration of pathological images and genomic data. Despite advantages of multimodal learning for cancer survival prediction, massive redundancy in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Yilan Zhang , Yingxue Xu , Jianqi Chen , Fengying Xie , Hao Chen

While large-scale pretrained language models have obtained impressive results when fine-tuned on a wide variety of tasks, they still often suffer from overfitting in low-resource scenarios. Since such models are general-purpose feature…

Computation and Language · Computer Science 2021-06-11 Rabeeh Karimi Mahabadi , Yonatan Belinkov , James Henderson

We propose a novel information bottleneck (IB) method named Drop-Bottleneck, which discretely drops features that are irrelevant to the target variable. Drop-Bottleneck not only enjoys a simple and tractable compression objective but also…

Machine Learning · Computer Science 2021-03-24 Jaekyeom Kim , Minjung Kim , Dongyeon Woo , Gunhee Kim

Modern high-throughput sequencing technologies have enabled us to profile multiple molecular modalities from the same single cell, providing unprecedented opportunities to assay celluar heterogeneity from multiple biological layers.…

Machine Learning · Statistics 2022-05-20 Pengcheng Zeng , Zhixiang Lin

Recently, maximizing mutual information has emerged as a powerful method for unsupervised graph representation learning. The existing methods are typically effective to capture information from the topology view but ignore the feature view.…

Machine Learning · Computer Science 2022-10-12 Xiaolong Fan , Maoguo Gong , Yue Wu , Hao Li

Recently, multi-view learning (MVL) has garnered significant attention due to its ability to fuse discriminative information from multiple views. However, real-world multi-view datasets are often heterogeneous and imperfect, which usually…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Jie Xu , Na Zhao , Gang Niu , Masashi Sugiyama , Xiaofeng Zhu

The feature attribution method reveals the contribution of input variables to the decision-making process to provide an attribution map for explanation. Existing methods grounded on the information bottleneck principle compute information…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Jung-Ho Hong , Ho-Joong Kim , Kyu-Sung Jeon , Seong-Whan Lee

Existing multi-view classification algorithms focus on promoting accuracy by exploiting different views, typically integrating them into common representations for follow-up tasks. Although effective, it is also crucial to ensure the…

Machine Learning · Computer Science 2022-06-28 Zongbo Han , Changqing Zhang , Huazhu Fu , Joey Tianyi Zhou