中文
相关论文

相关论文: Self-Supervised Information Bottleneck for Deep Mu…

200 篇论文

The information bottleneck (IB) approach to clustering takes a joint distribution $P\!\left(X,Y\right)$ and maps the data $X$ to cluster labels $T$ which retain maximal information about $Y$ (Tishby et al., 1999). This objective results in…

机器学习 · 统计学 2020-06-02 DJ Strouse , David J Schwab

The information bottleneck principle is an elegant and useful approach to representation learning. In this paper, we investigate the problem of representation learning in the context of reinforcement learning using the information…

机器学习 · 计算机科学 2019-11-14 Pei Yingjun , Hou Xinwen

The Information Bottleneck (IB) principle has emerged as a promising approach for enhancing the generalization, robustness, and interpretability of deep neural networks, demonstrating efficacy across image segmentation, document clustering,…

信息论 · 计算机科学 2025-04-18 Hanzhe Yang , Youlong Wu , Dingzhu Wen , Yong Zhou , Yuanming Shi

Deep neural networks suffer from poor generalization to unseen environments when the underlying data distribution is different from that in the training set. By learning minimum sufficient representations from training data, the information…

机器学习 · 计算机科学 2021-10-13 Francesco Alesiani , Shujian Yu , Xi Yu

Recent multi-view subspace clustering achieves impressive results utilizing deep networks, where the self-expressive correlation is typically modeled by a fully connected (FC) layer. However, they still suffer from two limitations. i) The…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Yuxiu Lin , Hui Liu , Ren Wang , Qiang Guo , Caiming Zhang

In recent years, incomplete multi-view clustering, which studies the challenging multi-view clustering problem on missing views, has received growing research interests. Although a series of methods have been proposed to address this issue,…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Jie Wen , Zheng Zhang , Yong Xu , Bob Zhang , Lunke Fei , Guo-Sen Xie

Concept Bottleneck Models (CBMs) aim for ante-hoc interpretability by learning a bottleneck layer that predicts interpretable concepts before the decision. State-of-the-art approaches typically select which concepts to learn via human…

机器学习 · 计算机科学 2026-03-10 Antonio De Santis , Schrasing Tong , Marco Brambilla , Lalana Kagal

Clustering is a fundamental unsupervised representation learning task with wide application in computer vision and pattern recognition. Deep clustering utilizes deep neural networks to learn latent representation, which is suitable for…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Wenhao Wu , Weiwei Wang , Shengjiang Kong

Subspace clustering aims to group data points that lie in a union of low-dimensional subspaces and finds wide application in computer vision, hyperspectral imaging, and recommendation systems. However, most existing methods assume fully…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Huanran Li , Daniel Pimentel-Alarcón

With advances in information acquisition technologies, multi-view data become ubiquitous. Multi-view learning has thus become more and more popular in machine learning and data mining fields. Multi-view unsupervised or semi-supervised…

机器学习 · 计算机科学 2018-04-04 Guoqing Chao , Shiliang Sun , Jinbo Bi

In this paper, we propose a novel Attentive Multi-View Deep Subspace Nets (AMVDSN), which deeply explores underlying consistent and view-specific information from multiple views and fuse them by considering each view's dynamic contribution…

计算机视觉与模式识别 · 计算机科学 2021-12-24 Run-kun Lu , Jian-wei Liu , Xin Zuo

In recent years, self-supervised learning has played a pivotal role in advancing machine learning by allowing models to acquire meaningful representations from unlabeled data. An intriguing research avenue involves developing…

机器学习 · 计算机科学 2023-10-30 Denis Janiak , Jakub Binkowski , Piotr Bielak , Tomasz Kajdanowicz

The Information Bottleneck (IB) provides an information theoretic principle for representation learning, by retaining all information relevant for predicting label while minimizing the redundancy. Though IB principle has been applied to a…

计算机视觉与模式识别 · 计算机科学 2022-12-27 Xudong Tian , Zhizhong Zhang , Shaohui Lin , Yanyun Qu , Yuan Xie , Lizhuang Ma

We present a framework for learning disentangled representation of CapsNet by information bottleneck constraint that distills information into a compact form and motivates to learn an interpretable factorized capsule. In our $\beta$-CapsNet…

计算机视觉与模式识别 · 计算机科学 2022-09-13 Ming-fei Hu , Jian-wei Liu

Contrastive learning has achieved promising performance in the field of multi-view clustering recently. However, the positive and negative sample construction mechanisms ignoring semantic consistency lead to false negative pairs, limiting…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Siwen Liu , Jinyan Liu , Hanning Yuan , Qi Li , Jing Geng , Ziqiang Yuan , Huaxu Han

Recent years have witnessed a growing academic interest in multi-view subspace clustering. In this paper, we propose a novel Double Graphs Regularized Multi-view Subspace Clustering (DGRMSC) method, which aims to harness both global and…

机器学习 · 计算机科学 2022-10-03 Longlong Chen , Yulong Wang , Youheng Liu , Yutao Hu , Libin Wang

Learning invariant (causal) features for out-of-distribution (OOD) generalization has attracted extensive attention recently, and among the proposals invariant risk minimization (IRM) is a notable solution. In spite of its theoretical…

机器学习 · 计算机科学 2023-02-01 Bin Deng , Kui Jia

The Information Bottleneck principle offers both a mechanism to explain how deep neural networks train and generalize, as well as a regularized objective with which to train models. However, multiple competing objectives are proposed in the…

机器学习 · 计算机科学 2021-01-06 Andreas Kirsch , Clare Lyle , Yarin Gal

In this paper, we introduce a Fast and Scalable Semi-supervised Multi-view Subspace Clustering (FSSMSC) method, a novel solution to the high computational complexity commonly found in existing approaches. FSSMSC features linear…

机器学习 · 计算机科学 2024-08-13 Huaming Ling , Chenglong Bao , Jiebo Song , Zuoqiang Shi

Deep neural networks typically learn spatially entangled representations that conflate discriminative foreground features with spurious background correlations, thereby undermining model interpretability and robustness. We propose a novel…

计算机视觉与模式识别 · 计算机科学 2025-11-13 Kaixiang Shu , Kai Meng , Junqin Luo