English
Related papers

Related papers: Self-Supervised Information Bottleneck for Deep Mu…

200 papers

Multi-view subspace clustering aims to divide a set of multisource data into several groups according to their underlying subspace structure. Although the spectral clustering based methods achieve promotion in multi-view clustering, their…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Songsong Wu , Zhiqiang Lu , Hao Tang , Yan Yan , Songhao Zhu , Xiao-Yuan Jing , Zuoyong Li

In this paper, we propose a semi-supervised clustering method, CEC-IB, that models data with a set of Gaussian distributions and that retrieves clusters based on a partial labeling provided by the user (partition-level side information). By…

Machine Learning · Computer Science 2017-11-15 Marek Śmieja , Bernhard C. Geiger

Semantic understanding of 3D point clouds is important for various robotics applications. Given that point-wise semantic annotation is expensive, in this paper, we address the challenge of learning models with extremely sparse labels. The…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Liyi Luo , Beiwen Tian , Hao Zhao , Guyue Zhou

Multi-view clustering is a learning paradigm based on multi-view data. Since statistic properties of different views are diverse, even incompatible, few approaches implement multi-view clustering based on the concatenated features…

Machine Learning · Computer Science 2021-03-25 Qinghai Zheng , Jihua Zhu , Zhongyu Li , Shanmin Pang , Jun Wang , Yaochen Li

Multi-view clustering has shown to be an effective method for analyzing underlying patterns in multi-view data. The performance of clustering can be improved by learning the consistency and complementarity between multi-view features,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Shihao Dong , Yuhui Zheng , Huiying Xu , Xinzhong Zhu

The information bottleneck (IB) approach is popular to improve the generalization, robustness and explainability of deep neural networks. Essentially, it aims to find a minimum sufficient representation $\mathbf{t}$ by striking a trade-off…

Machine Learning · Computer Science 2024-04-30 Shujian Yu , Xi Yu , Sigurd Løkse , Robert Jenssen , Jose C. Principe

In the past decade, deep neural networks have seen unparalleled improvements that continue to impact every aspect of today's society. With the development of high performance GPUs and the availability of vast amounts of data, learning…

Machine Learning · Computer Science 2021-05-12 Mohammad Ali Alomrani

Variational dimensionality reduction methods are widely used for their accuracy, generative capabilities, and robustness. We introduce a unifying framework that generalizes both such as traditional and state-of-the-art methods. The…

Machine Learning · Computer Science 2025-09-04 Eslam Abdelaleem , Ilya Nemenman , K. Michael Martini

Multimodal representation learning seeks to relate and decompose information inherent in multiple modalities. By disentangling modality-specific information from information that is shared across modalities, we can improve interpretability…

Machine Learning · Computer Science 2025-03-18 Chenyu Wang , Sharut Gupta , Xinyi Zhang , Sana Tonekaboni , Stefanie Jegelka , Tommi Jaakkola , Caroline Uhler

Benefiting from large-scale pretrained vision language models (VLMs), the performance of visual question answering (VQA) has approached human oracles. However, finetuning such models on limited data often suffers from overfitting and poor…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Jingjing Jiang , Ziyi Liu , Nanning Zheng

Multi-view learning is widely applied to real-life datasets, such as multiple omics biological data, but it often suffers from both missing views and missing labels. Prior probabilistic approaches addressed the missing view problem by using…

Machine Learning · Computer Science 2025-08-18 Yiyang Shen , Weiran Wang

Multi-view clustering has attracted increasing attentions recently by utilizing information from multiple views. However, existing multi-view clustering methods are either with high computation and space complexities, or lack of…

Machine Learning · Computer Science 2021-10-19 Jie Xu , Yazhou Ren , Guofeng Li , Lili Pan , Ce Zhu , Zenglin Xu

By "intelligently" fusing the complementary information across different views, multi-view learning is able to improve the performance of classification tasks. In this work, we extend the information bottleneck principle to a supervised…

Machine Learning · Computer Science 2022-04-25 Qi Zhang , Shujian Yu , Jingmin Xin , Badong Chen

Contrastive learning (CL) has shown great power in self-supervised learning due to its ability to capture insight correlations among large-scale data. Current CL models are biased to learn only the ability to discriminate positive and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Ziwen Liu , Bonan Li , Congying Han , Tiande Guo , Xuecheng Nie

Multiview clustering (MVC) segregates data samples into meaningful clusters by synthesizing information across multiple views. Moreover, deep learning-based methods have demonstrated their strong feature learning capabilities in MVC…

Machine Learning · Computer Science 2024-03-22 Hao Yang , Hua Mao , Wai Lok Woo , Jie Chen , Xi Peng

The Information Bottleneck (IB) principle offers an information-theoretic framework for analyzing the training process of deep neural networks (DNNs). Its essence lies in tracking the dynamics of two mutual information (MI) values: between…

Machine Learning · Computer Science 2024-05-10 Ivan Butakov , Alexander Tolmachev , Sofia Malanchuk , Anna Neopryatnaya , Alexey Frolov , Kirill Andreev

Vision-language co-embedding networks, such as CLIP, provide a latent embedding space with semantic information that is useful for downstream tasks. We hypothesize that the embedding space can be disentangled to separate the information on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Zhi Li , Hau Phan , Matthew Emigh , Austin J. Brockmeier

Subspace clustering is to find underlying low-dimensional subspaces and cluster the data points correctly. In this paper, we propose a novel multi-view subspace clustering method. Most existing methods suffer from two critical issues.…

Artificial Intelligence · Computer Science 2022-05-24 Mengyuan Zhang , Kai Liu

In recent years, Multi-View Clustering (MVC) has attracted increasing attention for its potential to reduce the annotation burden associated with large datasets. The aim of MVC is to exploit the inherent consistency and complementarity…

Machine Learning · Computer Science 2024-07-12 Zhangci Xiong , Meng Cao

Image clustering is a particularly challenging computer vision task, which aims to generate annotations without human supervision. Recent advances focus on the use of self-supervised learning strategies in image clustering, by first…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Foivos Ntelemis , Yaochu Jin , Spencer A. Thomas