English

A Novel Approach for Effective Multi-View Clustering with Information-Theoretic Perspective

Machine Learning 2023-09-26 v1

Abstract

Multi-view clustering (MVC) is a popular technique for improving clustering performance using various data sources. However, existing methods primarily focus on acquiring consistent information while often neglecting the issue of redundancy across multiple views. This study presents a new approach called Sufficient Multi-View Clustering (SUMVC) that examines the multi-view clustering framework from an information-theoretic standpoint. Our proposed method consists of two parts. Firstly, we develop a simple and reliable multi-view clustering method SCMVC (simple consistent multi-view clustering) that employs variational analysis to generate consistent information. Secondly, we propose a sufficient representation lower bound to enhance consistent information and minimise unnecessary information among views. The proposed SUMVC method offers a promising solution to the problem of multi-view clustering and provides a new perspective for analyzing multi-view data. To verify the effectiveness of our model, we conducted a theoretical analysis based on the Bayes Error Rate, and experiments on multiple multi-view datasets demonstrate the superior performance of SUMVC.

Keywords

Cite

@article{arxiv.2309.13989,
  title  = {A Novel Approach for Effective Multi-View Clustering with Information-Theoretic Perspective},
  author = {Chenhang Cui and Yazhou Ren and Jingyu Pu and Jiawei Li and Xiaorong Pu and Tianyi Wu and Yutao Shi and Lifang He},
  journal= {arXiv preprint arXiv:2309.13989},
  year   = {2023}
}
R2 v1 2026-06-28T12:31:23.127Z