English

Multi-view Feature Extraction based on Triple Contrastive Heads

Computer Vision and Pattern Recognition 2023-03-23 v1

Abstract

Multi-view feature extraction is an efficient approach for alleviating the issue of dimensionality in highdimensional multi-view data. Contrastive learning (CL), which is a popular self-supervised learning method, has recently attracted considerable attention. In this study, we propose a novel multi-view feature extraction method based on triple contrastive heads, which combines the sample-, recovery- , and feature-level contrastive losses to extract the sufficient yet minimal subspace discriminative information in compliance with information bottleneck principle. In MFETCH, we construct the feature-level contrastive loss, which removes the redundent information in the consistency information to achieve the minimality of the subspace discriminative information. Moreover, the recovery-level contrastive loss is also constructed in MFETCH, which captures the view-specific discriminative information to achieve the sufficiency of the subspace discriminative information.The numerical experiments demonstrate that the proposed method offers a strong advantage for multi-view feature extraction.

Keywords

Cite

@article{arxiv.2303.12615,
  title  = {Multi-view Feature Extraction based on Triple Contrastive Heads},
  author = {Hongjie Zhang},
  journal= {arXiv preprint arXiv:2303.12615},
  year   = {2023}
}

Comments

arXiv admin note: text overlap with arXiv:2302.03932

R2 v1 2026-06-28T09:28:14.994Z