English
Related papers

Related papers: Information Theory-Guided Heuristic Progressive Mu…

200 papers

Multi-view feature extraction is an efficient approach for alleviating the issue of dimensionality in highdimensional multi-view data. Contrastive learning (CL), which is a popular self-supervised learning method, has recently attracted…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Hongjie Zhang

The teacher-free online Knowledge Distillation (KD) aims to train an ensemble of multiple student models collaboratively and distill knowledge from each other. Although existing online KD methods achieve desirable performance, they often…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Chuanguang Yang , Zhulin An , Helong Zhou , Fuzhen Zhuang , Yongjun Xu , Qian Zhan

Multi-view Clustering (MVC) has achieved significant progress, with many efforts dedicated to learn knowledge from multiple views. However, most existing methods are either not applicable or require additional steps for incomplete MVC. Such…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Junjie Liu , Junlong Liu , Rongxin Jiang , Yaowu Chen , Chen Shen , Jieping Ye

Preserving maximal information is one of principles of designing self-supervised learning methodologies. To reach this goal, contrastive learning adopts an implicit way which is contrasting image pairs. However, we believe it is not fully…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Hong-Yu Zhou , Chixiang Lu , Sibei Yang , Xiaoguang Han , Yizhou Yu

This paper proposes a new principled multi-task representation learning framework (InfoMTL) to extract noise-invariant sufficient representations for all tasks. It ensures sufficiency of shared representations for all tasks and mitigates…

Computation and Language · Computer Science 2025-03-07 Dou Hu , Lingwei Wei , Wei Zhou , Songlin Hu

Most studies focused on information retrieval-based techniques for fault localization, which built representations for bug reports and source code files and matched their semantic vectors through similarity measurement. However, such…

Software Engineering · Computer Science 2026-02-06 Chunying Zhou , Xiaoyuan Xie , Gong Chen , Peng He , Bing Li

Models for image representation learning are typically designed for either recognition or generation. Various forms of contrastive learning help models learn to convert images to embeddings that are useful for classification, detection, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Matthew Gwilliam , Xiao Wang , Xuefeng Hu , Zhenheng Yang

Representation learning methods utilizing the InfoNCE loss have demonstrated considerable capacity in reducing human annotation effort by training invariant neural feature extractors. Although different variants of the training objective…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Hanyang Chen , Yanchao Yang

Multimodal learning aims to imitate human beings to acquire complementary information from multiple modalities for various downstream tasks. However, traditional aggregation-based multimodal fusion methods ignore the inter-modality…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Heqing Zou , Meng Shen , Chen Chen , Yuchen Hu , Deepu Rajan , Eng Siong Chng

Multi-view multi-label classification (MvMLC) has recently garnered significant research attention due to its wide range of real-world applications. However, incompleteness in views and labels is a common challenge, often resulting from…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Wulin Xie , Lian Zhao , Jiang Long , Xiaohuan Lu , Bingyan Nie

Image captioning, a popular topic in computer vision, has achieved substantial progress in recent years. However, the distinctiveness of natural descriptions is often overlooked in previous work. It is closely related to the quality of…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Bo Dai , Dahua Lin

Among different existing graph self-supervised learning strategies, graph contrastive learning (GCL) has been one of the most prevalent approaches to this problem. Despite the remarkable performance those GCL methods have achieved, existing…

Machine Learning · Computer Science 2022-10-27 Qianlong Wen , Zhongyu Ouyang , Chunhui Zhang , Yiyue Qian , Yanfang Ye , Chuxu Zhang

Human Activity Recognition is a field of research where input data can take many forms. Each of the possible input modalities describes human behaviour in a different way, and each has its own strengths and weaknesses. We explore the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Razvan Brinzea , Bulat Khaertdinov , Stylianos Asteriadis

Unsupervised disentangled representation learning is a long-standing problem in computer vision. This work proposes a novel framework for performing image clustering from deep embeddings by combining instance-level contrastive learning with…

Machine Learning · Computer Science 2021-10-05 Ramakrishnan Sundareswaran , Jansel Herrera-Gerena , John Just , Ali Jannesari

The rapid advancement of large language models (LLMs) has accelerated the emergence of in-context learning (ICL) as a cutting-edge approach in the natural language processing domain. Recently, ICL has been employed in visual understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Dianmo Sheng , Dongdong Chen , Zhentao Tan , Qiankun Liu , Qi Chu , Jianmin Bao , Tao Gong , Bin Liu , Shengwei Xu , Nenghai Yu

Recently, as an effective way of learning latent representations, contrastive learning has been increasingly popular and successful in various domains. The success of constrastive learning in single-label classifications motivates us to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Son D. Dao , Ethan Zhao , Dinh Phung , Jianfei Cai

Inspired by the success of contrastive learning (CL) in computer vision and natural language processing, graph contrastive learning (GCL) has been developed to learn discriminative node representations on graph datasets. However, the…

Machine Learning · Computer Science 2023-01-03 Zehong Wang , Qi Li , Donghua Yu , Xiaolong Han , Xiao-Zhi Gao , Shigen Shen

Multi-view learning methods often focus on improving decision accuracy, while neglecting the decision uncertainty, limiting their suitability for safety-critical applications. To mitigate this, researchers propose trusted multi-view…

Machine Learning · Computer Science 2024-10-08 Ying Liu , Lihong Liu , Cai Xu , Xiangyu Song , Ziyu Guan , Wei Zhao

While contrastive multi-view clustering has achieved remarkable success, it implicitly assumes balanced class distribution. However, real-world multi-view data primarily exhibits class imbalance distribution. Consequently, existing methods…

Machine Learning · Computer Science 2025-06-17 Xuqian Xue , Yiming Lei , Qi Cai , Hongming Shan , Junping Zhang

Features of the same sample generated by different pretrained models often exhibit inherently distinct feature distributions because of discrepancies in the model pretraining objectives or architectures. Learning invariant representations…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Jie Chen , Zhu Wang , Chuanbin Liu , Xi Peng