English
Related papers

Related papers: Mutual Contrastive Learning for Visual Representat…

200 papers

Contrastive learning is among the most successful methods for visual representation learning, and its performance can be further improved by jointly performing clustering on the learned representations. However, existing methods for joint…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Shunjie-Fabian Zheng , JaeEun Nam , Emilio Dorigatti , Bernd Bischl , Shekoofeh Azizi , Mina Rezaei

This paper proposes a scalable and straightforward pre-training paradigm for efficient visual conceptual representation called occluded image contrastive learning (OCL). Our OCL approach is simple: we randomly mask patches to generate…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Xiaoyu Yang , Lijian Xu , Hongsheng Li , Shaoting Zhang

Contrastive learning (CL), which can extract the information shared between different contrastive views, has become a popular paradigm for vision representation learning. Inspired by the success in computer vision, recent work introduces CL…

Machine Learning · Computer Science 2022-12-15 Xumeng Gong , Cheng Yang , Chuan Shi

Multimodal representation learning, exemplified by multimodal contrastive learning (MMCL) using image-text pairs, aims to learn powerful representations by aligning cues across modalities. This approach relies on the core assumption that…

Machine Learning · Computer Science 2025-09-29 Yichao Cai , Yuhang Liu , Erdun Gao , Tianjiao Jiang , Zhen Zhang , Anton van den Hengel , Javen Qinfeng Shi

Multi-view learning (MVL) has gained great success in integrating information from multiple perspectives of a dataset to improve downstream task performance. To make MVL methods more practical in an open-ended environment, this paper…

Machine Learning · Computer Science 2023-10-16 Depeng Li , Tianqi Wang , Junwei Chen , Kenji Kawaguchi , Cheng Lian , Zhigang Zeng

Image captioning, a popular topic in computer vision, has achieved substantial progress in recent years. However, the distinctiveness of natural descriptions is often overlooked in previous work. It is closely related to the quality of…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Bo Dai , Dahua Lin

This paper is concerned with contrastive learning (CL) for low-level image restoration and enhancement tasks. We propose a new label-efficient learning paradigm based on residuals, residual contrastive learning (RCL), and derive an…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Nanqing Dong , Matteo Maggioni , Yongxin Yang , Eduardo Pérez-Pellitero , Ales Leonardis , Steven McDonagh

Heterogeneous graph neural networks (HGNNs) have demonstrated their superiority in exploiting auxiliary information for recommendation tasks. However, graphs constructed using meta-paths in HGNNs are usually too dense and contain a large…

Information Retrieval · Computer Science 2025-06-02 Lei Sang , Yu Wang , Yiwen Zhang

We introduce Consistent Assignment for Representation Learning (CARL), an unsupervised learning method to learn visual representations by combining ideas from self-supervised contrastive learning and deep clustering. By viewing contrastive…

Machine Learning · Computer Science 2023-10-23 Thalles Silva , Adín Ramírez Rivera

With various facial manipulation techniques arising, face forgery detection has drawn growing attention due to security concerns. Previous works always formulate face forgery detection as a classification problem based on cross-entropy…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Ke Sun , Taiping Yao , Shen Chen , Shouhong Ding , Jilin L , Rongrong Ji

Medical image segmentation is a fundamental yet challenging task due to the arduous process of acquiring large volumes of high-quality labeled data from experts. Contrastive learning offers a promising but still problematic solution to this…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Shuang Zeng , Lei Zhu , Xinliang Zhang , Micky C Nnamdi , Wenqi Shi , J Ben Tamo , Qian Chen , Hangzhou He , Lujia Jin , Zifeng Tian , Qiushi Ren , Zhaoheng Xie , Yanye Lu

Recent approaches have utilized self-supervised auxiliary tasks as representation learning to improve the performance and sample efficiency of vision-based reinforcement learning algorithms in single-agent settings. However, in multi-agent…

Machine Learning · Computer Science 2023-06-06 Haolin Song , Mingxiao Feng , Wengang Zhou , Houqiang Li

Molecular representation learning contributes to multiple downstream tasks such as molecular property prediction and drug design. To properly represent molecules, graph contrastive learning is a promising paradigm as it utilizes…

Machine Learning · Computer Science 2022-03-14 Yin Fang , Qiang Zhang , Haihong Yang , Xiang Zhuang , Shumin Deng , Wen Zhang , Ming Qin , Zhuo Chen , Xiaohui Fan , Huajun Chen

Contrastive learning is a discriminative approach that aims at grouping similar samples closer and diverse samples far from each other. It it an efficient technique to train an encoder generating distinguishable and informative…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Qing Chen , Jian Zhang

Exemplar-based image translation establishes dense correspondences between a conditional input and an exemplar (from two different domains) for leveraging detailed exemplar styles to achieve realistic image translation. Existing work builds…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Fangneng Zhan , Yingchen Yu , Rongliang Wu , Jiahui Zhang , Shijian Lu , Changgong Zhang

Recently, multimodal contrastive learning (MMCL) approaches, such as CLIP, have achieved a remarkable success in learning representations that are robust against distribution shift and generalize to new domains. Despite the empirical…

Machine Learning · Computer Science 2024-03-19 Yihao Xue , Siddharth Joshi , Dang Nguyen , Baharan Mirzasoleiman

Contrastive Learning (CL) has shown promising performance in collaborative filtering. The key idea is to generate augmentation-invariant embeddings by maximizing the Mutual Information between different augmented views of the same instance.…

Information Retrieval · Computer Science 2024-01-01 Huiyuan Chen , Vivian Lai , Hongye Jin , Zhimeng Jiang , Mahashweta Das , Xia Hu

Quantifying and evaluating image complexity can be instrumental in enhancing the performance of various computer vision tasks. Supervised learning can effectively learn image complexity features from well-annotated datasets. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Shipeng Liu , Liang Zhao , Dengfeng Chen , Zhanping Song

Pre-trained language models (LMs) store knowledge in their parameters and can generate informative responses when used in conversational systems. However, LMs suffer from the problem of "hallucination:" they may generate plausible-looking…

Computation and Language · Computer Science 2022-12-21 Weiwei Sun , Zhengliang Shi , Shen Gao , Pengjie Ren , Maarten de Rijke , Zhaochun Ren

Graph Contrastive Learning (GCL) is a widely adopted approach in self-supervised graph representation learning, applying contrastive objectives to produce effective representations. However, current GCL methods primarily focus on capturing…

Machine Learning · Computer Science 2025-07-11 Dongxiao He , Yongqi Huang , Jitao Zhao , Xiaobao Wang , Zhen Wang