English
Related papers

Related papers: Probabilistic Contrastive Learning for Domain Adap…

200 papers

Contrastive learning (CL) has been successful as a powerful representation learning method. In this work we propose CLIM: Contrastive Learning with mutual Information Maximization, to explore the potential of CL on cross-domain sentiment…

Computation and Language · Computer Science 2020-11-13 Tian Li , Xiang Chen , Shanghang Zhang , Zhen Dong , Kurt Keutzer

Contrastive learning (CL), a self-supervised learning approach, can effectively learn visual representations from unlabeled data. Given the CL training data, generative models can be trained to generate synthetic data to supplement the real…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yawen Wu , Zhepeng Wang , Dewen Zeng , Yiyu Shi , Jingtong Hu

Contrastive Learning (CL) enhances the training of sequential recommendation (SR) models through informative self-supervision signals. Existing methods often rely on data augmentation strategies to create positive samples and promote…

Information Retrieval · Computer Science 2026-04-06 Zhikai Wang , Yanyan Shen , Zexi Zhang , Li He , Yichun Li , Hao Gu , Yinghua Zhang

Unsupervised domain adaptation (UDA) aims at learning a machine learning model using a labeled source domain that performs well on a similar yet different, unlabeled target domain. UDA is important in many applications such as medicine,…

Machine Learning · Computer Science 2023-02-08 Yilmazcan Ozyurt , Stefan Feuerriegel , Ce Zhang

This paper studies continual learning (CL) of a sequence of aspect sentiment classification(ASC) tasks in a particular CL setting called domain incremental learning (DIL). Each task is from a different domain or product. The DIL setting is…

Computation and Language · Computer Science 2021-12-21 Zixuan Ke , Bing Liu , Hu Xu , Lei Shu

Many Click-Through Rate (CTR) prediction works focused on designing advanced architectures to model complex feature interactions but neglected the importance of feature representation learning, e.g., adopting a plain embedding layer for…

Information Retrieval · Computer Science 2022-12-02 Fangye Wang , Yingxu Wang , Dongsheng Li , Hansu Gu , Tun Lu , Peng Zhang , Ning Gu

Despite its significant success, object detection in traffic and transportation scenarios requires time-consuming and laborious efforts in acquiring high-quality labeled data. Therefore, Unsupervised Domain Adaptation (UDA) for object…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zehua Fu , Chenguang Liu , Yuyu Chen , Jiaqi Zhou , Qingjie Liu , Yunhong Wang

Long-tailed distributions frequently emerge in real-world data, where a large number of minority categories contain a limited number of samples. Such imbalance issue considerably impairs the performance of standard supervised learning…

Machine Learning · Computer Science 2024-03-15 Chaoqun Du , Yulin Wang , Shiji Song , Gao Huang

Self-supervised contrastive learning (CL) has achieved state-of-the-art performance in representation learning by minimizing the distance between positive pairs while maximizing that of negative ones. Recently, it has been verified that the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jin-Young Kim , Soonwoo Kwon , Hyojun Go , Yunsung Lee , Seungtaek Choi , Hyun-Gyoon Kim

Recently, contrastive learning (CL) has emerged as a successful method for unsupervised graph representation learning. Most graph CL methods first perform stochastic augmentation on the input graph to obtain two graph views and maximize the…

Machine Learning · Computer Science 2021-03-01 Yanqiao Zhu , Yichen Xu , Feng Yu , Qiang Liu , Shu Wu , Liang Wang

Contrastive learning models have demonstrated impressive abilities to capture semantic similarities by aligning representations in the embedding space. However, their performance can be limited by the quality of the training data and its…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Amirabbas Afzali , Borna Khodabandeh , Ali Rasekh , Mahyar JafariNodeh , Sepehr kazemi , Simon Gottschalk

Contrastive learning (CL) is a predominant technique in image classification, but they showed limited performance with an imbalanced dataset. Recently, several supervised CL methods have been proposed to promote an ideal regular simplex…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Sumin Roh , Harim Kim , Ho Yun Lee , Il Yong Chun

Deep clustering successfully provides more effective features than conventional ones and thus becomes an important technique in current unsupervised learning. However, most deep clustering methods ignore the vital positive and negative…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Zhiyuan Dang , Cheng Deng , Xu Yang , Heng Huang

This paper explores useful modifications of the recent development in contrastive learning via novel probabilistic modeling. We derive a particular form of contrastive loss named Joint Contrastive Learning (JCL). JCL implicitly involves the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Qi Cai , Yu Wang , Yingwei Pan , Ting Yao , Tao Mei

In general, an experimental environment for deep learning assumes that the training and the test dataset are sampled from the same distribution. However, in real-world situations, a difference in the distribution between two datasets,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Daehee Kim , Seunghyun Park , Jinkyu Kim , Jaekoo Lee

Unsupervised domain adaptation~(UDA) aims at reducing the distribution discrepancy when transferring knowledge from a labeled source domain to an unlabeled target domain. Previous UDA methods assume that the source and target domains share…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Chuan-Xian Ren , Pengfei Ge , Peiyi Yang , Shuicheng Yan

Contrastive Learning (CL) has shown promising performance in collaborative filtering. The key idea is to generate augmentation-invariant embeddings by maximizing the Mutual Information between different augmented views of the same instance.…

Information Retrieval · Computer Science 2024-01-01 Huiyuan Chen , Vivian Lai , Hongye Jin , Zhimeng Jiang , Mahashweta Das , Xia Hu

In standard supervised machine learning, it is necessary to provide a label for every input in the data. While raw data in many application domains is easily obtainable on the Internet, manual labelling of this data is prohibitively…

Machine Learning · Computer Science 2023-09-07 Konstantinos Christopher Tsiolis

Place recognition is an essential and challenging task in loop closing and global localization for robotics and autonomous driving applications. Benefiting from the recent advances in deep learning techniques, the performance of LiDAR place…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Jiafeng Cui , Xieyuanli Chen

Contrastive learning is a popular form of self-supervised learning that encourages augmentations (views) of the same input to have more similar representations compared to augmentations of different inputs. Recent attempts to theoretically…

Machine Learning · Computer Science 2022-03-01 Nikunj Saunshi , Jordan Ash , Surbhi Goel , Dipendra Misra , Cyril Zhang , Sanjeev Arora , Sham Kakade , Akshay Krishnamurthy