English
Related papers

Related papers: Joint Contrastive Learning for Unsupervised Domain…

200 papers

Semantic segmentation models struggle to generalize in the presence of domain shift. In this paper, we introduce contrastive learning for feature alignment in cross-domain adaptation. We assemble both in-domain contrastive pairs and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Feihu Zhang , Vladlen Koltun , Philip Torr , René Ranftl , Stephan R. Richter

Unsupervised domain adaptation seeks to learn an invariant and discriminative representation for an unlabeled target domain by leveraging the information of a labeled source dataset. We propose to improve the discriminative ability of the…

Machine Learning · Computer Science 2019-06-03 Rui Wang , Guoyin Wang , Ricardo Henao

Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models. Modern batch contrastive approaches…

Machine Learning · Computer Science 2021-03-12 Prannay Khosla , Piotr Teterwak , Chen Wang , Aaron Sarna , Yonglong Tian , Phillip Isola , Aaron Maschinot , Ce Liu , Dilip Krishnan

Visual recognition is recently learned via either supervised learning on human-annotated image-label data or language-image contrastive learning with webly-crawled image-text pairs. While supervised learning may result in a more…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Jianwei Yang , Chunyuan Li , Pengchuan Zhang , Bin Xiao , Ce Liu , Lu Yuan , Jianfeng Gao

Existing unsupervised domain adaptation methods based on adversarial learning have achieved good performance in several medical imaging tasks. However, these methods focus only on global distribution adaptation and ignore distribution…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Wei Feng , Lin Wang , Lie Ju , Xin Zhao , Xin Wang , Xiaoyu Shi , Zongyuan Ge

To improve the detection accuracy and generalization of steganalysis, this paper proposes the Steganalysis Contrastive Framework (SCF) based on contrastive learning. The SCF improves the feature representation of steganalysis by maximizing…

Artificial Intelligence · Computer Science 2021-03-02 Yanzhen Ren , Yiwen Liu , Lina Wang

Despite recent success, most contrastive self-supervised learning methods are domain-specific, relying heavily on data augmentation techniques that require knowledge about a particular domain, such as image cropping and rotation. To…

Machine Learning · Computer Science 2021-07-21 Vikas Verma , Minh-Thang Luong , Kenji Kawaguchi , Hieu Pham , Quoc V. Le

Due to the advantages of leveraging unlabeled data and learning meaningful representations, semi-supervised learning and contrastive learning have been progressively combined to achieve better performances in popular applications with few…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Bowen Tao , Lan Li , Xin-Chun Li , De-Chuan Zhan

In Self-Supervised Learning (SSL), various pretext tasks are designed for learning feature representations through contrastive loss. However, previous studies have shown that this loss is less tolerant to semantically similar samples due to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-07 Shanshan Wang , Soumya Tripathy , Annamaria Mesaros

State-of-the-art natural language understanding classification models follow two-stages: pre-training a large language model on an auxiliary task, and then fine-tuning the model on a task-specific labeled dataset using cross-entropy loss.…

Computation and Language · Computer Science 2021-04-06 Beliz Gunel , Jingfei Du , Alexis Conneau , Ves Stoyanov

We introduce a novel approach to unsupervised and semi-supervised domain adaptation for semantic segmentation. Unlike many earlier methods that rely on adversarial learning for feature alignment, we leverage contrastive learning to bridge…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Weizhe Liu , David Ferstl , Samuel Schulter , Lukas Zebedin , Pascal Fua , Christian Leistner

We propose Domain-Conditioned Meta-Contrastive Learning, a framework for improving the cross-domain generalization of vision-language models. While contrastive models such as CLIP achieve strong performance through large-scale training,…

Optimization and Control · Mathematics 2026-03-31 Merham Fouladvand , Peuroly Batra

We study the problem of unsupervised domain adaptation, which aims to adapt classifiers trained on a labeled source domain to an unlabeled target domain. Many existing approaches first learn domain-invariant features and then construct…

Machine Learning · Computer Science 2012-07-03 Yuan Shi , Fei Sha

To overcome the domain gap between synthetic and real-world datasets, unsupervised domain adaptation methods have been proposed for semantic segmentation. Majority of the previous approaches have attempted to reduce the gap either at the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Tianyu Li , Subhankar Roy , Huayi Zhou , Hongtao Lu , Stephane Lathuiliere

With the recent promising results of contrastive learning in the self-supervised learning paradigm, supervised contrastive learning has successfully extended these contrastive approaches to supervised contexts, outperforming cross-entropy…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Jaewon Kim , Hyukjong Lee , Jooyoung Chang , Sang Min Park

Domain adaptation is transfer learning which aims to generalize a learning model across training and testing data with different distributions. Most previous research tackle this problem in seeking a shared feature representation between…

Machine Learning · Computer Science 2017-04-17 Lingkun Luo , Xiaofang Wang , Shiqiang Hu , Chao Wang , Yuxing Tang , Liming Chen

Unsupervised domain adaptation aims to align a labeled source domain and an unlabeled target domain, but it requires to access the source data which often raises concerns in data privacy, data portability and data transmission efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Jiaxing Huang , Dayan Guan , Aoran Xiao , Shijian Lu

Detecting Out-of-Domain (OOD) or unknown intents from user queries is essential in a task-oriented dialog system. A key challenge of OOD detection is to learn discriminative semantic features. Traditional cross-entropy loss only focuses on…

Computation and Language · Computer Science 2021-06-01 Zhiyuan Zeng , Keqing He , Yuanmeng Yan , Zijun Liu , Yanan Wu , Hong Xu , Huixing Jiang , Weiran Xu

As a recent noticeable topic, domain generalization aims to learn a generalizable model on multiple source domains, which is expected to perform well on unseen test domains. Great efforts have been made to learn domain-invariant features by…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Jianxin Lin , Yongqiang Tang , Junping Wang , Wensheng Zhang

In this study, we focus on the unsupervised domain adaptation problem where an approximate inference model is to be learned from a labeled data domain and expected to generalize well to an unlabeled data domain. The success of unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Jing Wang , Jiahong Chen , Jianzhe Lin , Leonid Sigal , Clarence W. de Silva