English
Related papers

Related papers: Probabilistic Contrastive Learning for Domain Adap…

200 papers

Feature extraction is an efficient approach for alleviating the issue of dimensionality in high-dimensional data. As a popular self-supervised learning method, contrastive learning has recently garnered considerable attention. In this…

Machine Learning · Computer Science 2021-09-14 Hongjie Zhang

Meta-reinforcement learning typically requires orders of magnitude more samples than single task reinforcement learning methods. This is because meta-training needs to deal with more diverse distributions and train extra components such as…

Machine Learning · Computer Science 2021-03-12 Bernie Wang , Simon Xu , Kurt Keutzer , Yang Gao , Bichen Wu

In the presence of large sets of labeled data, Deep Learning (DL) has accomplished extraordinary triumphs in the avenue of computer vision, particularly in object classification and recognition tasks. However, DL cannot always perform well…

Computer Vision and Pattern Recognition · Computer Science 2019-01-03 Mohammad Mahfujur Rahman , Clinton Fookes , Mahsa Baktashmotlagh , Sridha Sridharan

Contrastive Learning (CL), a leading paradigm in Self-Supervised Learning (SSL), typically relies on pairs of data views generated through augmentation. While multiple augmentations per instance (more than two) improve generalization in…

To bridge the gap between the source and target domains in unsupervised domain adaptation (UDA), the most common strategy puts focus on matching the marginal distributions in the feature space through adversarial learning. However, such…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Zhizhe Liu , Zhenfeng Zhu , Shuai Zheng , Yang Liu , Jiayu Zhou , Yao Zhao

Semi-supervised learning acts as an effective way to leverage massive unlabeled data. In this paper, we propose a novel training strategy, termed as Semi-supervised Contrastive Learning (SsCL), which combines the well-known contrastive loss…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yuhang Zhang , Xiaopeng Zhang , Robert. C. Qiu , Jie Li , Haohang Xu , Qi Tian

Image captioning, a popular topic in computer vision, has achieved substantial progress in recent years. However, the distinctiveness of natural descriptions is often overlooked in previous work. It is closely related to the quality of…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Bo Dai , Dahua Lin

Feature alignment between domains is one of the mainstream methods for Unsupervised Domain Adaptation (UDA) semantic segmentation. Existing feature alignment methods for semantic segmentation learn domain-invariant features by adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Shuang Wang , Dong Zhao , Yi Li , Chi Zhang , Yuwei Guo , Qi Zang , Biao Hou , Licheng Jiao

Unsupervised domain adaptation (UDA) for semantic segmentation has been well-studied in recent years. However, most existing works largely neglect the local regional consistency across different domains and are less robust to changes in…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Qianyu Zhou , Chuyun Zhuang , Ran Yi , Xuequan Lu , Lizhuang Ma

Domain generalization (DG) is a prevalent problem in real-world applications, which aims to train well-generalized models for unseen target domains by utilizing several source domains. Since domain labels, i.e., which domain each data point…

Machine Learning · Computer Science 2023-11-14 Yunze Tong , Junkun Yuan , Min Zhang , Didi Zhu , Keli Zhang , Fei Wu , Kun Kuang

Despite recent success, most contrastive self-supervised learning methods are domain-specific, relying heavily on data augmentation techniques that require knowledge about a particular domain, such as image cropping and rotation. To…

Machine Learning · Computer Science 2021-07-21 Vikas Verma , Minh-Thang Luong , Kenji Kawaguchi , Hieu Pham , Quoc V. Le

How to improve discriminative feature learning is central in classification. Existing works address this problem by explicitly increasing inter-class separability and intra-class similarity, whether by constructing positive and negative…

Machine Learning · Computer Science 2024-08-21 Qingsong Zhao , Yi Wang , Shuguang Dou , Chen Gong , Yin Wang , Cairong Zhao

We present Domain Contrast (DC), a simple yet effective approach inspired by contrastive learning for training domain adaptive detectors. DC is deduced from the error bound minimization perspective of a transferred model, and is implemented…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Feng Liu , Xiaoxong Zhang , Fang Wan , Xiangyang Ji , Qixiang Ye

We generalize the theory of supervised contrastive learning, previously applied to physical systems at equilibrium or steady state, to systems following any dynamics described by coupled ordinary differential equations. We show that if…

Disordered Systems and Neural Networks · Physics 2026-03-31 Menachem Stern , Adam G. Frim , Raúl Candás , Andrea J. Liu , Vijay Balasubramanian

Unsupervised domain adaptation uses source data from different distributions to solve the problem of classifying data from unlabeled target domains. However, conventional methods require access to source data, which often raise concerns…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Yuqi Chen , Xiangbin Zhu , Yonggang Li , Yingjian Li , Haojie Fang

Contrastive learning (CL) continuously achieves significant breakthroughs across multiple domains. However, the most common InfoNCE-based methods suffer from some dilemmas, such as \textit{uniformity-tolerance dilemma} (UTD) and…

Machine Learning · Computer Science 2023-06-13 Zizheng Huang , Haoxing Chen , Ziqi Wen , Chao Zhang , Huaxiong Li , Bo Wang , Chunlin Chen

Contrastive learning, which aims at minimizing the distance between positive pairs while maximizing that of negative ones, has been widely and successfully applied in unsupervised feature learning, where the design of positive and negative…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Rui Zhu , Bingchen Zhao , Jingen Liu , Zhenglong Sun , Chang Wen Chen

During the past decade, deep neural networks have led to fast-paced progress and significant achievements in computer vision problems, for both academia and industry. Yet despite their success, state-of-the-art image classification…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Aristotelis Ballas , Christos Diou

Cross-domain few-shot classification induces a much more challenging problem than its in-domain counterpart due to the existence of domain shifts between the training and test tasks. In this paper, we develop a novel Adaptive Parametric…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Marzi Heidari , Abdullah Alchihabi , Qing En , Yuhong Guo

Unsupervised feature learning has made great strides with contrastive learning based on instance discrimination and invariant mapping, as benchmarked on curated class-balanced datasets. However, natural data could be highly correlated and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Xudong Wang , Ziwei Liu , Stella X. Yu