English
Related papers

Related papers: Negatives-Dominant Contrastive Learning for Genera…

200 papers

Deep networks trained on the source domain show degraded performance when tested on unseen target domain data. To enhance the model's generalization ability, most existing domain generalization methods learn domain invariant features by…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Liwei Yang , Xiang Gu , Jian Sun

Contrastive learning has demonstrated promising potential in recommender systems. Existing methods typically construct sparser views by randomly perturbing the original interaction graph, as they have no idea about the authentic user…

Information Retrieval · Computer Science 2025-12-19 Xufeng Liang , Zhida Qin , Chong Zhang , Tianyu Huang , Gangyi Ding

This paper explores useful modifications of the recent development in contrastive learning via novel probabilistic modeling. We derive a particular form of contrastive loss named Joint Contrastive Learning (JCL). JCL implicitly involves the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Qi Cai , Yu Wang , Yingwei Pan , Ting Yao , Tao Mei

Contrastive learning (CL) continuously achieves significant breakthroughs across multiple domains. However, the most common InfoNCE-based methods suffer from some dilemmas, such as \textit{uniformity-tolerance dilemma} (UTD) and…

Machine Learning · Computer Science 2023-06-13 Zizheng Huang , Haoxing Chen , Ziqi Wen , Chao Zhang , Huaxiong Li , Bo Wang , Chunlin Chen

Differentially private (DP) contrastive learning aims to learn general-purpose representations from sensitive data, alleviating the privacy leakage concerns of organizations deploying or sharing embedding models trained on private user…

Cryptography and Security · Computer Science 2026-04-30 Kecen Li , Chen Gong , Zinan Lin , Tianhao Wang , Xiaokui Xiao

Domain generalization(DG) endeavors to develop robust models that possess strong generalizability while preserving excellent discriminability. Nonetheless, pivotal DG techniques tend to improve the feature generalizability by learning…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Shaocong Long , Qianyu Zhou , Chenhao Ying , Lizhuang Ma , Yuan Luo

Machine learning models typically suffer from the domain shift problem when trained on a source dataset and evaluated on a target dataset of different distribution. To overcome this problem, domain generalisation (DG) methods aim to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Kaiyang Zhou , Yongxin Yang , Timothy Hospedales , Tao Xiang

While achieving remarkable success for medical image segmentation, deep convolution neural networks (DCNNs) often fail to maintain their robustness when confronting test data with the novel distribution. To address such a drawback, the…

Image and Video Processing · Electrical Eng. & Systems 2022-05-09 Yuxin Kang , Hansheng Li , Xuan Zhao , Dongqing Hu , Feihong Liu , Lei Cui , Jun Feng , Lin Yang

Domain generalization (DG) intends to train a model on multiple source domains to ensure that it can generalize well to an arbitrary unseen target domain. The acquisition of domain-invariant representations is pivotal for DG as they possess…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Na Wang , Lei Qi , Jintao Guo , Yinghuan Shi , Yang Gao

Fault diagnosis under unseen operating conditions remains highly challenging when labeled data are scarce. Semi-supervised domain generalization fault diagnosis (SSDGFD) provides a practical solution by jointly exploiting labeled and…

Machine Learning · Computer Science 2026-04-24 Junyu Ren , Wensheng Gan , Philip S Yu

Unsupervised domain adaptation (UDA) aims to improve the classification performance on an unlabeled target domain by leveraging information from a fully labeled source domain. Recent approaches explore domain-invariant and…

Machine Learning · Computer Science 2021-03-26 Ni Xiao , Lei Zhang

This study reveals the inherent tolerance of contrastive learning (CL) towards sampling bias, wherein negative samples may encompass similar semantics (\eg labels). However, existing theories fall short in providing explanations for this…

Machine Learning · Computer Science 2023-10-18 Junkang Wu , Jiawei Chen , Jiancan Wu , Wentao Shi , Xiang Wang , Xiangnan He

Long-tailed data bias decision boundaries toward head classes and degrade tail class accuracy. Diffusion-based generative augmentation address this problem by generating additional data, while head-to-tail transfer further mitigate the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jiacheng Yang , Ruichi Zhang , Chikai Shang , Mengke Li , Xinyi Shang , Junlong Gao , Yonggang Zhang , Yang Lu

In vision domain, large-scale natural datasets typically exhibit long-tailed distribution which has large class imbalance between head and tail classes. This distribution poses difficulty in learning good representations for tail classes.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Anthony Meng Huat Tiong , Junnan Li , Guosheng Lin , Boyang Li , Caiming Xiong , Steven C. H. Hoi

Graph contrastive learning (GCL) emerges as the most representative approach for graph representation learning, which leverages the principle of maximizing mutual information (InfoMax) to learn node representations applied in downstream…

Machine Learning · Computer Science 2022-11-22 Yige Yuan , Bingbing Xu , Huawei Shen , Qi Cao , Keting Cen , Wen Zheng , Xueqi Cheng

Recently,the detection transformer has gained substantial attention for its inherent minimal post-processing requirement.However,this paradigm relies on abundant training data,yet in the context of the cross-domain adaptation,insufficient…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Ziru Zeng , Yue Ding , Hongtao Lu

In this work, we propose a domain generalization (DG) approach to learn on several labeled source domains and transfer knowledge to a target domain that is inaccessible in training. Considering the inherent conditional and label shifts, we…

Machine Learning · Computer Science 2021-07-26 Xiaofeng Liu , Bo Hu , Linghao Jin , Xu Han , Fangxu Xing , Jinsong Ouyang , Jun Lu , Georges EL Fakhri , Jonghye Woo

Deep networks are well-known to be fragile to adversarial attacks, and adversarial training is one of the most popular methods used to train a robust model. To take advantage of unlabeled data, recent works have applied adversarial training…

Machine Learning · Computer Science 2023-02-22 Xin Zou , Weiwei Liu

Classifiers often learn to be biased corresponding to the class-imbalanced dataset, especially under the semi-supervised learning (SSL) set. While previous work tries to appropriately re-balance the classifiers by subtracting a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Weiwei Xing , Yue Cheng , Hongzhu Yi , Xiaohui Gao , Xiang Wei , Xiaoyu Guo , Yuming Zhang , Xinyu Pang

Domain generalization (DG) aims to incorporate knowledge from multiple source domains into a single model that could generalize well on unseen target domains. This problem is ubiquitous in practice since the distributions of the target data…

Machine Learning · Statistics 2019-07-26 Shoubo Hu , Kun Zhang , Zhitang Chen , Laiwan Chan