中文
相关论文

相关论文: Contrastive Learning with Synthetic Positives

200 篇论文

Unpaired image-to-image translation aims to find a mapping between the source domain and the target domain. To alleviate the problem of the lack of supervised labels for the source images, cycle-consistency based methods have been proposed…

计算机视觉与模式识别 · 计算机科学 2022-07-14 Yupei Lin , Sen Zhang , Tianshui Chen , Yongyi Lu , Guangping Li , Yukai Shi

Recently, self-supervised methods show remarkable achievements in image-level representation learning. Nevertheless, their image-level self-supervisions lead the learned representation to sub-optimal for dense prediction tasks, such as…

计算机视觉与模式识别 · 计算机科学 2021-11-23 Yunsung Lee , Teakgyu Hong , Han-Cheol Cho , Junbum Cha , Seungryong Kim

Self-Supervised Contrastive Learning has proven effective in deriving high-quality representations from unlabeled data. However, a major challenge that hinders both unimodal and multimodal contrastive learning is feature suppression, a…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Jihai Zhang , Xiang Lan , Xiaoye Qu , Yu Cheng , Mengling Feng , Bryan Hooi

Large-scale foundation models, such as CLIP, have demonstrated remarkable success in visual recognition tasks by embedding images in a semantically rich space. Self-supervised learning (SSL) has also shown promise in improving visual…

计算机视觉与模式识别 · 计算机科学 2023-08-23 Mainak Singha , Ankit Jha , Biplab Banerjee

Geo-tagged images are publicly available in large quantities, whereas labels such as object classes are rather scarce and expensive to collect. Meanwhile, contrastive learning has achieved tremendous success in various natural image and…

计算机视觉与模式识别 · 计算机科学 2023-05-10 Gengchen Mai , Ni Lao , Yutong He , Jiaming Song , Stefano Ermon

Recent advances in self-supervised learning (SSL) have largely closed the gap with supervised ImageNet pretraining. Despite their success these methods have been primarily applied to unlabeled ImageNet images, and show marginal gains when…

计算机视觉与模式识别 · 计算机科学 2020-12-09 Ramprasaath R. Selvaraju , Karan Desai , Justin Johnson , Nikhil Naik

Graph contrastive learning (GCL) aligns node representations by classifying node pairs into positives and negatives using a selection process that typically relies on establishing correspondences within two augmented graphs. The…

机器学习 · 计算机科学 2024-11-27 Maysam Behmanesh , Maks Ovsjanikov

Negative sampling is a limiting factor w.r.t. the generalization of metric-learned neural networks. We show that uniform negative sampling provides little information about the class boundaries and thus propose three novel techniques for…

机器学习 · 计算机科学 2021-02-15 James O' Neill , Danushka Bollegala

Zero-shot learning (ZSL) aims to recognize classes that do not have samples in the training set. One representative solution is to directly learn an embedding function associating visual features with corresponding class semantics for…

计算机视觉与模式识别 · 计算机科学 2023-07-19 Yu Du , Miaojing Shi , Fangyun Wei , Guoqi Li

Whilst contrastive learning has recently brought notable benefits to deep clustering of unlabelled images by learning sample-specific discriminative visual features, its potential for explicitly inferring class decision boundaries is less…

计算机视觉与模式识别 · 计算机科学 2022-11-22 Jiabo Huang , Shaogang Gong

Beyond the success of Contrastive Language-Image Pre-training (CLIP), recent trends mark a shift toward exploring the applicability of lightweight vision-language models for resource-constrained scenarios. These models often deliver…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Chu Myaet Thwal , Ye Lin Tun , Minh N. H. Nguyen , Eui-Nam Huh , Choong Seon Hong

Many Click-Through Rate (CTR) prediction works focused on designing advanced architectures to model complex feature interactions but neglected the importance of feature representation learning, e.g., adopting a plain embedding layer for…

信息检索 · 计算机科学 2022-12-02 Fangye Wang , Yingxu Wang , Dongsheng Li , Hansu Gu , Tun Lu , Peng Zhang , Ning Gu

Self-supervised learning (SSL) methods have shown promise for medical imaging applications by learning meaningful visual representations, even when the amount of labeled data is limited. Here, we extend state-of-the-art contrastive learning…

Convolutional Neural Networks (CNNs) provide excellent performance when used for image classification. The classical method of training CNNs is by labeling images in a supervised manner as in "input image belongs to this label" (Positive…

机器学习 · 计算机科学 2019-08-21 Youngdong Kim , Junho Yim , Juseung Yun , Junmo Kim

Self-supervised contrastive learning (CL) effectively learns transferable representations from unlabeled data containing images or image-text pairs but suffers vulnerability to data poisoning backdoor attacks (DPCLs). An adversary can…

计算机视觉与模式识别 · 计算机科学 2025-08-20 Tuo Chen , Jie Gui , Minjing Dong , Ju Jia , Lanting Fang , Jian Liu

Contrastive Learning (CL) is a recent representation learning approach, which encourages inter-class separability and intra-class compactness in learned image representations. Since medical images often contain multiple semantic classes in…

计算机视觉与模式识别 · 计算机科学 2021-08-09 Prashant Pandey , Ajey Pai , Nisarg Bhatt , Prasenjit Das , Govind Makharia , Prathosh AP , Mausam

Contrastive Learning (CL) has been successfully applied to classification and other downstream tasks related to concrete concepts, such as objects contained in the ImageNet dataset. No attempts seem to have been made so far in applying this…

机器学习 · 计算机科学 2025-05-30 Daniel N. Nissani

The objective of this paper is to learn semantic representations for sleep stage classification from raw physiological time series. Although supervised methods have gained remarkable performance, they are limited in clinical situations due…

信号处理 · 电气工程与系统科学 2021-10-20 Hongjun Zhang , Jing Wang , Qinfeng Xiao , Jiaoxue Deng , Youfang Lin

In this work, we aim to consider the application of contrastive learning in the scenario of the recommendation system adequately, making it more suitable for recommendation task. We propose a learning paradigm called supervised contrastive…

信息检索 · 计算机科学 2022-04-20 Chun Yang

In this paper, we introduce a novel neural network training framework that increases model's adversarial robustness to adversarial attacks while maintaining high clean accuracy by combining contrastive learning (CL) with adversarial…

机器学习 · 计算机科学 2022-09-13 Adir Rahamim , Itay Naeh