中文
相关论文

相关论文: Contrastive Learning with Negative Sampling Correc…

200 篇论文

Multi-label image classification presents a challenging task in many domains, including computer vision and medical imaging. Recent advancements have introduced graph-based and transformer-based methods to improve performance and capture…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Ahmad Sajedi , Samir Khaki , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

How can you sample good negative examples for contrastive learning? We argue that, as with metric learning, contrastive learning of representations benefits from hard negative samples (i.e., points that are difficult to distinguish from an…

机器学习 · 计算机科学 2021-01-26 Joshua Robinson , Ching-Yao Chuang , Suvrit Sra , Stefanie Jegelka

Contrastive learning has gained significant attention in short text clustering, yet it has an inherent drawback of mistakenly identifying samples from the same category as negatives and then separating them in the feature space (false…

机器学习 · 计算机科学 2026-03-16 Zhihao Yao

Graph contrastive learning (GCL) aims to contrast positive-negative counterparts to learn the node embeddings, whereas graph data augmentation methods are employed to generate these positive-negative samples. The variation, quantity, and…

机器学习 · 计算机科学 2025-03-05 Adnan Ali , Jinlong Li , Huanhuan Chen , Ali Kashif Bashir

Many contrastive representation learning methods learn a single global representation of an entire image. However, dense contrastive representation learning methods such as DenseCL (Wang et al., 2021) can learn better representations for…

计算机视觉与模式识别 · 计算机科学 2023-01-12 Berk Iskender , Zhenlin Xu , Simon Kornblith , En-Hung Chu , Maryam Khademi

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

机器学习 · 计算机科学 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

Positive Unlabeled (PU) learning is widely used in many applications, where a binary classifier is trained on the datasets consisting of only positive and unlabeled samples. In this paper, we improve PU learning over state-of-the-art from…

机器学习 · 计算机科学 2020-04-22 Liwei Jiang , Dan Li , Qisheng Wang , Shuai Wang , Songtao Wang

With the advent of big data across multiple high-impact applications, we are often facing the challenge of complex heterogeneity. The newly collected data usually consist of multiple modalities and are characterized with multiple labels,…

机器学习 · 计算机科学 2022-07-27 Lecheng Zheng , Jinjun Xiong , Yada Zhu , Jingrui He

Graph contrastive learning (GCL) is a popular method for leaning graph representations by maximizing the consistency of features across augmented views. Traditional GCL methods utilize single-perspective i.e. data or model-perspective)…

机器学习 · 计算机科学 2024-06-04 Zelin Yao , Chuang Liu , Xueqi Ma , Mukun Chen , Jia Wu , Xiantao Cai , Bo Du , Wenbin Hu

Graph contrastive learning (GCL) has been widely applied to text classification tasks due to its ability to generate self-supervised signals from unlabeled data, thus facilitating model training. However, existing GCL-based text…

机器学习 · 计算机科学 2024-10-25 Wei Ai , Jianbin Li , Ze Wang , Jiayi Du , Tao Meng , Yuntao Shou , Keqin Li

Sound source localization aims to localize objects emitting the sound in visual scenes. Recent works obtaining impressive results typically rely on contrastive learning. However, the common practice of randomly sampling negatives in prior…

计算机视觉与模式识别 · 计算机科学 2024-08-30 Zengjie Song , Jiangshe Zhang , Yuxi Wang , Junsong Fan , Zhaoxiang Zhang

Positive-unlabeled (PU) learning aims to train a classifier using the data containing only labeled-positive instances and unlabeled instances. However, existing PU learning methods are generally hard to achieve satisfactory performance on…

机器学习 · 统计学 2024-06-03 Xiaoke Wang , Xiaochen Yang , Rui Zhu , Jing-Hao Xue

Graph contrastive learning (GCL) has recently emerged as an effective learning paradigm to alleviate the reliance on labelling information for graph representation learning. The core of GCL is to maximise the mutual information between the…

机器学习 · 计算机科学 2022-10-18 Yizhen Zheng , Yu Zheng , Xiaofei Zhou , Chen Gong , Vincent CS Lee , Shirui Pan

Self-supervised learning approach like contrastive learning is attached great attention in natural language processing. It uses pairs of training data augmentations to build a classification task for an encoder with well representation…

计算与语言 · 计算机科学 2021-12-03 Deshui Miao , Jiaqi Zhang , Wenbo Xie , Jian Song , Xin Li , Lijuan Jia , Ning Guo

In contrastive learning, two views of an original image, generated by different augmentations, are considered a positive pair, and their similarity is required to be high. Similarly, two views of distinct images form a negative pair, with…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Lei Wang , Piotr Koniusz , Tom Gedeon , Liang Zheng

Contrastive learning-based recommendation algorithms have significantly advanced the field of self-supervised recommendation, particularly with BPR as a representative ranking prediction task that dominates implicit collaborative filtering.…

信息检索 · 计算机科学 2024-03-13 Shipeng Song , Bin Liu , Fei Teng , Tianrui Li

Learning sentence embeddings in an unsupervised manner is fundamental in natural language processing. Recent common practice is to couple pre-trained language models with unsupervised contrastive learning, whose success relies on augmenting…

计算与语言 · 计算机科学 2022-10-20 Qiyu Wu , Chongyang Tao , Tao Shen , Can Xu , Xiubo Geng , Daxin Jiang

Recently, contrastive learning has achieved great results in self-supervised learning, where the main idea is to push two augmentations of an image (positive pairs) closer compared to other random images (negative pairs). We argue that not…

计算机视觉与模式识别 · 计算机科学 2021-09-13 Ajinkya Tejankar , Soroush Abbasi Koohpayegani , Vipin Pillai , Paolo Favaro , Hamed Pirsiavash

Unsupervised learning has recently made exceptional progress because of the development of more effective contrastive learning methods. However, CNNs are prone to depend on low-level features that humans deem non-semantic. This dependency…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Songwei Ge , Shlok Mishra , Haohan Wang , Chun-Liang Li , David Jacobs

Semi-supervised learning acts as an effective way to leverage massive unlabeled data. In this paper, we propose a novel training strategy, termed as Semi-supervised Contrastive Learning (SsCL), which combines the well-known contrastive loss…

计算机视觉与模式识别 · 计算机科学 2021-05-18 Yuhang Zhang , Xiaopeng Zhang , Robert. C. Qiu , Jie Li , Haohang Xu , Qi Tian