中文
相关论文

相关论文: Synthetic Hard Negative Samples for Contrastive Le…

200 篇论文

Contrastive learning has achieved remarkable success on various high-level tasks, but there are fewer contrastive learning-based methods proposed for low-level tasks. It is challenging to adopt vanilla contrastive learning technologies…

计算机视觉与模式识别 · 计算机科学 2023-07-18 Gang Wu , Junjun Jiang , Xianming Liu

Ensuring the realism of computer-generated synthetic images is crucial to deep neural network (DNN) training. Due to different semantic distributions between synthetic and real-world captured datasets, there exists semantic mismatch between…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Ganning Zhao , Tingwei Shen , Suya You , C. -C. Jay Kuo

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

计算机视觉与模式识别 · 计算机科学 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

While effective in recommendation tasks, collaborative filtering (CF) techniques face the challenge of data sparsity. Researchers have begun leveraging contrastive learning to introduce additional self-supervised signals to address this.…

信息检索 · 计算机科学 2024-02-20 Peijie Sun , Le Wu , Kun Zhang , Xiangzhi Chen , Meng Wang

Recent years have witnessed many successful applications of contrastive learning in diverse domains, yet its self-supervised version still remains many exciting challenges. As the negative samples are drawn from unlabeled datasets, a…

机器学习 · 计算机科学 2024-02-01 Bin Liu , Bang Wang , Tianrui Li

Anomaly detection aims at identifying deviant samples from the normal data distribution. Contrastive learning has provided a successful way to sample representation that enables effective discrimination on anomalies. However, when…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Gaoang Wang , Yibing Zhan , Xinchao Wang , Mingli Song , Klara Nahrstedt

Contrastive learning, especially self-supervised contrastive learning (SSCL), has achieved great success in extracting powerful features from unlabeled data. In this work, we contribute to the theoretical understanding of SSCL and uncover…

机器学习 · 计算机科学 2023-06-05 Tianyang Hu , Zhili Liu , Fengwei Zhou , Wenjia Wang , Weiran Huang

Graph contrastive learning has emerged as a powerful tool for unsupervised graph representation learning. The key to the success of graph contrastive learning is to acquire high-quality positive and negative samples as contrasting pairs for…

机器学习 · 计算机科学 2023-05-19 Haoran Yang , Hongxu Chen , Sixiao Zhang , Xiangguo Sun , Qian Li , Xiangyu Zhao , Guandong Xu

Contrastive Learning (CL) enhances the training of sequential recommendation (SR) models through informative self-supervision signals. Existing methods often rely on data augmentation strategies to create positive samples and promote…

信息检索 · 计算机科学 2026-04-06 Zhikai Wang , Yanyan Shen , Zexi Zhang , Li He , Yichun Li , Hao Gu , Yinghua Zhang

Learning scientific document representations can be substantially improved through contrastive learning objectives, where the challenge lies in creating positive and negative training samples that encode the desired similarity semantics.…

计算与语言 · 计算机科学 2022-10-20 Malte Ostendorff , Nils Rethmeier , Isabelle Augenstein , Bela Gipp , Georg Rehm

Image classification datasets exhibit a non-negligible fraction of mislabeled examples, often due to human error when one class superficially resembles another. This issue poses challenges in supervised contrastive learning (SCL), where the…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Zijun Long , George Killick , Lipeng Zhuang , Richard McCreadie , Gerardo Aragon Camarasa , Paul Henderson

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

机器学习 · 计算机科学 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

The learn-to-compare paradigm of contrastive representation learning (CRL), which compares positive samples with negative ones for representation learning, has achieved great success in a wide range of domains, including natural language…

信息检索 · 计算机科学 2022-06-02 Lanling Xu , Jianxun Lian , Wayne Xin Zhao , Ming Gong , Linjun Shou , Daxin Jiang , Xing Xie , Ji-Rong Wen

Whilst contrastive learning has recently brought notable benefits to deep clustering of unlabelled images by learning sample-specific discriminative visual features, its potential for explicitly inferring class decision boundaries is less…

计算机视觉与模式识别 · 计算机科学 2022-11-22 Jiabo Huang , Shaogang Gong

Self-supervised representation learning has made significant leaps fueled by progress in contrastive learning, which seeks to learn transformations that embed positive input pairs nearby, while pushing negative pairs far apart. While…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Tri Huynh , Simon Kornblith , Matthew R. Walter , Michael Maire , Maryam Khademi

Contrastive learning -- a modern approach to extract useful representations from unlabeled data by training models to distinguish similar samples from dissimilar ones -- has driven significant progress in foundation models. In this work, we…

机器学习 · 统计学 2025-10-15 Licong Lin , Song Mei

Sound source localization aims to localize objects emitting the sound in visual scenes. Recent works obtaining impressive results typically rely on contrastive learning. However, the common practice of randomly sampling negatives in prior…

计算机视觉与模式识别 · 计算机科学 2024-08-30 Zengjie Song , Jiangshe Zhang , Yuxi Wang , Junsong Fan , Zhaoxiang Zhang

Contrastive learning predicts whether two images belong to the same category by training a model to make their feature representations as close or as far away as possible. In this paper, we rethink how to mine samples in contrastive…

计算机视觉与模式识别 · 计算机科学 2023-11-02 Hengkui Dong , Xianzhong Long , Yun Li

Contrastive learning based on instance discrimination trains model to discriminate different transformations of the anchor sample from other samples, which does not consider the semantic similarity among samples. This paper proposes a new…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Hao Li , Xiaopeng Zhang , Hongkai Xiong

Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudo labels as supervision and use the learned representations for several…

计算机视觉与模式识别 · 计算机科学 2021-02-09 Ashish Jaiswal , Ashwin Ramesh Babu , Mohammad Zaki Zadeh , Debapriya Banerjee , Fillia Makedon