中文
相关论文

相关论文: Self-supervised Contrastive Learning for Implicit …

200 篇论文

As one of the most effective self-supervised representation learning methods, contrastive learning (CL) relies on multiple negative pairs to contrast against each positive pair. In the standard practice of contrastive learning, data…

机器学习 · 计算机科学 2024-01-18 Lu Wang , Chao Du , Pu Zhao , Chuan Luo , Zhangchi Zhu , Bo Qiao , Wei Zhang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Self-supervised Contrastive Learning (CL) has been recently shown to be very effective in preventing deep networks from overfitting noisy labels. Despite its empirical success, the theoretical understanding of the effect of contrastive…

机器学习 · 计算机科学 2022-07-06 Yihao Xue , Kyle Whitecross , Baharan Mirzasoleiman

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

计算机视觉与模式识别 · 计算机科学 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Learning and evaluating recommender systems from logged implicit feedback is challenging due to exposure bias. While inverse propensity scoring (IPS) corrects this bias, it often suffers from high variance and instability. In this paper, we…

机器学习 · 计算机科学 2025-09-03 Rahul Raja , Arpita Vats

Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for…

计算机视觉与模式识别 · 计算机科学 2026-02-09 Salma Haidar , José Oramas

Recently, learning from vast unlabeled data, especially self-supervised learning, has been emerging and attracted widespread attention. Self-supervised learning followed by the supervised fine-tuning on a few labeled examples can…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Wentao Zhu , Hang Shang , Tingxun Lv , Chao Liao , Sen Yang , Ji Liu

Recently, as an effective way of learning latent representations, contrastive learning has been increasingly popular and successful in various domains. The success of constrastive learning in single-label classifications motivates us to…

计算机视觉与模式识别 · 计算机科学 2021-07-27 Son D. Dao , Ethan Zhao , Dinh Phung , Jianfei Cai

Pretext Invariant Representation Learning (PIRL) followed by Supervised Fine-Tuning (SFT) has become a standard paradigm for learning with limited labels. We extend this approach to the Positive Unlabeled (PU) setting, where only a small…

Recommender systems are widely deployed in various web environments, and self-supervised learning (SSL) has recently attracted significant attention in this field. Contrastive learning (CL) stands out as a major SSL paradigm due to its…

信息检索 · 计算机科学 2025-01-17 Yu Zhang , Lei Sang , Yi Zhang , Yiwen Zhang , Yun Yang

Learning rich visual representations using contrastive self-supervised learning has been extremely successful. However, it is still a major question whether we could use a similar approach to learn superior auditory representations. In this…

声音 · 计算机科学 2020-10-20 Haider Al-Tahan , Yalda Mohsenzadeh

Inspired by the impressive success of contrastive learning (CL), a variety of graph augmentation strategies have been employed to learn node representations in a self-supervised manner. Existing methods construct the contrastive samples by…

机器学习 · 计算机科学 2022-12-14 Peiyao Zhao , Yuangang Pan , Xin Li , Xu Chen , Ivor W. Tsang , Lejian Liao

Self-supervised representation learning can mitigate the limitations in recognition tasks with few manually labeled data but abundant unlabeled data---a common scenario in sound event research. In this work, we explore unsupervised…

声音 · 计算机科学 2020-11-17 Eduardo Fonseca , Diego Ortego , Kevin McGuinness , Noel E. O'Connor , Xavier Serra

In response to an object presentation, supervised learning schemes generally respond with a parsimonious label. Upon a similar presentation we humans respond again with a label, but are flooded, in addition, by a myriad of associations. A…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Daniel N. Nissani

Due to the advantages of leveraging unlabeled data and learning meaningful representations, semi-supervised learning and contrastive learning have been progressively combined to achieve better performances in popular applications with few…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Bowen Tao , Lan Li , Xin-Chun Li , De-Chuan Zhan

Deep supervised learning has achieved great success in the last decade. However, its deficiencies of dependence on manual labels and vulnerability to attacks have driven people to explore a better solution. As an alternative,…

机器学习 · 计算机科学 2021-06-28 Xiao Liu , Fanjin Zhang , Zhenyu Hou , Zhaoyu Wang , Li Mian , Jing Zhang , Jie Tang

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

机器学习 · 计算机科学 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

We present a contrasting learning approach with data augmentation techniques to learn document representations in an unsupervised manner. Inspired by recent contrastive self-supervised learning algorithms used for image and NLP pretraining,…

The pursuit of learning robust representations without human supervision is a longstanding challenge. The recent advancements in self-supervised contrastive learning approaches have demonstrated high performance across various…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Ozgu Goksu , Nicolas Pugeault

The sequential recommendation aims at predicting the next items in user behaviors, which can be solved by characterizing item relationships in sequences. Due to the data sparsity and noise issues in sequences, a new self-supervised learning…

机器学习 · 计算机科学 2022-03-30 Zhiwei Liu , Yongjun Chen , Jia Li , Man Luo , Philip S. Yu , Caiming Xiong

In this work, we aim to consider the application of contrastive learning in the scenario of the recommendation system adequately, making it more suitable for recommendation task. We propose a learning paradigm called supervised contrastive…

信息检索 · 计算机科学 2022-04-20 Chun Yang