中文
相关论文

相关论文: A Generalized Learning Framework for Self-Supervis…

200 篇论文

Previous work on action representation learning focused on global representations for short video clips. In contrast, many practical applications, such as video alignment, strongly demand learning the intensive representation of long…

计算机视觉与模式识别 · 计算机科学 2023-03-03 Minghao Chen , Renbo Tu , Chenxi Huang , Yuqi Lin , Boxi Wu , Deng Cai

Self-supervised learning (especially contrastive learning) methods on heterogeneous graphs can effectively get rid of the dependence on supervisory data. Meanwhile, most existing representation learning methods embed the heterogeneous…

机器学习 · 计算机科学 2022-06-28 Shichao Zhu , Chuan Zhou , Anfeng Cheng , Shirui Pan , Shuaiqiang Wang , Dawei Yin , Bin Wang

Graph neural networks (GNNs) have recently emerged as an effective collaborative filtering (CF) approaches for recommender systems. The key idea of GNN-based recommender systems is to recursively perform message passing along user-item…

信息检索 · 计算机科学 2023-07-14 Yangqin Jiang , Chao Huang , Lianghao Xia

Extracting image semantics effectively and assigning corresponding labels to multiple objects or attributes for natural images is challenging due to the complex scene contents and confusing label dependencies. Recent works have focused on…

计算机视觉与模式识别 · 计算机科学 2023-09-26 Leilei Ma , Dengdi Sun , Lei Wang , Haifeng Zhao , Bin Luo

Contrastive learning has been widely applied to graph representation learning, where the view generators play a vital role in generating effective contrastive samples. Most of the existing contrastive learning methods employ pre-defined…

机器学习 · 计算机科学 2022-01-04 Yihang Yin , Qingzhong Wang , Siyu Huang , Haoyi Xiong , Xiang Zhang

Self-supervised learning (SSL) has recently become the favorite among feature learning methodologies. It is therefore appealing for domain adaptation approaches to consider incorporating SSL. The intuition is to enforce instance-level…

计算机视觉与模式识别 · 计算机科学 2021-12-15 Yang Chen , Yingwei Pan , Yu Wang , Ting Yao , Xinmei Tian , Tao Mei

Tremendous breakthroughs have been developed in Semi-Supervised Semantic Segmentation (S4) through contrastive learning. However, due to limited annotations, the guidance on unlabeled images is generated by the model itself, which…

计算机视觉与模式识别 · 计算机科学 2024-02-29 Haoyu Xie , Changqi Wang , Jian Zhao , Yang Liu , Jun Dan , Chong Fu , Baigui Sun

Graph contrastive learning (GCL) aims to align the positive features while differentiating the negative features in the latent space by minimizing a pair-wise contrastive loss. As the embodiment of an outstanding discriminative unsupervised…

机器学习 · 计算机科学 2023-12-27 Jiangmeng Li , Yifan Jin , Hang Gao , Wenwen Qiang , Changwen Zheng , Fuchun Sun

Integrating supervised contrastive loss to cross entropy-based communication has recently been proposed as a solution to address the long-tail learning problem. However, when the class imbalance ratio is high, it requires adjusting the…

机器学习 · 计算机科学 2024-07-10 Charika De Alvis , Dishanika Denipitiyage , Suranga Seneviratne

Supervised Contrastive Loss (SCL) is popular in visual representation learning. Given an anchor image, SCL pulls two types of positive samples, i.e., its augmentation and other images from the same class together, while pushes negative…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Shiyu Xuan , Shiliang Zhang

Generalized Category Discovery (GCD) tackles the challenging problem of categorizing unlabeled images into both known and novel classes within a partially labeled dataset, without prior knowledge of the number of unknown categories.…

计算机视觉与模式识别 · 计算机科学 2025-07-03 Mingfu Yan , Jiancheng Huang , Yifan Liu , Shifeng Chen

Graph contrastive learning (GCL) has achieved remarkable success by following the computer vision paradigm of preserving absolute similarity between augmented views. However, this approach faces fundamental challenges in graphs due to their…

机器学习 · 计算机科学 2025-05-13 Zhiyuan Ning , Pengfei Wang , Ziyue Qiao , Pengyang Wang , Yuanchun Zhou

Contrastive Learning (CL) enhances the training of sequential recommendation (SR) models through informative self-supervision signals. Existing methods often rely on data augmentation strategies to create positive samples and promote…

信息检索 · 计算机科学 2026-04-06 Zhikai Wang , Yanyan Shen , Zexi Zhang , Li He , Yichun Li , Hao Gu , Yinghua Zhang

Self-Supervised Contrastive Learning has proven effective in deriving high-quality representations from unlabeled data. However, a major challenge that hinders both unimodal and multimodal contrastive learning is feature suppression, a…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Jihai Zhang , Xiang Lan , Xiaoye Qu , Yu Cheng , Mengling Feng , Bryan Hooi

Supervised-contrastive loss (SCL) is an alternative to cross-entropy (CE) for classification tasks that makes use of similarities in the embedding space to allow for richer representations. In this work, we propose methods to engineer the…

机器学习 · 计算机科学 2023-10-03 Jaidev Gill , Vala Vakilian , Christos Thrampoulidis

Contrastive learning (CL) has emerged as a powerful framework for learning representations of images and text in a self-supervised manner while enhancing model robustness against adversarial attacks. More recently, researchers have extended…

机器学习 · 计算机科学 2023-12-04 Filippo Guerranti , Zinuo Yi , Anna Starovoit , Rafiq Kamel , Simon Geisler , Stephan Günnemann

Unsupervised graph representation learning is a non-trivial topic. The success of contrastive methods in the unsupervised representation learning on structured data inspires similar attempts on the graph. Existing graph contrastive learning…

机器学习 · 计算机科学 2024-04-02 Tianyu Zhang , Yuxiang Ren , Wenzheng Feng , Weitao Du , Xuecang Zhang

This paper presents SimCLR: a simple framework for contrastive learning of visual representations. We simplify recently proposed contrastive self-supervised learning algorithms without requiring specialized architectures or a memory bank.…

机器学习 · 计算机科学 2020-07-02 Ting Chen , Simon Kornblith , Mohammad Norouzi , Geoffrey Hinton

We propose Graph Contrastive Learning (GraphCL), a general framework for learning node representations in a self supervised manner. GraphCL learns node embeddings by maximizing the similarity between the representations of two randomly…

机器学习 · 计算机科学 2020-07-17 Hakim Hafidi , Mounir Ghogho , Philippe Ciblat , Ananthram Swami

Supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. Self-supervised learning (SSL), can be used to solve such problems by pre-training a…

计算机视觉与模式识别 · 计算机科学 2022-02-01 Haifeng Li , Yi Li , Guo Zhang , Ruoyun Liu , Haozhe Huang , Qing Zhu , Chao Tao