中文
相关论文

相关论文: Probing Negative Sampling Strategies to Learn Grap…

200 篇论文

Ensuring validation for highly automated driving poses significant obstacles to the widespread adoption of highly automated vehicles. Scenario-based testing offers a potential solution by reducing the homologation effort required for these…

机器学习 · 计算机科学 2023-09-19 Maximilian Zipfl , Moritz Jarosch , J. Marius Zöllner

Self-supervised graph representation learning has recently shown considerable promise in a range of fields, including bioinformatics and social networks. A large number of graph contrastive learning approaches have shown promising…

机器学习 · 计算机科学 2024-01-30 Wei Ju , Yiyang Gu , Zhengyang Mao , Ziyue Qiao , Yifang Qin , Xiao Luo , Hui Xiong , Ming Zhang

Self-supervised representation learning can mitigate the limitations in recognition tasks with few manually labeled data but abundant unlabeled data---a common scenario in sound event research. In this work, we explore unsupervised…

声音 · 计算机科学 2020-11-17 Eduardo Fonseca , Diego Ortego , Kevin McGuinness , Noel E. O'Connor , Xavier Serra

Graph-based models and contrastive learning have emerged as prominent methods in Collaborative Filtering (CF). While many existing models in CF incorporate these methods in their design, there seems to be a limited depth of analysis…

信息检索 · 计算机科学 2024-06-24 Yihong Wu , Le Zhang , Fengran Mo , Tianyu Zhu , Weizhi Ma , Jian-Yun Nie

Contrastive learning has emerged as a premier method for learning representations with or without supervision. Recent studies have shown its utility in graph representation learning for pre-training. Despite successes, the understanding of…

机器学习 · 计算机科学 2023-02-07 Amur Ghose , Yingxue Zhang , Jianye Hao , Mark Coates

Unsupervised representation learning has recently received lots of interest due to its powerful generalizability through effectively leveraging large-scale unlabeled data. There are two prevalent approaches for this, contrastive learning…

机器学习 · 计算机科学 2021-06-14 Saehoon Kim , Sungwoong Kim , Juho Lee

This paper studies the problem of class-imbalanced graph classification, which aims at effectively classifying the graph categories in scenarios with imbalanced class distributions. While graph neural networks (GNNs) have achieved…

机器学习 · 计算机科学 2024-12-31 Wei Ju , Zhengyang Mao , Siyu Yi , Yifang Qin , Yiyang Gu , Zhiping Xiao , Jianhao Shen , Ziyue Qiao , Ming Zhang

Learning by contrasting positive and negative samples is a general strategy adopted by many methods. Noise contrastive estimation (NCE) for word embeddings and translating embeddings for knowledge graphs are examples in NLP employing this…

计算与语言 · 计算机科学 2018-08-06 Avishek Joey Bose , Huan Ling , Yanshuai Cao

Contrastive representation learning has gained much attention due to its superior performance in learning representations from both image and sequential data. However, the learned representations could potentially lead to performance…

计算与语言 · 计算机科学 2022-11-01 Jianfeng Chi , William Shand , Yaodong Yu , Kai-Wei Chang , Han Zhao , Yuan Tian

While tokenized graph Transformers have demonstrated strong performance in node classification tasks, their reliance on a limited subset of nodes with high similarity scores for constructing token sequences overlooks valuable information…

机器学习 · 计算机科学 2025-02-18 Jinsong Chen , Hanpeng Liu , John E. Hopcroft , Kun He

Contrastive learning is a popular form of self-supervised learning that encourages augmentations (views) of the same input to have more similar representations compared to augmentations of different inputs. Recent attempts to theoretically…

A main challenge in mining network-based data is finding effective ways to represent or encode graph structures so that it can be efficiently exploited by machine learning algorithms. Several methods have focused in network representation…

社会与信息网络 · 计算机科学 2019-03-18 Leonardo Gutiérrez-Gómez , Jean-Charles Delvenne

Graph Contrastive Learning (GCL) has recently drawn much research interest for learning generalizable node representations in a self-supervised manner. In general, the contrastive learning process in GCL is performed on top of the…

机器学习 · 计算机科学 2022-12-06 Kaize Ding , Yancheng Wang , Yingzhen Yang , Huan Liu

Graph Contrastive Learning (GCL) has proven highly effective in promoting the performance of Semi-Supervised Node Classification (SSNC). However, existing GCL methods are generally transferred from other fields like CV or NLP, whose…

机器学习 · 计算机科学 2022-04-28 Deli Chen , Yankai Lin , Lei Li , Xuancheng Ren , Peng Li , Jie Zhou , Xu Sun

Tremendous progress has been made in visual representation learning, notably with the recent success of self-supervised contrastive learning methods. Supervised contrastive learning has also been shown to outperform its cross-entropy…

计算机视觉与模式识别 · 计算机科学 2021-08-17 Ashraful Islam , Chun-Fu Chen , Rameswar Panda , Leonid Karlinsky , Richard Radke , Rogerio Feris

Understanding self-supervised learning is important but challenging. Previous theoretical works study the role of pretraining losses, and view neural networks as general black boxes. However, the recent work of Saunshi et al. argues that…

机器学习 · 计算机科学 2023-04-11 Jeff Z. HaoChen , Tengyu Ma

The standard approach to contrastive learning is to maximize the agreement between different views of the data. The views are ordered in pairs, such that they are either positive, encoding different views of the same object, or negative,…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Artem Moskalev , Ivan Sosnovik , Volker Fischer , Arnold Smeulders

(Very early draft)Traditional supervised learning keeps pushing convolution neural network(CNN) achieving state-of-art performance. However, lack of large-scale annotation data is always a big problem due to the high cost of it, even…

计算机视觉与模式识别 · 计算机科学 2019-11-26 Zhibo Wang , Shen Yan , Xiaoyu Zhang , Niels Lobo

The success of most advanced facial expression recognition works relies heavily on large-scale annotated datasets. However, it poses great challenges in acquiring clean and consistent annotations for facial expression datasets. On the other…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Yuxuan Shu , Xiao Gu , Guang-Zhong Yang , Benny Lo

Self-supervised representation learning has made significant leaps fueled by progress in contrastive learning, which seeks to learn transformations that embed positive input pairs nearby, while pushing negative pairs far apart. While…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Tri Huynh , Simon Kornblith , Matthew R. Walter , Michael Maire , Maryam Khademi