中文
相关论文

相关论文: Rethinking Spectral Augmentation for Contrast-base…

200 篇论文

Self-supervised learning (SSL) has been extensively explored in recent years. Particularly, generative SSL has seen emerging success in natural language processing and other AI fields, such as the wide adoption of BERT and GPT. Despite…

机器学习 · 计算机科学 2022-07-14 Zhenyu Hou , Xiao Liu , Yukuo Cen , Yuxiao Dong , Hongxia Yang , Chunjie Wang , Jie Tang

Recent research has revealed that Graph Neural Networks (GNNs) are susceptible to adversarial attacks targeting the graph structure. A malicious attacker can manipulate a limited number of edges, given the training labels, to impair the…

机器学习 · 计算机科学 2023-03-30 Zihan Liu , Ge Wang , Yun Luo , Stan Z. Li

We introduce a novel masked graph autoencoder (MGAE) framework to perform effective learning on graph structure data. Taking insights from self-supervised learning, we randomly mask a large proportion of edges and try to reconstruct these…

机器学习 · 计算机科学 2022-01-10 Qiaoyu Tan , Ninghao Liu , Xiao Huang , Rui Chen , Soo-Hyun Choi , Xia Hu

In graph learning, maps between graphs and their subgraphs frequently arise. For instance, when coarsening or rewiring operations are present along the pipeline, one needs to keep track of the corresponding nodes between the original and…

机器学习 · 计算机科学 2023-02-01 Marco Pegoraro , Riccardo Marin , Arianna Rampini , Simone Melzi , Luca Cosmo , Emanuele Rodolà

Recently, self-supervised contrastive learning has achieved great success on various tasks. However, its underlying working mechanism is yet unclear. In this paper, we first provide the tightest bounds based on the widely adopted assumption…

机器学习 · 计算机科学 2025-11-06 Qi Zhang , Yifei Wang , Yisen Wang

Cross-graph node classification, utilizing the abundant labeled nodes from one graph to help classify unlabeled nodes in another graph, can be viewed as a domain generalization problem of graph neural networks (GNNs) due to the structure…

机器学习 · 计算机科学 2025-02-26 Guanzi Chen , Jiying Zhang , Yang Li

Graph contrastive learning (GCL) has emerged as a representative graph self-supervised method, achieving significant success. The currently prevalent optimization objective for GCL is InfoNCE. Typically, it employs augmentation techniques…

机器学习 · 计算机科学 2024-03-22 Yulan Hu , Sheng Ouyang , Jingyu Liu , Ge Chen , Zhirui Yang , Junchen Wan , Fuzheng Zhang , Zhongyuan Wang , Yong Liu

Graph neural network (GNN) has been demonstrated powerful in modeling graph-structured data. However, despite many successful cases of applying GNNs to various graph classification and prediction tasks, whether the graph geometrical…

机器学习 · 计算机科学 2023-07-20 Dai Shi , Yi Guo , Zhiqi Shao , Junbin Gao

In recent years, Graph Neural Networks (GNNs) have made significant advancements, particularly in tasks such as node classification, link prediction, and graph representation. However, challenges arise from biases that can be hidden not…

机器学习 · 计算机科学 2024-04-10 Mahdi Tavassoli Kejani , Fadi Dornaika , Jean-Michel Loubes

Graph Neural Networks (GNNs) have been widely applied in the semi-supervised node classification task, where a key point lies in how to sufficiently leverage the limited but valuable label information. Most of the classical GNNs solely use…

机器学习 · 计算机科学 2022-12-26 Le Yu , Leilei Sun , Bowen Du , Tongyu Zhu , Weifeng Lv

This work studies self-supervised graph learning for text-attributed graphs (TAGs) where nodes are represented by textual attributes. Unlike traditional graph contrastive methods that perturb the numerical feature space and alter the…

机器学习 · 计算机科学 2024-06-19 Yi Fang , Dongzhe Fan , Daochen Zha , Qiaoyu Tan

Graph-level anomaly detection has become a critical topic in diverse areas, such as financial fraud detection and detecting anomalous activities in social networks. While most research has focused on anomaly detection for visual data such…

机器学习 · 计算机科学 2022-08-05 Chen Qiu , Marius Kloft , Stephan Mandt , Maja Rudolph

In recent years, spectral graph neural networks, characterized by polynomial filters, have garnered increasing attention and have achieved remarkable performance in tasks such as node classification. These models typically assume that…

机器学习 · 计算机科学 2025-02-25 Kangkang Lu , Yanhua Yu , Hao Fei , Xuan Li , Zixuan Yang , Zirui Guo , Meiyu Liang , Mengran Yin , Tat-Seng Chua

The results of training a neural network are heavily dependent on the architecture chosen; and even a modification of only its size, however small, typically involves restarting the training process. In contrast to this, we begin training…

机器学习 · 计算机科学 2024-02-12 Rupert Mitchell , Robin Menzenbach , Kristian Kersting , Martin Mundt

Graph neural networks, a powerful deep learning tool to model graph-structured data, have demonstrated remarkable performance on numerous graph learning tasks. To address the data noise and data scarcity issues in deep graph learning, the…

机器学习 · 计算机科学 2022-11-22 Kaize Ding , Zhe Xu , Hanghang Tong , Huan Liu

Graph representation learning has attracted a surge of interest recently, whose target at learning discriminant embedding for each node in the graph. Most of these representation methods focus on supervised learning and heavily depend on…

机器学习 · 计算机科学 2021-07-07 Pengpeng Shao , Tong Liu , Dawei Zhang , Jianhua Tao , Feihu Che , Guohua Yang

Variants of Graph Neural Networks (GNNs) for representation learning have been proposed recently and achieved fruitful results in various fields. Among them, Graph Attention Network (GAT) first employs a self-attention strategy to learn…

机器学习 · 计算机科学 2021-07-28 Heng Chang , Yu Rong , Tingyang Xu , Wenbing Huang , Somayeh Sojoudi , Junzhou Huang , Wenwu Zhu

Many improvements on GNNs can be deemed as operations on the spectrum of the underlying graph matrix, which motivates us to directly study the characteristics of the spectrum and their effects on GNN performance. By generalizing most…

机器学习 · 计算机科学 2022-06-22 Mingqi Yang , Yanming Shen , Rui Li , Heng Qi , Qiang Zhang , Baocai Yin

Contrastive learning enables learning useful audio and speech representations without ground-truth labels by maximizing the similarity between latent representations of similar signal segments. In this framework various data augmentation…

音频与语音处理 · 电气工程与系统科学 2022-04-11 Salah Zaiem , Titouan Parcollet , Slim Essid

Learning point clouds is challenging due to the lack of connectivity information, i.e., edges. Although existing edge-aware methods can improve the performance by modeling edges, how edges contribute to the improvement is unclear. In this…

计算机视觉与模式识别 · 计算机科学 2022-07-05 Haoyi Xiu , Xin Liu , Weimin Wang , Kyoung-Sook Kim , Takayuki Shinohara , Qiong Chang , Masashi Matsuoka