中文
相关论文

相关论文: Global Attention Improves Graph Networks Generaliz…

200 篇论文

Self-attention mechanism in graph neural networks (GNNs) led to state-of-the-art performance on many graph representation learning tasks. Currently, at every layer, attention is computed between connected pairs of nodes and depends solely…

机器学习 · 计算机科学 2021-08-27 Guangtao Wang , Rex Ying , Jing Huang , Jure Leskovec

Recently, text classification model based on graph neural network (GNN) has attracted more and more attention. Most of these models adopt a similar network paradigm, that is, using pre-training node embedding initialization and two-layer…

计算与语言 · 计算机科学 2023-01-26 Jiayuan Chen , Boyu Zhang , Yinfei Xu , Meng Wang

Measuring the generalization performance of a Deep Neural Network (DNN) without relying on a validation set is a difficult task. In this work, we propose exploiting Latent Geometry Graphs (LGGs) to represent the latent spaces of trained DNN…

机器学习 · 计算机科学 2020-11-26 Carlos Lassance , Louis Béthune , Myriam Bontonou , Mounia Hamidouche , Vincent Gripon

Inspired by the notion that ``{\it to copy is easier than to memorize}``, in this work, we introduce GNN-LM, which extends the vanilla neural language model (LM) by allowing to reference similar contexts in the entire training corpus. We…

计算与语言 · 计算机科学 2022-05-05 Yuxian Meng , Shi Zong , Xiaoya Li , Xiaofei Sun , Tianwei Zhang , Fei Wu , Jiwei Li

Graph Neural Networks (GNNs) have been shown to possess strong representation abilities over graph data. However, GNNs are vulnerable to adversarial attacks, and even minor perturbations to the graph structure can significantly degrade…

机器学习 · 计算机科学 2023-09-20 Abdullah Alchihabi , Qing En , Yuhong Guo

Graph Neural Networks (GNNs) have enjoyed wide spread applications in graph-structured data. However, existing graph based applications commonly lack annotated data. GNNs are required to learn latent patterns from a limited amount of…

机器学习 · 计算机科学 2023-03-22 Wenqi Wei , Mu Qiao , Divyesh Jadav

Graph neural networks (GNNs) aim to learn well-trained representations in a lower-dimension space for downstream tasks while preserving the topological structures. In recent years, attention mechanism, which is brilliant in the fields of…

社会与信息网络 · 计算机科学 2026-05-12 Chengcheng Sun , Chenhao Li , Xiang Lin , Tianji Zheng , Fanrong Meng , Xiaobin Rui , Zhixiao Wang

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate…

信息检索 · 计算机科学 2022-01-10 Sai Mitheran , Abhinav Java , Surya Kant Sahu , Arshad Shaikh

Graph Neural Networks (GNNs) have been widely used to learn representations on graphs and tackle many real-world problems from a wide range of domains. In this paper we propose wsGAT, an extension of the Graph Attention Network (GAT)…

社会与信息网络 · 计算机科学 2022-02-01 Marco Grassia , Giuseppe Mangioni

Graph neural networks are powerful architectures for structured datasets. However, current methods struggle to represent long-range dependencies. Scaling the depth or width of GNNs is insufficient to broaden receptive fields as larger GNNs…

机器学习 · 计算机科学 2022-01-24 Zhanghao Wu , Paras Jain , Matthew A. Wright , Azalia Mirhoseini , Joseph E. Gonzalez , Ion Stoica

In recent years, graph neural networks (GNNs) have emerged as a potent tool for learning on graph-structured data and won fruitful successes in varied fields. The majority of GNNs follow the message-passing paradigm, where representations…

机器学习 · 计算机科学 2024-08-30 Yurui Lai , Xiaoyang Lin , Renchi Yang , Hongtao Wang

Graph Neural Networks (GNNs) are an effective framework for representation learning of graphs. GNNs follow a neighborhood aggregation scheme, where the representation vector of a node is computed by recursively aggregating and transforming…

机器学习 · 计算机科学 2019-02-26 Keyulu Xu , Weihua Hu , Jure Leskovec , Stefanie Jegelka

Recent research has highlighted the role of relational inductive biases in building learning agents that can generalize and reason in a compositional manner. However, while relational learning algorithms such as graph neural networks (GNNs)…

机器学习 · 计算机科学 2020-03-17 Koustuv Sinha , Shagun Sodhani , Joelle Pineau , William L. Hamilton

Graph neural networks (GNNs) have been popularly used in analyzing graph-structured data, showing promising results in various applications such as node classification, link prediction and network recommendation. In this paper, we present a…

机器学习 · 计算机科学 2021-08-11 Qinkai Zheng , Houyi Li , Peng Zhang , Zhixiong Yang , Guowei Zhang , Xintan Zeng , Yongchao Liu

Recent advances in neural algorithmic reasoning with graph neural networks (GNNs) are propped up by the notion of algorithmic alignment. Broadly, a neural network will be better at learning to execute a reasoning task (in terms of sample…

机器学习 · 计算机科学 2022-10-12 Andrew Dudzik , Petar Veličković

Graph Neural Networks (GNNs) have been highly successful for the node classification task. GNNs typically assume graphs are homophilic, i.e. neighboring nodes are likely to belong to the same class. However, a number of real-world graphs…

机器学习 · 计算机科学 2024-09-20 Yurui Lai , Taiyan Zhang , Rui Fan

Graph neural networks (GNNs) are vulnerable to adversarial attacks, especially for topology perturbations, and many methods that improve the robustness of GNNs have received considerable attention. Recently, we have witnessed the…

机器学习 · 计算机科学 2024-12-25 Zhongjian Zhang , Xiao Wang , Huichi Zhou , Yue Yu , Mengmei Zhang , Cheng Yang , Chuan Shi

Subgraph representation learning based on Graph Neural Network (GNN) has exhibited broad applications in scientific advancements, such as predictions of molecular structure-property relationships and collective cellular function. In…

机器学习 · 计算机科学 2022-10-17 Yili Shen , Xiao Liu , Cheng-Wei Ju , Jiaxu Yan , Jun Yi , Zhou Lin , Hui Guan

We present an attention-based spatial graph convolution (AGC) for graph neural networks (GNNs). Existing AGCs focus on only using node-wise features and utilizing one type of attention function when calculating attention weights. Instead,…

计算机视觉与模式识别 · 计算机科学 2023-03-06 Yang Li , Yuichi Tanaka

In recent years, deep learning has achieved remarkable success in the field of image restoration. However, most convolutional neural network-based methods typically focus on a single scale, neglecting the incorporation of multi-scale…

图像与视频处理 · 电气工程与系统科学 2025-02-27 Jiatao Jiang , Zhen Cui , Chunyan Xu , Jian Yang