中文
相关论文

相关论文: Rethinking Graph Transformer Architecture Design f…

200 篇论文

Existing studies have shown that Message-Passing Graph Neural Networks (MPNNs) are highly susceptible to adversarial attacks. In contrast, despite the increasing importance of Graph Transformers (GTs), their robustness properties are…

机器学习 · 计算机科学 2026-04-14 Philipp Foth , Lukas Gosch , Simon Geisler , Leo Schwinn , Stephan Günnemann

Graph neural networks (GNNs) have achieved impressive impressions for graph-related tasks. However, most GNNs are primarily studied under the cases of signal domain with supervised training, which requires abundant task-specific labels and…

机器学习 · 计算机科学 2025-07-16 Jinhui Pang , Zixuan Wang , Jiliang Tang , Mingyan Xiao , Nan Yin

Graph Neural Networks (GNNs) show strong expressive power on graph data mining, by aggregating information from neighbors and using the integrated representation in the downstream tasks. The same aggregation methods and parameters for each…

机器学习 · 计算机科学 2022-03-22 Xiaojun Ma , Qin Chen , Yuanyi Ren , Guojie Song , Liang Wang

Graph convolutional networks (GCNs) enable end-to-end learning on graph structured data. However, many works assume a given graph structure. When the input graph is noisy or unavailable, one approach is to construct or learn a latent graph…

计算机视觉与模式识别 · 计算机科学 2023-07-19 Avishkar Saha , Oscar Mendez , Chris Russell , Richard Bowden

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

机器学习 · 计算机科学 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo

Graph Transformers (GTs) have demonstrated significant advantages in graph representation learning through their global attention mechanisms. However, the self-attention mechanism in GTs tends to neglect the inductive biases inherent in…

机器学习 · 计算机科学 2024-12-04 Lei Yu , Hongyang Chen , Jingsong Lv , Linyao Yang

We explore the node classification task in the context of graph domain adaptation, which uses both source and target graph structures along with source labels to enhance the generalization capabilities of Graph Neural Networks (GNNs) on…

机器学习 · 计算机科学 2025-12-15 Haiyang Yu , Meng-Chieh Lee , Xiang song , Qi Zhu , Christos Faloutsos

Graph Neural Networks (GNNs) and Transformers share significant similarities in their encoding strategies for interacting with features from nodes of interest, where Transformers use query-key scores and GNNs use edges. Compared to GNNs,…

机器学习 · 计算机科学 2025-07-08 Jiaxin Qi , Yan Cui , Jinli Ou , Jianqiang Huang , Gaogang Xie

In representation learning on graph-structured data, many popular graph neural networks (GNNs) fail to capture long-range dependencies, leading to performance degradation. Furthermore, this weakness is magnified when the concerned graph is…

机器学习 · 计算机科学 2024-03-07 Mengying Jiang , Guizhong Liu , Yuanchao Su , Xinliang Wu

While tokenized graph Transformers have demonstrated strong performance in node classification tasks, their reliance on a limited subset of nodes with high similarity scores for constructing token sequences overlooks valuable information…

机器学习 · 计算机科学 2025-02-18 Jinsong Chen , Hanpeng Liu , John E. Hopcroft , Kun He

Graph neural networks (GNNs) have shown remarkable performance on homophilic graph data while being far less impressive when handling non-homophilic graph data due to the inherent low-pass filtering property of GNNs. In general, since…

机器学习 · 计算机科学 2023-10-27 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Youru Li , Yao Zhao

Transformers serve as the backbone architectures of Foundational Models, where domain-specific tokenizers allow them to adapt to various domains. Graph Transformers (GTs) have recently emerged as leading models in geometric deep learning,…

神经与进化计算 · 计算机科学 2025-04-03 Limei Wang , Kaveh Hassani , Si Zhang , Dongqi Fu , Baichuan Yuan , Weilin Cong , Zhigang Hua , Hao Wu , Ning Yao , Bo Long

Graph Transformers (GTs) have demonstrated their advantages across a wide range of tasks. However, the self-attention mechanism in GTs overlooks the graph's inductive biases, particularly biases related to structure, which are crucial for…

机器学习 · 计算机科学 2024-04-25 Chuang Liu , Zelin Yao , Yibing Zhan , Xueqi Ma , Shirui Pan , Wenbin Hu

Cross-network node classification (CNNC), which aims to classify nodes in a label-deficient target network by transferring the knowledge from a source network with abundant labels, draws increasing attention recently. To address CNNC, we…

机器学习 · 计算机科学 2023-10-18 Xiao Shen , Shirui Pan , Kup-Sze Choi , Xi Zhou

Graph Neural Networks (GNNs) are deep learning methods which provide the current state of the art performance in node classification tasks. GNNs often assume homophily -- neighboring nodes having similar features and labels--, and therefore…

机器学习 · 计算机科学 2021-10-26 Liheng Ma , Reihaneh Rabbany , Adriana Romero-Soriano

Graph Neural Networks (GNNs) often struggle with heterophilic data, where connected nodes may have dissimilar labels, as they typically assume homophily and rely on local message passing. To address this, we propose creating alternative…

机器学习 · 计算机科学 2025-06-11 Victor M. Tenorio , Madeline Navarro , Samuel Rey , Santiago Segarra , Antonio G. Marques

Transformers have been designed for channel acquisition tasks such as channel prediction and other tasks such as precoding, while graph neural networks (GNNs) have been demonstrated to be efficient for learning a multitude of communication…

信号处理 · 电气工程与系统科学 2025-03-06 Yuxuan Duan , Jia Guo , Chenyang Yang

Graph Neural Networks (GNNs) have proven to be highly effective for node classification tasks across diverse graph structural patterns. Traditionally, GNNs employ a uniform global filter, typically a low-pass filter for homophilic graphs…

机器学习 · 计算机科学 2024-06-06 Haoyu Han , Juanhui Li , Wei Huang , Xianfeng Tang , Hanqing Lu , Chen Luo , Hui Liu , Jiliang Tang

We show that viewing graphs as sets of node features and incorporating structural and positional information into a transformer architecture is able to outperform representations learned with classical graph neural networks (GNNs). Our…

机器学习 · 计算机科学 2021-06-11 Grégoire Mialon , Dexiong Chen , Margot Selosse , Julien Mairal

Graph neural networks (GNNs) have achieved tremendous success in the task of graph classification and its diverse downstream real-world applications. Despite the huge success in learning graph representations, current GNN models have…

社会与信息网络 · 计算机科学 2023-09-07 Xin Wang , Heng Chang , Beini Xie , Tian Bian , Shiji Zhou , Daixin Wang , Zhiqiang Zhang , Wenwu Zhu