English
Related papers

Related papers: Rethinking Graph Transformer Architecture Design f…

200 papers

Existing studies have shown that Message-Passing Graph Neural Networks (MPNNs) are highly susceptible to adversarial attacks. In contrast, despite the increasing importance of Graph Transformers (GTs), their robustness properties are…

Machine Learning · Computer Science 2026-04-14 Philipp Foth , Lukas Gosch , Simon Geisler , Leo Schwinn , Stephan Günnemann

Graph neural networks (GNNs) have achieved impressive impressions for graph-related tasks. However, most GNNs are primarily studied under the cases of signal domain with supervised training, which requires abundant task-specific labels and…

Machine Learning · Computer Science 2025-07-16 Jinhui Pang , Zixuan Wang , Jiliang Tang , Mingyan Xiao , Nan Yin

Graph Neural Networks (GNNs) show strong expressive power on graph data mining, by aggregating information from neighbors and using the integrated representation in the downstream tasks. The same aggregation methods and parameters for each…

Machine Learning · Computer Science 2022-03-22 Xiaojun Ma , Qin Chen , Yuanyi Ren , Guojie Song , Liang Wang

Graph convolutional networks (GCNs) enable end-to-end learning on graph structured data. However, many works assume a given graph structure. When the input graph is noisy or unavailable, one approach is to construct or learn a latent graph…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Avishkar Saha , Oscar Mendez , Chris Russell , Richard Bowden

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

Machine Learning · Computer Science 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo

Graph Transformers (GTs) have demonstrated significant advantages in graph representation learning through their global attention mechanisms. However, the self-attention mechanism in GTs tends to neglect the inductive biases inherent in…

Machine Learning · Computer Science 2024-12-04 Lei Yu , Hongyang Chen , Jingsong Lv , Linyao Yang

We explore the node classification task in the context of graph domain adaptation, which uses both source and target graph structures along with source labels to enhance the generalization capabilities of Graph Neural Networks (GNNs) on…

Machine Learning · Computer Science 2025-12-15 Haiyang Yu , Meng-Chieh Lee , Xiang song , Qi Zhu , Christos Faloutsos

Graph Neural Networks (GNNs) and Transformers share significant similarities in their encoding strategies for interacting with features from nodes of interest, where Transformers use query-key scores and GNNs use edges. Compared to GNNs,…

Machine Learning · Computer Science 2025-07-08 Jiaxin Qi , Yan Cui , Jinli Ou , Jianqiang Huang , Gaogang Xie

In representation learning on graph-structured data, many popular graph neural networks (GNNs) fail to capture long-range dependencies, leading to performance degradation. Furthermore, this weakness is magnified when the concerned graph is…

Machine Learning · Computer Science 2024-03-07 Mengying Jiang , Guizhong Liu , Yuanchao Su , Xinliang Wu

While tokenized graph Transformers have demonstrated strong performance in node classification tasks, their reliance on a limited subset of nodes with high similarity scores for constructing token sequences overlooks valuable information…

Machine Learning · Computer Science 2025-02-18 Jinsong Chen , Hanpeng Liu , John E. Hopcroft , Kun He

Graph neural networks (GNNs) have shown remarkable performance on homophilic graph data while being far less impressive when handling non-homophilic graph data due to the inherent low-pass filtering property of GNNs. In general, since…

Machine Learning · Computer Science 2023-10-27 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Youru Li , Yao Zhao

Transformers serve as the backbone architectures of Foundational Models, where domain-specific tokenizers allow them to adapt to various domains. Graph Transformers (GTs) have recently emerged as leading models in geometric deep learning,…

Neural and Evolutionary Computing · Computer Science 2025-04-03 Limei Wang , Kaveh Hassani , Si Zhang , Dongqi Fu , Baichuan Yuan , Weilin Cong , Zhigang Hua , Hao Wu , Ning Yao , Bo Long

Graph Transformers (GTs) have demonstrated their advantages across a wide range of tasks. However, the self-attention mechanism in GTs overlooks the graph's inductive biases, particularly biases related to structure, which are crucial for…

Machine Learning · Computer Science 2024-04-25 Chuang Liu , Zelin Yao , Yibing Zhan , Xueqi Ma , Shirui Pan , Wenbin Hu

Cross-network node classification (CNNC), which aims to classify nodes in a label-deficient target network by transferring the knowledge from a source network with abundant labels, draws increasing attention recently. To address CNNC, we…

Machine Learning · Computer Science 2023-10-18 Xiao Shen , Shirui Pan , Kup-Sze Choi , Xi Zhou

Graph Neural Networks (GNNs) are deep learning methods which provide the current state of the art performance in node classification tasks. GNNs often assume homophily -- neighboring nodes having similar features and labels--, and therefore…

Machine Learning · Computer Science 2021-10-26 Liheng Ma , Reihaneh Rabbany , Adriana Romero-Soriano

Graph Neural Networks (GNNs) often struggle with heterophilic data, where connected nodes may have dissimilar labels, as they typically assume homophily and rely on local message passing. To address this, we propose creating alternative…

Machine Learning · Computer Science 2025-06-11 Victor M. Tenorio , Madeline Navarro , Samuel Rey , Santiago Segarra , Antonio G. Marques

Transformers have been designed for channel acquisition tasks such as channel prediction and other tasks such as precoding, while graph neural networks (GNNs) have been demonstrated to be efficient for learning a multitude of communication…

Signal Processing · Electrical Eng. & Systems 2025-03-06 Yuxuan Duan , Jia Guo , Chenyang Yang

Graph Neural Networks (GNNs) have proven to be highly effective for node classification tasks across diverse graph structural patterns. Traditionally, GNNs employ a uniform global filter, typically a low-pass filter for homophilic graphs…

Machine Learning · Computer Science 2024-06-06 Haoyu Han , Juanhui Li , Wei Huang , Xianfeng Tang , Hanqing Lu , Chen Luo , Hui Liu , Jiliang Tang

We show that viewing graphs as sets of node features and incorporating structural and positional information into a transformer architecture is able to outperform representations learned with classical graph neural networks (GNNs). Our…

Machine Learning · Computer Science 2021-06-11 Grégoire Mialon , Dexiong Chen , Margot Selosse , Julien Mairal

Graph neural networks (GNNs) have achieved tremendous success in the task of graph classification and its diverse downstream real-world applications. Despite the huge success in learning graph representations, current GNN models have…

Social and Information Networks · Computer Science 2023-09-07 Xin Wang , Heng Chang , Beini Xie , Tian Bian , Shiji Zhou , Daixin Wang , Zhiqiang Zhang , Wenwu Zhu
‹ Prev 1 3 4 5 6 7 10 Next ›