English
Related papers

Related papers: DHIL-GT: Scalable Graph Transformer with Decoupled…

200 papers

Graph Transformers (GTs) have significantly advanced the field of graph representation learning by overcoming the limitations of message-passing graph neural networks (GNNs) and demonstrating promising performance and expressive power.…

Machine Learning · Computer Science 2024-05-07 Wenhao Zhu , Guojie Song , Liang Wang , Shaoguo Liu

Graph Convolutional Networks (GCNs) are extensively utilized for deep learning on graphs. The large data sizes of graphs and their vertex features make scalable training algorithms and distributed memory systems necessary. Since the…

Machine Learning · Computer Science 2022-12-14 Gunduz Vehbi Demirci , Aparajita Haldar , Hakan Ferhatosmanoglu

Graph transformers need strong inductive biases to derive meaningful attention scores. Yet, current methods often fall short in capturing longer ranges, hierarchical structures, or community structures, which are common in various graphs…

Machine Learning · Computer Science 2024-05-28 Yuankai Luo , Hongkang Li , Lei Shi , Xiao-Ming Wu

Graph Neural Networks (GNNs) are powerful tools for processing relational data but often struggle to generalize to unseen graphs, giving rise to the development of Graph Foundational Models (GFMs). However, current GFMs are challenged by…

Machine Learning · Computer Science 2026-05-25 Weishuo Ma , Yanbo Wang , Xiyuan Wang , Lei Zou , Muhan Zhang

Graph Neural Networks (GNNs) have evolved to understand graph structures through recursive exchanges and aggregations among nodes. To enhance robustness, self-supervised learning (SSL) has become a vital tool for data augmentation.…

Computation and Language · Computer Science 2024-05-08 Jiabin Tang , Yuhao Yang , Wei Wei , Lei Shi , Lixin Su , Suqi Cheng , Dawei Yin , Chao Huang

This paper presents a general graph representation learning framework called DeepGL for learning deep node and edge representations from large (attributed) graphs. In particular, DeepGL begins by deriving a set of base features (e.g.,…

Machine Learning · Statistics 2017-10-17 Ryan A. Rossi , Rong Zhou , Nesreen K. Ahmed

Graph-based Active Learning (AL) leverages the structure of graphs to efficiently prioritize label queries, reducing labeling costs and user burden in applications like health monitoring, human behavior analysis, and sensor networks. By…

Machine Learning · Computer Science 2025-06-13 Maryam Khalid , Akane Sano

In this paper, we study semi-supervised graph classification, which aims at accurately predicting the categories of graphs in scenarios with limited labeled graphs and abundant unlabeled graphs. Despite the promising capability of graph…

Machine Learning · Computer Science 2024-05-29 Wei Ju , Zhengyang Mao , Siyu Yi , Yifang Qin , Yiyang Gu , Zhiping Xiao , Yifan Wang , Xiao Luo , Ming Zhang

Transformers serve as the backbone architectures of Foundational Models, where domain-specific tokenizers allow them to adapt to various domains. Graph Transformers (GTs) have recently emerged as leading models in geometric deep learning,…

Neural and Evolutionary Computing · Computer Science 2025-04-03 Limei Wang , Kaveh Hassani , Si Zhang , Dongqi Fu , Baichuan Yuan , Weilin Cong , Zhigang Hua , Hao Wu , Ning Yao , Bo Long

Graph Transformers (GTs) have recently demonstrated remarkable performance across diverse domains. By leveraging attention mechanisms, GTs are capable of modeling long-range dependencies and complex structural relationships beyond local…

Machine Learning · Computer Science 2025-06-06 Jiachen Tang , Zhonghao Wang , Sirui Chen , Sheng Zhou , Jiawei Chen , Jiajun Bu

Graph Transformers (GTs) have demonstrated great effectiveness across various graph analytical tasks. However, the existing GTs focus on training and testing graph data originated from the same distribution, but fail to generalize under…

Machine Learning · Computer Science 2026-03-16 Tianyin Liao , Ziwei Zhang , Yufei Sun , Chunyu Hu , Jianxin Li

Graph self-training (GST), which selects and assigns pseudo-labels to unlabeled nodes, is popular for tackling label sparsity in graphs. However, recent study on homophily graphs show that GST methods could introduce and amplify…

Social and Information Networks · Computer Science 2024-07-26 Fali Wang , Tianxiang Zhao , Junjie Xu , Suhang Wang

Graph Neural Networks (GNN) have shown a strong potential to be integrated into commercial products for network control and management. Early works using GNN have demonstrated an unprecedented capability to learn from different network…

Networking and Internet Architecture · Computer Science 2021-10-05 Miquel Ferriol-Galmés , José Suárez-Varela , Krzysztof Rusek , Pere Barlet-Ros , Albert Cabellos-Aparicio

Many widely used datasets for graph machine learning tasks have generally been homophilous, where nodes with similar labels connect to each other. Recently, new Graph Neural Networks (GNNs) have been developed that move beyond the homophily…

Machine Learning · Computer Science 2021-10-28 Derek Lim , Felix Hohne , Xiuyu Li , Sijia Linda Huang , Vaishnavi Gupta , Omkar Bhalerao , Ser-Nam Lim

Graph-based computations are crucial in a wide range of applications, where graphs can scale to trillions of edges. To enable efficient training on such large graphs, mini-batch subgraph sampling is commonly used, which allows training…

Machine Learning · Computer Science 2025-04-04 Yue Jin , Yongchao Liu , Chuntao Hong

Graph convolutional networks (GCNs) have emerged as dominant methods for skeleton-based action recognition. However, they still suffer from two problems, namely, neighborhood constraints and entangled spatiotemporal feature representations.…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Ruwen Bai , Min Li , Bo Meng , Fengfa Li , Miao Jiang , Junxing Ren , Degang Sun

Graph classification aims to extract accurate information from graph-structured data for classification and is becoming more and more important in graph learning community. Although Graph Neural Networks (GNNs) have been successfully…

Machine Learning · Computer Science 2020-06-24 Ning Ma , Jiajun Bu , Jieyu Yang , Zhen Zhang , Chengwei Yao , Zhi Yu , Sheng Zhou , Xifeng Yan

The design of Graph Transformers (GTs) generally neglects considerations for fairness, resulting in biased outcomes against certain sensitive subgroups. Since GTs encode graph information without relying on message-passing mechanisms,…

Machine Learning · Computer Science 2024-04-29 Renqiang Luo , Huafei Huang , Shuo Yu , Xiuzhen Zhang , Feng Xia

Graph neural networks (GNNs) have emerged as a powerful tool for modeling graph-structured data. However, existing GNNs often struggle with heterophilic graphs, where connected nodes tend to have dissimilar features or labels. While…

Machine Learning · Computer Science 2026-02-10 Ruizhong Qiu , Ting-Wei Li , Gaotang Li , Hanghang Tong

Graph neural networks (GNNs) have emerged as a powerful tool for modeling graph-structured data. However, existing GNNs often struggle with heterophilic graphs, where connected nodes tend to have dissimilar features or labels. While…

Machine Learning · Computer Science 2025-09-17 Ruizhong Qiu , Ting-Wei Li , Gaotang Li , Hanghang Tong