English
Related papers

Related papers: Mitigating Degree Biases in Message Passing Mechan…

200 papers

Social and information networks are gaining huge popularity recently due to their various applications. Knowledge representation through graphs in the form of nodes and edges should preserve as many characteristics of the original data as…

Machine Learning · Computer Science 2021-02-08 Rucha Bhalchandra Joshi , Subhankar Mishra

Graph neural networks (GNNs) learn to represent nodes by aggregating information from their neighbors. As GNNs increase in depth, their receptive field grows exponentially, leading to high memory costs. Several existing methods address this…

Machine Learning · Computer Science 2025-07-16 Taraneh Younesian , Daniel Daza , Emile van Krieken , Thiviyan Thanapalasingam , Peter Bloem

The Transformer architecture has gained growing attention in graph representation learning recently, as it naturally overcomes several limitations of graph neural networks (GNNs) by avoiding their strict structural inductive biases and…

Machine Learning · Statistics 2022-06-14 Dexiong Chen , Leslie O'Bray , Karsten Borgwardt

Graphs are widely used to model relational data. As graphs are getting larger and larger in real-world scenarios, there is a trend to store and compute subgraphs in multiple local systems. For example, recently proposed \emph{subgraph…

Machine Learning · Computer Science 2024-01-30 Zaixi Zhang , Qingyong Hu , Yang Yu , Weibo Gao , Qi Liu

Mini-batch Graph Transformer (MGT), as an emerging graph learning model, has demonstrated significant advantages in semi-supervised node prediction tasks with improved computational efficiency and enhanced model robustness. However,…

Machine Learning · Computer Science 2024-07-16 Wenda Li , Kaixuan Chen , Shunyu Liu , Tongya Zheng , Wenjie Huang , Mingli Song

Pre-trained graph neural networks (GNNs) transfer well, but adapting them to downstream tasks remains challenging due to mismatches between pre-training objectives and task requirements. Graph prompt tuning offers a parameter-efficient…

Machine Learning · Computer Science 2026-02-06 Long D. Nguyen , Binh P. Nguyen

Graph foundation models represent a transformative paradigm for learning transferable representations across diverse graph domains. Recent methods leverage large language models to unify graph and text modalities into a shared…

Machine Learning · Computer Science 2025-12-23 Heng Zhang , Tianyi Zhang , Yuling Shi , Xiaodong Gu , Yaomin Shen , Haochen You , Zijian Zhang , Yilei Yuan , Jin Huang

Graph Neural Networks (GNNs) have been successful in modeling graph-structured data. However, similar to other machine learning models, GNNs can exhibit bias in predictions based on attributes like race and gender. Moreover, bias in GNNs…

Machine Learning · Computer Science 2025-08-21 Zengyi Wo , Chang Liu , Yumeng Wang , Minglai Shao , Wenjun Wang

Graph neural networks (GNNs) have been widely adopted in engineering applications such as social network analysis, chemical research and computer vision. However, their efficacy is severely compromised by the inherent homophily assumption,…

Machine Learning · Computer Science 2026-04-13 Yi Luo , Xu Sun , Guangchun Luo , Aiguo Chen

Graph Transformers (GTs) have significantly advanced the field of graph representation learning by overcoming the limitations of message-passing graph neural networks (GNNs) and demonstrating promising performance and expressive power.…

Machine Learning · Computer Science 2024-05-07 Wenhao Zhu , Guojie Song , Liang Wang , Shaoguo Liu

Graph Transformers (GTs) have demonstrated their advantages across a wide range of tasks. However, the self-attention mechanism in GTs overlooks the graph's inductive biases, particularly biases related to structure, which are crucial for…

Machine Learning · Computer Science 2024-04-25 Chuang Liu , Zelin Yao , Yibing Zhan , Xueqi Ma , Shirui Pan , Wenbin Hu

Node tokenized graph Transformers (GTs) have shown promising performance in node classification. The generation of token sequences is the key module in existing tokenized GTs which transforms the input graph into token sequences,…

Machine Learning · Computer Science 2025-02-13 Jinsong Chen , Chenyang Li , GaiChao Li , John E. Hopcroft , Kun He

Heterogeneous graph learning aims to capture complex relationships and diverse relational semantics among entities in a heterogeneous graph to obtain meaningful representations for nodes and edges. Recent advancements in heterogeneous graph…

Computation and Language · Computer Science 2024-05-21 Jiabin Tang , Yuhao Yang , Wei Wei , Lei Shi , Long Xia , Dawei Yin , Chao Huang

Graph neural networks (GNNs) have been shown promising in improving the efficiency of learning communication policies by leveraging their permutation properties. Nonetheless, existing works design GNNs only for specific wireless policies,…

Signal Processing · Electrical Eng. & Systems 2023-08-22 Shengjie Liu , Jia Guo , Chenyang Yang

Graph neural networks are powerful architectures for structured datasets. However, current methods struggle to represent long-range dependencies. Scaling the depth or width of GNNs is insufficient to broaden receptive fields as larger GNNs…

Machine Learning · Computer Science 2022-01-24 Zhanghao Wu , Paras Jain , Matthew A. Wright , Azalia Mirhoseini , Joseph E. Gonzalez , Ion Stoica

As the field of Graph Neural Networks (GNN) continues to grow, it experiences a corresponding increase in the need for large, real-world datasets to train and test new GNN models on challenging, realistic problems. Unfortunately, such graph…

Machine Learning · Computer Science 2023-06-12 Minji Yoon , Yue Wu , John Palowitch , Bryan Perozzi , Ruslan Salakhutdinov

Nuclei classification is a critical step in computer-aided diagnosis with histopathology images. In the past, various methods have employed graph neural networks (GNN) to analyze cell graphs that model inter-cell relationships by…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Wei Lou , Guanbin Li , Xiang Wan , Haofeng Li

Message passing plays a vital role in graph neural networks (GNNs) for effective feature learning. However, the over-reliance on input topology diminishes the efficacy of message passing and restricts the ability of GNNs. Despite efforts to…

Machine Learning · Computer Science 2024-12-03 Junshu Sun , Chenxue Yang , Xiangyang Ji , Qingming Huang , Shuhui Wang

Conventional graph neural networks (GNNs) are often confronted with fairness issues that may stem from their input, including node attributes and neighbors surrounding a node. While several recent approaches have been proposed to eliminate…

Machine Learning · Computer Science 2023-02-21 Zemin Liu , Trung-Kien Nguyen , Yuan Fang

We propose Graph Tree Networks (GTNets), a deep graph learning architecture with a new general message passing scheme that originates from the tree representation of graphs. In the tree representation, messages propagate upward from the…

Machine Learning · Computer Science 2022-04-28 Nan Wu , Chaofan Wang