English
Related papers

Related papers: Language Models as Messengers: Enhancing Message P…

200 papers

Real-world heterogeneous graphs are inherently noisy and usually not in the optimal graph structures for downstream tasks, which often adversely affects the performance of GRL models in downstream tasks. Although Graph Structure Learning…

Machine Learning · Computer Science 2026-04-08 He Zhao , Zhiwei Zeng , Yongwei Wang , Chunyan Miao

Heterogeneous graph neural networks (HGNNs) have powerful capability to embed rich structural and semantic information of a heterogeneous graph into node representations. Existing HGNNs inherit many mechanisms from graph neural networks…

Machine Learning · Computer Science 2023-09-04 Xiaocheng Yang , Mingyu Yan , Shirui Pan , Xiaochun Ye , Dongrui Fan

Message passing has evolved as an effective tool for designing Graph Neural Networks (GNNs). However, most existing methods for message passing simply sum or average all the neighboring features to update node representations. They are…

Machine Learning · Computer Science 2022-06-17 Rui Yang , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong

Message passing is a fundamental procedure for graph neural networks in the field of graph representation learning. Based on the homophily assumption, the current message passing always aggregates features of connected nodes, such as the…

Machine Learning · Computer Science 2022-02-02 Jie Chen , Weiqi Liu , Jian Pu

Heterogeneous Graph Neural Networks (HGNNs) are powerful tools for deep learning on heterogeneous graphs. Typical HGNNs require repetitive message passing during training, limiting efficiency for large-scale real-world graphs. Recent…

Machine Learning · Computer Science 2024-09-04 Jun Hu , Bryan Hooi , Bingsheng He

The message-passing mechanism underlying Graph Neural Networks (GNNs) is not naturally suited for heterophilic datasets, where adjacent nodes often have different labels. Most solutions to this problem remain confined to the task of node…

Machine Learning · Computer Science 2025-06-30 Andrea Giuseppe Di Francesco , Francesco Caso , Maria Sofia Bucarelli , Fabrizio Silvestri

Pretraining plays a pivotal role in acquiring generalized knowledge from large-scale data, achieving remarkable successes as evidenced by large models in CV and NLP. However, progress in the graph domain remains limited due to fundamental…

Artificial Intelligence · Computer Science 2024-06-21 Yu Song , Haitao Mao , Jiachen Xiao , Jingzhe Liu , Zhikai Chen , Wei Jin , Carl Yang , Jiliang Tang , Hui Liu

Existing Graph Neural Networks (GNNs) follow the message-passing mechanism that conducts information interaction among nodes iteratively. While considerable progress has been made, such node interaction paradigms still have the following…

Machine Learning · Computer Science 2023-04-14 Jie Chen , Zilong Li , Yin Zhu , Junping Zhang , Jian Pu

Handling heterogeneous data in tabular datasets poses a significant challenge for deep learning models. While attention-based architectures and self-supervised learning have achieved notable success, their application to tabular data…

Machine Learning · Computer Science 2025-02-27 Anay Majee , Maria Xenochristou , Wei-Peng Chen

Despite the tremendous success of graph-based learning systems in handling structural data, it has been widely investigated that they are fragile to adversarial attacks on homophilic graph data, where adversaries maliciously modify the…

Machine Learning · Computer Science 2025-09-05 Yulin Zhu , Yuni Lai , Xing Ai , Wai Lun LO , Gaolei Li , Jianhua Li , Di Tang , Xingxing Zhang , Mengpei Yang , Kai Zhou

Graphs are ubiquitous structures found in numerous real-world applications, such as drug discovery, recommender systems, and social network analysis. To model graph-structured data, graph neural networks (GNNs) have become a popular tool.…

Computation and Language · Computer Science 2025-02-10 Zehong Wang , Sidney Liu , Zheyuan Zhang , Tianyi Ma , Chuxu Zhang , Yanfang Ye

Graphs are a widely used paradigm for representing non-Euclidean data, with applications ranging from social network analysis to biomolecular prediction. While graph learning has achieved remarkable progress, real-world graph data presents…

Graph Neural Networks (GNNs) have emerged as powerful models for learning from graph-structured data. However, GNNs lack the inherent semantic understanding capability of rich textual node attributes, limiting their effectiveness in…

Artificial Intelligence · Computer Science 2025-09-04 Hanqi Duan , Yao Cheng , Jianxiang Yu , Yao Liu , Xiang Li

Recent years have witnessed fast developments of graph neural networks (GNNs) that have benefited myriad graph analytic tasks and applications. Most GNNs rely on the homophily assumption that nodes belonging to the same class are more…

Machine Learning · Computer Science 2026-04-21 Xin Zheng , Yi Wang , Yixin Liu , Ming Li , Miao Zhang , Di Jin , Philip S. Yu , Shirui Pan

Graph neural networks (GNNs) on text--attributed graphs (TAGs) typically encode node texts using pretrained language models (PLMs) and propagate these embeddings through linear neighborhood aggregation. However, the representation spaces of…

Graph Neural Networks (GNNs) are the subject of intense focus by the machine learning community for problems involving relational reasoning. GNNs can be broadly divided into spatial and spectral approaches. Spatial approaches use a form of…

Machine Learning · Statistics 2021-01-05 Kimberly Stachenfeld , Jonathan Godwin , Peter Battaglia

Recently, large language models (LLMs) have demonstrated superior capabilities in understanding and zero-shot learning on textual data, promising significant advances for many text-related domains. In the graph domain, various real-world…

Computation and Language · Computer Science 2024-02-21 Xuanwen Huang , Kaiqiao Han , Yang Yang , Dezheng Bao , Quanjin Tao , Ziwei Chai , Qi Zhu

Message passing neural networks (MPNNs) learn the representation of graph-structured data based on graph original information, including node features and graph structures, and have shown astonishing improvement in node classification…

Machine Learning · Computer Science 2023-01-30 Xiao Liu , Lijun Zhang , Hui Guan

Graph Neural Networks (GNNs) have evolved to understand graph structures through recursive exchanges and aggregations among nodes. To enhance robustness, self-supervised learning (SSL) has become a vital tool for data augmentation.…

Computation and Language · Computer Science 2024-05-08 Jiabin Tang , Yuhao Yang , Wei Wei , Lei Shi , Lixin Su , Suqi Cheng , Dawei Yin , Chao Huang

Graph neural network, as a powerful graph representation technique based on deep learning, has shown superior performance and attracted considerable research interest. However, it has not been fully considered in graph neural network for…

Social and Information Networks · Computer Science 2021-01-21 Xiao Wang , Houye Ji , Chuan Shi , Bai Wang , Peng Cui , P. Yu , Yanfang Ye