中文
相关论文

相关论文: Tokenphormer: Structure-aware Multi-token Graph Tr…

200 篇论文

Graph Neural Networks (GNNs) have paved the way for being a cornerstone in graph-related learning tasks. Yet, the ability of GNNs to capture structural interactions within graphs remains under-explored. In this work, we address this gap by…

机器学习 · 计算机科学 2025-03-04 Asela Hevapathige , Qing Wang

Graph Neural Networks (GNNs) typically scale with the number of graph edges, making them well suited for sparse graphs but less efficient on dense graphs, such as point clouds or molecular interactions. A common remedy is to sparsify the…

机器学习 · 计算机科学 2025-12-03 Shiyu Chen , Ningyuan Huang , Soledad Villar

Temporal graph neural networks (TGNNs) outperform regular GNNs by incorporating time information into graph-based operations. However, TGNNs adopt specialized models (e.g., TGN, TGAT, and APAN ) and require tailored training frameworks…

机器学习 · 计算机科学 2024-09-19 Qiang Huang , Xiao Yan , Xin Wang , Susie Xi Rao , Zhichao Han , Fangcheng Fu , Wentao Zhang , Jiawei Jiang

Graph Transformers (GTs) have emerged as a promising graph learning tool, leveraging their all-pair connected property to effectively capture global information. To address the over-smoothing problem in deep GNNs, global attention was…

机器学习 · 计算机科学 2025-12-17 Chaohao Yuan , Zhenjie Song , Ercan Engin Kuruoglu , Kangfei Zhao , Yang Liu , Deli Zhao , Hong Cheng , Yu Rong

Graph transformer networks (GTN) are a variant of graph convolutional networks (GCN) that are targeted to heterogeneous graphs in which nodes and edges have associated type information that can be exploited to improve inference accuracy.…

人工智能 · 计算机科学 2021-06-17 Loc Hoang , Udit Agarwal , Gurbinder Gill , Roshan Dathathri , Abhik Seal , Brian Martin , Keshav Pingali

We present a simple and effective approach to incorporating syntactic structure into neural attention-based encoder-decoder models for machine translation. We rely on graph-convolutional networks (GCNs), a recent class of neural networks…

计算与语言 · 计算机科学 2020-06-22 Jasmijn Bastings , Ivan Titov , Wilker Aziz , Diego Marcheggiani , Khalil Sima'an

Despite the success of Transformer models in vision and language tasks, they often learn knowledge from enormous data implicitly and cannot utilize structured input data directly. On the other hand, structured learning approaches such as…

计算机视觉与模式识别 · 计算机科学 2023-05-02 Xuehai He , Xin Eric Wang

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

机器学习 · 计算机科学 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo

Graph Neural Networks (GNNs) are a powerful tool for machine learning on graphs.GNNs combine node feature information with the graph structure by recursively passing neural messages along edges of the input graph. However, incorporating…

机器学习 · 计算机科学 2019-11-15 Rex Ying , Dylan Bourgeois , Jiaxuan You , Marinka Zitnik , Jure Leskovec

Integrating the structural inductive biases of Graph Neural Networks (GNNs) with the global contextual modeling capabilities of Transformers represents a pivotal challenge in graph representation learning. While GNNs excel at capturing…

机器学习 · 计算机科学 2025-03-05 Zhihua Duan , Jialin Wang

Graph Transformers (GTs) have demonstrated remarkable performance in graph representation learning over popular graph neural networks (GNNs). However, self--attention, the core module of GTs, preserves only low-frequency signals in graph…

机器学习 · 计算机科学 2025-05-30 Guoguo Ai , Guansong Pang , Hezhe Qiao , Yuan Gao , Hui Yan

Representation learning on text-attributed graphs (TAGs) is vital for real-world applications, as they combine semantic textual and contextual structural information. Research in this field generally consist of two main perspectives:…

计算与语言 · 计算机科学 2024-10-15 Yaoke Wang , Yun Zhu , Wenqiao Zhang , Yueting Zhuang , Yunfei Li , Siliang Tang

Predictive Business Process Monitoring (PBPM) aims to forecast future events in ongoing cases based on historical event logs. While Graph Neural Networks (GNNs) are well suited to capture structural dependencies in process data, existing…

机器学习 · 计算机科学 2025-11-25 Fang Wang , Ernesto Damiani

Recent advances in Graph Convolutional Neural Networks (GCNNs) have shown their efficiency for non-Euclidean data on graphs, which often require a large amount of labeled data with high cost. It it thus critical to learn graph feature…

计算机视觉与模式识别 · 计算机科学 2020-03-20 Xiang Gao , Wei Hu , Guo-Jun Qi

Graph Neural Networks (GNNs) are learning models aimed at processing graphs and signals on graphs. The most popular and successful GNNs are based on message passing schemes. Such schemes inherently have limited expressive power when it…

机器学习 · 计算机科学 2022-06-24 Jacob Bamberger

Graph Neural Networks (GNNs) often struggle with heterophilic data, where connected nodes may have dissimilar labels, as they typically assume homophily and rely on local message passing. To address this, we propose creating alternative…

机器学习 · 计算机科学 2025-06-11 Victor M. Tenorio , Madeline Navarro , Samuel Rey , Santiago Segarra , Antonio G. Marques

Graph neural networks have shown significant success in the field of graph representation learning. Graph convolutions perform neighborhood aggregation and represent one of the most important graph operations. Nevertheless, one layer of…

机器学习 · 计算机科学 2020-07-21 Meng Liu , Hongyang Gao , Shuiwang Ji

Graph Neural Networks (GNNs) have demonstrated impressive performance across diverse graph-based tasks by leveraging message passing to capture complex node relationships. However, on large-scale real-world graphs, GNNs face two major…

机器学习 · 计算机科学 2026-03-10 Xiang Li , Jianpeng Qi , Haobing Liu , Yuan Cao , Guoqing Chao , Zhongying Zhao , Junyu Dong , Xinwang Liu , Yanwei Yu

Graph neural networks (GNNs) have been widely adopted in engineering applications such as social network analysis, chemical research and computer vision. However, their efficacy is severely compromised by the inherent homophily assumption,…

机器学习 · 计算机科学 2026-04-13 Yi Luo , Xu Sun , Guangchun Luo , Aiguo Chen

This paper studies semi-supervised graph classification, a crucial task with a wide range of applications in social network analysis and bioinformatics. Recent works typically adopt graph neural networks to learn graph-level representations…

机器学习 · 计算机科学 2023-04-25 Wei Ju , Xiao Luo , Meng Qu , Yifan Wang , Chong Chen , Minghua Deng , Xian-Sheng Hua , Ming Zhang