中文
相关论文

相关论文: Exploring the Global-to-Local Attention Scheme in …

200 篇论文

Spatial-temporal network traffic forecasting is a challenging task due to the complex spatial relationships and dynamic temporal patterns present in each node. Traditional regression methods are not directly applicable to such graph data.…

信息检索 · 计算机科学 2026-05-12 Jinming Xing , Guoheng Sun , Hui Sun , Linchao Pan , Shakir Mahmood , Xuanhao Luo , Muhammad Shahzad

Graph Transformers (GTs) have emerged as a powerful paradigm for graph representation learning due to their ability to model diverse node interactions. However, existing GTs often rely on intricate architectural designs tailored to specific…

计算机视觉与模式识别 · 计算机科学 2025-10-22 Yujie Xing , Xiao Wang , Bin Wu , Hai Huang , Chuan Shi

Graph Transformers (GTs) have shown strong empirical performance, yet current architectures vary widely in their use of attention mechanisms, positional embeddings (PEs), and expressivity. Existing expressivity results are often tied to…

机器学习 · 计算机科学 2025-11-12 Timo Stoll , Luis Müller , Christopher Morris

Graph convolutional networks (GCNs) have shown the powerful ability in text structure representation and effectively facilitate the task of text classification. However, challenges still exist in adapting GCN on learning discriminative…

机器学习 · 计算机科学 2019-12-02 Xueya Zhang , Tong Zhang , Wenting Zhao , Zhen Cui , Jian Yang

Graph Neural Networks (GNNs) have been highly successful for the node classification task. GNNs typically assume graphs are homophilic, i.e. neighboring nodes are likely to belong to the same class. However, a number of real-world graphs…

机器学习 · 计算机科学 2024-09-20 Yurui Lai , Taiyan Zhang , Rui Fan

To alleviate the local receptive issue of GCN, Transformers have been exploited to capture the long range dependences of nodes for graph data representation and learning. However, existing graph Transformers generally employ regular…

机器学习 · 计算机科学 2023-05-15 Bo Jiang , Fei Xu , Ziyan Zhang , Jin Tang , Feiping Nie

Many real-world problems can be represented as graph-based learning problems. In this paper, we propose a novel framework for learning spatial and attentional convolution neural networks on arbitrary graphs. Different from previous…

机器学习 · 计算机科学 2019-02-26 Hao Peng , Jianxin Li , Qiran Gong , Senzhang Wang , Yuanxing Ning , Philip S. Yu

Graph Transformer has demonstrated impressive capabilities in the field of graph representation learning. However, existing approaches face two critical challenges: (1) most models suffer from exponentially increasing computational…

Graph Neural Networks (GNNs) are routinely used in molecular physics, social sciences, and economics to model many-body interactions in graph-like systems. However, GNNs are inherently local and can suffer from information flow bottlenecks.…

Traffic forecasting is an indispensable part of Intelligent transportation systems (ITS), and long-term network-wide accurate traffic speed forecasting is one of the most challenging tasks. Recently, deep learning methods have become…

人工智能 · 计算机科学 2021-04-13 Haoyang Yan , Xiaolei Ma

We propose a generalization of transformer neural network architecture for arbitrary graphs. The original transformer was designed for Natural Language Processing (NLP), which operates on fully connected graphs representing all connections…

机器学习 · 计算机科学 2021-01-26 Vijay Prakash Dwivedi , Xavier Bresson

Graph transformers are the state-of-the-art for learning from graph-structured data and are empirically known to avoid several pitfalls of message-passing architectures. However, there is limited theoretical analysis on why these models…

机器学习 · 统计学 2026-03-19 Nil Ayday , Lingchu Yang , Debarghya Ghoshdastidar

Graph Transformers (GTs) have demonstrated remarkable performance in graph representation learning over popular graph neural networks (GNNs). However, self--attention, the core module of GTs, preserves only low-frequency signals in graph…

机器学习 · 计算机科学 2025-05-30 Guoguo Ai , Guansong Pang , Hezhe Qiao , Yuan Gao , Hui Yan

Hypergraphs play a pivotal role in the modelling of data featuring higher-order relations involving more than two entities. Hypergraph neural networks emerge as a powerful tool for processing hypergraph-structured data, delivering…

机器学习 · 计算机科学 2024-06-04 Zexi Liu , Bohan Tang , Ziyuan Ye , Xiaowen Dong , Siheng Chen , Yanfeng Wang

Accurate and real-time traffic state prediction is of great practical importance for urban traffic control and web mapping services. With the support of massive data, deep learning methods have shown their powerful capability in capturing…

机器学习 · 计算机科学 2023-09-07 Xunlian Luo , Chunjiang Zhu , Detian Zhang , Qing Li

Graph convolutional networks (GCNs) have been widely used and achieved remarkable results in skeleton-based action recognition. We think the key to skeleton-based action recognition is a skeleton hanging in frames, so we focus on how the…

计算机视觉与模式识别 · 计算机科学 2023-12-07 Nguyen Huu Bao Long

Geometric deep learning has made great strides towards generalizing the design of structure-aware neural networks from traditional domains to non-Euclidean ones, giving rise to graph neural networks (GNN) that can be applied to…

机器学习 · 统计学 2024-10-28 Frederik Wenkel , Yimeng Min , Matthew Hirn , Michael Perlmutter , Guy Wolf

Top-performing landmark estimation algorithms are based on exploiting the excellent ability of large convolutional neural networks (CNNs) to represent local appearance. However, it is well known that they can only learn weak spatial…

计算机视觉与模式识别 · 计算机科学 2022-10-14 Andrés Prados-Torreblanca , José M. Buenaposada , Luis Baumela

Graph classification is an important learning task for graph-structured data. Graph neural networks (GNNs) have recently gained growing attention in graph learning and have shown significant improvements in many important graph problems.…

机器学习 · 计算机科学 2024-01-31 Tao Wen , Elynn Chen , Yuzhou Chen

Graph convolutional networks (GCNs) have been widely used for representation learning on graph data, which can capture structural patterns on a graph via specifically designed convolution and readout operations. In many graph classification…

机器学习 · 计算机科学 2020-10-13 Wenfeng Liu , Maoguo Gong , Zedong Tang , A. K. Qin