English
Related papers

Related papers: On the Connection Between MPNN and Graph Transform…

200 papers

The success of motion prediction for autonomous driving relies on integration of information from the HD maps. As maps are naturally graph-structured, investigation on graph neural networks (GNNs) for encoding HD maps is burgeoning in…

Artificial Intelligence · Computer Science 2022-09-07 Fang Da , Yu Zhang

Recent works have demonstrated the potential of Graph Neural Networks (GNN) for network intrusion detection. Despite their advantages, a significant gap persists between real-world scenarios, where detection speed is critical, and existing…

Machine Learning · Computer Science 2024-06-21 Louis Van Langendonck , Ismael Castell-Uroz , Pere Barlet-Ros

Graph Neural Networks (GNNs) have proven to be highly effective in various graph learning tasks. A key characteristic of GNNs is their use of a fixed number of message-passing steps for all nodes in the graph, regardless of each node's…

Machine Learning · Computer Science 2025-09-03 Yassine Abbahaddou , Fragkiskos D. Malliaros , Johannes F. Lutzeyer , Michalis Vazirgiannis

This study addresses the challenge of real-time metaverse applications by proposing an in-network placement and task-offloading solution for delay-constrained computing tasks in next-generation networks. The metaverse, envisioned as a…

Networking and Internet Architecture · Computer Science 2025-01-22 Sulaiman Muhammad Rashid , Ibrahim Aliyu , Il-Kwon Jeong , Tai-Won Um , Jinsul Kim

We investigate machine learning approaches to approximating the \emph{domination number} of graphs, the minimum size of a dominating set. Exact computation of this parameter is NP-hard, restricting classical methods to small instances. We…

Machine Learning · Computer Science 2025-11-25 Randy Davila , Beyzanur Ispir

As a special field in deep learning, Graph Neural Networks (GNNs) focus on extracting intrinsic network features and have drawn unprecedented popularity in both academia and industry. Most of the state-of-the-art GNN models offer…

Machine Learning · Computer Science 2021-08-17 Qinyi Zhu , Yiou Xiao

Machine learning frameworks such as graph neural networks typically rely on a given, fixed graph to exploit relational inductive biases and thus effectively learn from network data. However, when said graphs are (partially) unobserved,…

Machine Learning · Computer Science 2022-05-20 Max Wasserman , Saurabh Sihag , Gonzalo Mateos , Alejandro Ribeiro

Effectively and efficiently deploying graph neural networks (GNNs) at scale remains one of the most challenging aspects of graph representation learning. Many powerful solutions have only ever been validated on comparatively small datasets,…

Message passing-based graph neural networks (GNNs) have achieved great success in many real-world applications. For a sampled mini-batch of target nodes, the message passing process is divided into two parts: message passing between nodes…

Machine Learning · Computer Science 2025-02-28 Zhihao Shi , Jie Wang , Zhiwei Zhuang , Xize Liang , Bin Li , Feng Wu

Graph neural networks (GNNs) have garnered significant attention due to their ability to represent graph data. Among various GNN variants, graph attention network (GAT) stands out since it is able to dynamically learn the importance of…

Machine Learning · Computer Science 2024-08-19 Tiqiao Wei , Ye Yuan

We argue that Transformers are essentially graph-to-graph models, with sequences just being a special case. Attention weights are functionally equivalent to graph edges. Our Graph-to-Graph Transformer architecture makes this ability…

Computation and Language · Computer Science 2023-10-30 James Henderson , Alireza Mohammadshahi , Andrei C. Coman , Lesly Miculicich

Temporal graph neural networks (TGNNs) outperform regular GNNs by incorporating time information into graph-based operations. However, TGNNs adopt specialized models (e.g., TGN, TGAT, and APAN ) and require tailored training frameworks…

Machine Learning · Computer Science 2024-09-19 Qiang Huang , Xiao Yan , Xin Wang , Susie Xi Rao , Zhichao Han , Fangcheng Fu , Wentao Zhang , Jiawei Jiang

Graph Neural Networks (GNNs) have shown promising potential in graph representation learning. The majority of GNNs define a local message-passing mechanism, propagating information over the graph by stacking multiple layers. These methods,…

Machine Learning · Computer Science 2024-02-20 Ali Behrouz , Farnoosh Hashemi

Graphs play an important role in many applications. Recently, Graph Neural Networks (GNNs) have achieved promising results in graph analysis tasks. Some state-of-the-art GNN models have been proposed, e.g., Graph Convolutional Networks…

Machine Learning · Computer Science 2021-09-29 Yaoman Li , Irwin King

Graph Neural Networks (GNNs), particularly Graph Convolutional Neural Networks (GCNNs), have emerged as pivotal instruments in machine learning and signal processing for processing graph-structured data. This paper proposes an analysis…

Machine Learning · Statistics 2024-11-04 Xinjue Wang , Esa Ollila , Sergiy A. Vorobyov

Learning meaningful representations of free-hand sketches remains a challenging task given the signal sparsity and the high-level abstraction of sketches. Existing techniques have focused on exploiting either the static nature of sketches…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Peng Xu , Chaitanya K. Joshi , Xavier Bresson

Graph Transformers (GTs) have shown advantages in numerous graph structure tasks but their self-attention mechanism ignores the generalization bias of graphs, with existing methods mainly compensating for this bias from aspects like…

Machine Learning · Computer Science 2025-04-29 Yonghui Zhai , Yang Zhang , Minghao Shang , Lihua Pang , Yaxin Ren

Graph neural networks (GNNs) are composed of layers consisting of graph convolutions and pointwise nonlinearities. Due to their invariance and stability properties, GNNs are provably successful at learning representations from data…

Machine Learning · Computer Science 2023-08-09 Luana Ruiz , Luiz F. O. Chamon , Alejandro Ribeiro

Graph representation learning received increasing attentions in recent years. Most of existing methods ignore the complexity of the graph structures and restrict graphs in a single constant-curvature representation space, which is only…

Machine Learning · Computer Science 2021-12-13 Li Sun , Zhongbao Zhang , Junda Ye , Hao Peng , Jiawei Zhang , Sen Su , Philip S. Yu

In this paper we cast neural networks defined on graphs as message-passing neural networks (MPNNs) in order to study the distinguishing power of different classes of such models. We are interested in whether certain architectures are able…

Machine Learning · Computer Science 2020-04-07 Floris Geerts , Filip Mazowiecki , Guillermo A. Pérez