English
Related papers

Related papers: Tailoring Self-Attention for Graph via Rooted Subt…

200 papers

Following the success of deep convolutional networks in various vision and speech related tasks, researchers have started investigating generalizations of the well-known technique for graph-structured data. A recently-proposed method called…

Social and Information Networks · Computer Science 2018-09-21 John Boaz Lee , Ryan A. Rossi , Xiangnan Kong , Sungchul Kim , Eunyee Koh , Anup Rao

Graph neural networks (GNNs), which capture graph structures via a feature aggregation mechanism following the graph embedding framework, have demonstrated a powerful ability to support various tasks. According to the topology properties…

Machine Learning · Computer Science 2025-05-28 Meng Qin , Jiahong Liu , Irwin King

In recent years, graph neural networks (GNNs) have emerged as a potent tool for learning on graph-structured data and won fruitful successes in varied fields. The majority of GNNs follow the message-passing paradigm, where representations…

Machine Learning · Computer Science 2024-08-30 Yurui Lai , Xiaoyang Lin , Renchi Yang , Hongtao Wang

Accurate indoor localization is crucial for enabling spatial context in smart environments and navigation systems. Wi-Fi Received Signal Strength (RSS) fingerprinting is a widely used indoor localization approach due to its compatibility…

Machine Learning · Computer Science 2025-07-16 Danish Gufran , Sudeep Pasricha

Graph Attention Network (GAT) is one of the most popular Graph Neural Network (GNN) architecture, which employs the attention mechanism to learn edge weights and has demonstrated promising performance in various applications. However, since…

Machine Learning · Computer Science 2024-03-05 Qincheng Lu , Jiaqi Zhu , Sitao Luan , Xiao-Wen Chang

In this paper, we design Graph Neural Networks (GNNs) with attention mechanisms to tackle an important yet challenging nonlinear regression problem: massive network localization. We first review our previous network localization method…

Machine Learning · Computer Science 2025-04-08 Wenzhong Yan , Feng Yin , Juntao Wang , Geert Leus , Abdelhak M. Zoubir , Yang Tian

Dynamic graph learning plays a pivotal role in modeling evolving relationships over time, especially for temporal link prediction tasks in domains such as traffic systems, social networks, and recommendation platforms. While…

Machine Learning · Computer Science 2025-11-18 Tao Zou , Chengfeng Wu , Tianxi Liao , Junchen Ye , Bowen Du

With the rise of IoT-based botnet attacks, researchers have explored various learning models for detection, including traditional machine learning, deep learning, and hybrid approaches. A key advancement involves deploying attention…

Machine Learning · Computer Science 2025-05-26 Hassan Wasswa , Hussein Abbass , Timothy Lynar

Advanced methods of applying deep learning to structured data such as graphs have been proposed in recent years. In particular, studies have focused on generalizing convolutional neural networks to graph data, which includes redefining the…

Machine Learning · Computer Science 2019-06-14 Junhyun Lee , Inyeop Lee , Jaewoo Kang

Graph neural networks (GNNs) have emerged as a powerful tool for graph classification and representation learning. However, GNNs tend to suffer from over-smoothing problems and are vulnerable to graph perturbations. To address these…

Machine Learning · Computer Science 2021-11-01 Yuzhou Chen , Baris Coskunuzer , Yulia R. Gel

Graph neural networks (GNNs) are widely used as surrogates for costly experiments and first-principles simulations to study the behavior of compounds at atomistic scale, and their architectural complexity is constantly increasing to enable…

Machine Learning · Computer Science 2026-05-04 Arindam Chowdhury , Massimiliano Lupo Pasini

Deep learning methods for graphs achieve remarkable performance on many node-level and graph-level prediction tasks. However, despite the proliferation of the methods and their success, prevailing Graph Neural Networks (GNNs) neglect…

Machine Learning · Computer Science 2020-11-10 Emily Alsentzer , Samuel G. Finlayson , Michelle M. Li , Marinka Zitnik

In recent years, powered by the learned discriminative representation via graph neural network (GNN) models, deep graph matching methods have made great progresses in the task of matching semantic features. However, these methods usually…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 He Liu , Tao Wang , Yidong Li , Congyan Lang , Yi Jin , Haibin Ling

Traffic flow prediction plays a crucial role in alleviating traffic congestion and enhancing transport efficiency. While combining graph convolution networks with recurrent neural networks for spatial-temporal modeling is a common strategy…

Machine Learning · Computer Science 2024-01-10 Haiyang Liu , Chunjiang Zhu , Detian Zhang

In this paper, we present Conjoint Attentions (CAs), a class of novel learning-to-attend strategies for graph neural networks (GNNs). Besides considering the layer-wise node features propagated within the GNN, CAs can additionally…

Machine Learning · Computer Science 2021-12-14 Tiantian He , Yew-Soon Ong , Lu Bai

Transformers have recently emerged as powerful neural networks for graph learning, showcasing state-of-the-art performance on several graph property prediction tasks. However, these results have been limited to small-scale graphs, where the…

Machine Learning · Computer Science 2023-12-19 Vijay Prakash Dwivedi , Yozen Liu , Anh Tuan Luu , Xavier Bresson , Neil Shah , Tong Zhao

Graph neural networks (GNNs) have been widely used in deep learning on graphs. They can learn effective node representations that achieve superior performances in graph analysis tasks such as node classification and node clustering.…

Machine Learning · Computer Science 2021-04-19 Jianxin Li , Hao Peng , Yuwei Cao , Yingtong Dou , Hekai Zhang , Philip S. Yu , Lifang He

Hypergraphs serve as an effective model for depicting complex connections in various real-world scenarios, from social to biological networks. The development of Hypergraph Neural Networks (HGNNs) has emerged as a valuable method to manage…

Machine Learning · Computer Science 2024-06-17 Shuai Wang , David W. Zhang , Jia-Hong Huang , Stevan Rudinac , Monika Kackovic , Nachoem Wijnberg , Marcel Worring

Graph neural networks (GNN) have shown significant capabilities in handling structured data, yet their application to dynamic, temporal data remains limited. This paper presents a new type of graph attention network, called TempoKGAT, which…

Machine Learning · Computer Science 2024-12-24 Lena Sasal , Daniel Busby , Abdenour Hadid

Attention mechanisms are critical to the success of large language models (LLMs), driving significant advancements in multiple fields. However, for graph-structured data, which requires emphasis on topological connections, they fall short…

Artificial Intelligence · Computer Science 2025-05-06 Zhong Guan , Likang Wu , Hongke Zhao , Ming He , Jianpin Fan