English
Related papers

Related papers: Less is More: Hop-Wise Graph Attention for Scalabl…

200 papers

Graph Neural Networks (GNNs) have emerged as the de facto standard for modeling graph data, with attention mechanisms and transformers significantly enhancing their performance on graph-based tasks. Despite these advancements, the…

Machine Learning · Computer Science 2025-04-07 Nikhil Shivakumar Nayak

Domain adaptation using graph-structured networks learns label-discriminative and network-invariant node embeddings by sharing graph parameters. Most existing works focus on domain adaptation of homogeneous networks. The few works that…

Machine Learning · Computer Science 2022-09-27 Tiancheng Huang , Ke Xu , Donglin Wang

Wearable sensors in Internet of Things (IoT) ecosystems increasingly support applications such as remote health monitoring, elderly care, and smart home automation, all of which rely on robust human activity recognition (HAR). Continual…

Temporal graph neural networks have shown promising results in learning inductive representations by automatically extracting temporal patterns. However, previous works often rely on complex memory modules or inefficient random walk methods…

Machine Learning · Computer Science 2024-01-10 Mohammad Ali Alomrani , Mahdi Biparva , Yingxue Zhang , Mark Coates

Graph Neural Networks (GNNs) are routinely used in molecular physics, social sciences, and economics to model many-body interactions in graph-like systems. However, GNNs are inherently local and can suffer from information flow bottlenecks.…

Computational Physics · Physics 2025-02-21 Alessandro Caruso , Jacopo Venturin , Lorenzo Giambagli , Edoardo Rolando , Frank Noé , Cecilia Clementi

In this paper, we investigate the degree of explainability of graph neural networks (GNNs). Existing explainers work by finding global/local subgraphs to explain a prediction, but they are applied after a GNN has already been trained. Here,…

Machine Learning · Computer Science 2022-12-21 Indro Spinelli , Simone Scardapane , Aurelio Uncini

Graph Convolutional Networks (GCNs) gained traction for graph representation learning, with recent attention on improving performance on heterophilic graphs for various real-world applications. The localized feature aggregation in a typical…

Machine Learning · Computer Science 2025-07-30 Garv Kaushik

Graph Attention Networks (GATs) are one of the most popular GNN architectures and are considered as the state-of-the-art architecture for representation learning with graphs. In GAT, every node attends to its neighbors given its own…

Machine Learning · Computer Science 2022-02-01 Shaked Brody , Uri Alon , Eran Yahav

Few-shot learning can find the latent structure information between the prior knowledge and the queried data by the similarity metric of meta-learning to construct the discriminative model for recognizing the new categories with the rare…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Guangfeng Lin , Ying Yang , Yindi Fan , Xiaobing Kang , Kaiyang Liao , Fan Zhao

A common issue in Graph Neural Networks (GNNs) is known as over-smoothing. By increasing the number of iterations within the message-passing of GNNs, the nodes' representations of the input graph align with each other and become…

Machine Learning · Computer Science 2021-10-22 Christian M. M. Frey , Yunpu Ma , Matthias Schubert

Graph Neural Networks (GNNs) have been widely studied for graph data representation and learning. However, existing GNNs generally conduct context-aware learning on node feature representation only which usually ignores the learning of edge…

Machine Learning · Computer Science 2019-10-07 Bo Jiang , Leiling Wang , Jin Tang , Bin Luo

Graph neural networks (GNNs) have emerged as a popular strategy for handling non-Euclidean data due to their state-of-the-art performance. However, most of the current GNN model designs mainly focus on task accuracy, lacking in considering…

Machine Learning · Computer Science 2023-04-14 Ao Zhou , Jianlei Yang , Yingjie Qi , Yumeng Shi , Tong Qiao , Weisheng Zhao , Chunming Hu

Recently, linear complexity sequence modeling networks have achieved modeling capabilities similar to Vision Transformers on a variety of computer vision tasks, while using fewer FLOPs and less memory. However, their advantage in terms of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Bencheng Liao , Xinggang Wang , Lianghui Zhu , Qian Zhang , Chang Huang

Graph neural networks (GNNs) have been widely used in graph-structured data computation, showing promising performance in various applications such as node classification, link prediction, and network recommendation. Existing works mainly…

Machine Learning · Computer Science 2023-02-07 Houyi Li , Zhihong Chen , Zhao Li , Qinkai Zheng , Peng Zhang , Shuigeng Zhou

Accurate power load forecasting is crucial for improving energy efficiency and ensuring power supply quality. Considering the power load forecasting problem involves not only dynamic factors like historical load variations but also static…

Machine Learning · Computer Science 2024-09-27 Chao Min , Yijia Wang , Bo Zhang , Xin Ma , Junyi Cui

Mechanistic interpretability seeks to reverse-engineer neural network computations into human-understandable algorithms, yet extracting sparse computational circuits from billion-parameter language models remains challenging due to…

Machine Learning · Computer Science 2026-01-21 Mohammed Mudassir Uddin , Shahnawaz Alam , Mohammed Kaif Pasha

This paper presents a novel transformer architecture for graph representation learning. The core insight of our method is to fully consider the information propagation among nodes and edges in a graph when building the attention module in…

Machine Learning · Computer Science 2024-10-10 Zhe Chen , Hao Tan , Tao Wang , Tianrun Shen , Tong Lu , Qiuying Peng , Cheng Cheng , Yue Qi

Graph Neural Networks (GNNs) are powerful to learn the representation of graph-structured data. Most of the GNNs use the message-passing scheme, where the embedding of a node is iteratively updated by aggregating the information of its…

Machine Learning · Computer Science 2020-07-28 Shuo Zhang , Lei Xie

Machine learning over graphs have been emerging as powerful learning tools for graph data. However, it is challenging for industrial communities to leverage the techniques, such as graph neural networks (GNNs), and solve real-world problems…

Social and Information Networks · Computer Science 2020-03-17 Dalong Zhang , Xin Huang , Ziqi Liu , Zhiyang Hu , Xianzheng Song , Zhibang Ge , Zhiqiang Zhang , Lin Wang , Jun Zhou , Yang Shuang , Yuan Qi

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate…

Information Retrieval · Computer Science 2022-01-10 Sai Mitheran , Abhinav Java , Surya Kant Sahu , Arshad Shaikh