English
Related papers

Related papers: Massive Activations in Graph Neural Networks: Deco…

200 papers

Graph neural networks (GNNs), and especially message-passing neural networks, excel in various domains such as physics, drug discovery, and molecular modeling. The expressivity of GNNs with respect to their ability to discriminate…

In previous studies, decoding electroencephalography (EEG) signals has not considered the topological relationship of EEG electrodes. However, the latest neuroscience has suggested brain network connectivity. Thus, the exhibited interaction…

Signal Processing · Electrical Eng. & Systems 2020-07-28 Shuyue Jia , Yimin Hou , Yan Shi , Yang Li

Meta-path-based heterogeneous graph neural networks aggregate over meta-path-induced views, and their semantic-level attention over meta-path channels is widely used as a narrative for ``which semantics matter.'' We study this assumption…

Machine Learning · Computer Science 2026-02-10 Maiqi Jiang , Noman Ali , Yiran Ding , Yanfu Zhang

Vital nodes usually play a key role in complex networks. Uncovering these nodes is an important task in protecting the network, especially when the network suffers intentional attack. Many existing methods have not fully integrated the node…

Social and Information Networks · Computer Science 2025-09-24 Huaizhi Liao , Tian Qiu , Guang Chen

Human activity recognition (HAR) through wearable devices has received much interest due to its numerous applications in fitness tracking, wellness screening, and supported living. As a result, we have seen a great deal of work in this…

Machine Learning · Computer Science 2022-06-13 Nafees Ahmad , Savio Ho-Chit Chow , Ho-fung Leung

The irreducible complexity of natural phenomena has led Graph Neural Networks to be employed as a standard model to perform representation learning tasks on graph-structured data. While their capacity to capture local and global patterns is…

Machine Learning · Computer Science 2024-02-13 Lorenzo Giusti

Graph Neural Networks (GNNs) have been successfully used in many problems involving graph-structured data, achieving state-of-the-art performance. GNNs typically employ a message-passing scheme, in which every node aggregates information…

Machine Learning · Computer Science 2022-11-22 Michail Chatzianastasis , Johannes F. Lutzeyer , George Dasoulas , Michalis Vazirgiannis

Recent advancements in graph learning have revolutionized the way to understand and analyze data with complex structures. Notably, Graph Neural Networks (GNNs), i.e. neural network architectures designed for learning graph representations,…

Machine Learning · Computer Science 2024-07-09 Yu Huang , Min Zhou , Menglin Yang , Zhen Wang , Muhan Zhang , Jie Wang , Hong Xie , Hao Wang , Defu Lian , Enhong Chen

Graph neural network, as a powerful graph representation technique based on deep learning, has shown superior performance and attracted considerable research interest. However, it has not been fully considered in graph neural network for…

Social and Information Networks · Computer Science 2021-01-21 Xiao Wang , Houye Ji , Chuan Shi , Bai Wang , Peng Cui , P. Yu , Yanfang Ye

The goal of this work is to address two limitations in autoencoder-based models: latent space interpretability and compatibility with unstructured meshes. This is accomplished here with the development of a novel graph neural network (GNN)…

Machine Learning · Computer Science 2023-02-20 Shivam Barwey , Varun Shankar , Venkatasubramanian Viswanathan , Romit Maulik

Data-driven surrogate modeling has surged in capability in recent years with the emergence of graph neural networks (GNNs), which can operate directly on mesh-based representations of data. The goal of this work is to introduce an…

Machine Learning · Computer Science 2024-10-25 Shivam Barwey , Hojin Kim , Romit Maulik

We address the key challenge of size-induced distribution shifts in graph neural networks (GNNs) and their impact on the generalization of GNNs to larger graphs. Existing literature operates under diverse assumptions about distribution…

Machine Learning · Computer Science 2025-08-04 Gaotang Li , Danai Koutra , Yujun Yan

Graph Neural Networks (GNNs) have achieved promising performance in a variety of graph-focused tasks. Despite their success, however, existing GNNs suffer from two significant limitations: a lack of interpretability in their results due to…

Machine Learning · Statistics 2024-11-19 Wenzhuo Zhou , Annie Qu , Keiland W. Cooper , Norbert Fortin , Babak Shahbaba

Graph neural networks (GNNs) have demonstrated a significant boost in prediction performance on graph data. At the same time, the predictions made by these models are often hard to interpret. In that regard, many efforts have been made to…

Machine Learning · Computer Science 2023-05-24 Yiqiao Li , Jianlong Zhou , Sunny Verma , Fang Chen

Interpretability has emerged as a crucial aspect of building trust in machine learning systems, aimed at providing insights into the working of complex neural networks that are otherwise opaque to a user. There are a plethora of existing…

Machine Learning · Statistics 2021-01-19 Rushil Anirudh , Jayaraman J. Thiagarajan , Rahul Sridhar , Peer-Timo Bremer

Graph Neural Networks (GNNs) achieve an impressive performance on structured graphs by recursively updating the representation vector of each node based on its neighbors, during which parameterized transformation matrices should be learned…

Machine Learning · Computer Science 2019-06-14 Pengfei Chen , Weiwen Liu , Chang-Yu Hsieh , Guangyong Chen , Shengyu Zhang

Although hypergraph neural networks (HGNNs) have emerged as a powerful framework for analyzing complex datasets, their practical performance often remains limited. On one hand, existing networks typically employ a single type of attention…

Machine Learning · Computer Science 2025-11-14 Murong Yang , Shihui Ying , Yue Gao , Xin-Jian Xu

Heterogeneous information network (HIN) embedding, aiming to map the structure and semantic information in a HIN to distributed representations, has drawn considerable research attention. Graph neural networks for HIN embeddings typically…

Social and Information Networks · Computer Science 2020-07-07 Di Jin , Zhizhi Yu , Dongxiao He , Carl Yang , Philip S. Yu , Jiawei Han

Deep neural networks (DNNs) achieve state-of-the-art performance on many tasks, but this often requires increasingly larger model sizes, which in turn leads to more complex internal representations. Explainability techniques (XAI) have made…

Machine Learning · Computer Science 2026-01-30 Tom Pelletreau-Duris , Ruud van Bakel , Michael Cochez

Attention networks have proven to be an effective approach for embedding categorical inference within a deep neural network. However, for many tasks we may want to model richer structural dependencies without abandoning end-to-end training.…

Computation and Language · Computer Science 2017-02-17 Yoon Kim , Carl Denton , Luong Hoang , Alexander M. Rush