English
Related papers

Related papers: Massive Activations in Graph Neural Networks: Deco…

200 papers

Graphs play an important role in many applications. Recently, Graph Neural Networks (GNNs) have achieved promising results in graph analysis tasks. Some state-of-the-art GNN models have been proposed, e.g., Graph Convolutional Networks…

Machine Learning · Computer Science 2021-09-29 Yaoman Li , Irwin King

Graph Neural Networks (graph NNs) are a promising deep learning approach for analyzing graph-structured data. However, it is known that they do not improve (or sometimes worsen) their predictive performance as we pile up many layers and add…

Machine Learning · Computer Science 2021-01-07 Kenta Oono , Taiji Suzuki

Attention-based graph neural networks (GNNs), such as graph attention networks (GATs), have become popular neural architectures for processing graph-structured data and learning node embeddings. Despite their empirical success, these models…

Machine Learning · Statistics 2023-06-07 Dexiong Chen , Paolo Pellizzoni , Karsten Borgwardt

Graph Neural Networks (GNNs) have risen to prominence in learning representations for graph structured data. A single GNN layer typically consists of a feature transformation and a feature aggregation operation. The former normally uses…

Machine Learning · Computer Science 2021-10-19 Yao Ma , Xiaorui Liu , Tong Zhao , Yozen Liu , Jiliang Tang , Neil Shah

Estimating multiple attributes from a single facial image gives comprehensive descriptions on the high level semantics of the face. It is naturally regarded as a multi-task supervised learning problem with a single deep CNN, in which lower…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Yan Zhang , Li Sun

A central question in neuroscience is how self-organizing dynamic interactions in the brain emerge on their relatively static structural backbone. Due to the complexity of spatial and temporal dependencies between different brain areas,…

Neurons and Cognition · Quantitative Biology 2020-10-15 Simon Wein , Wilhelm Malloni , Ana Maria Tomé , Sebastian M. Frank , Gina-Isabelle Henze , Stefan Wüst , Mark W. Greenlee , Elmar W. Lang

Graph Neural Networks (GNNs) have been taking role in many areas, thanks to their expressive power on graph-structured data. On the other hand, Mobile Ad-Hoc Networks (MANETs) are gaining attention as network technologies have been taken to…

Machine Learning · Computer Science 2022-12-20 Taha Tekdogan

Objective: Modelling the associations from high-throughput experimental molecular data has provided unprecedented insights into biological pathways and signalling mechanisms. Graphical models and networks have especially proven to be useful…

Machine Learning · Statistics 2013-04-24 Marco Scutari , Radhakrishnan Nagarajan

Graph Neural Networks (GNNs) have garnered significant attention from researchers due to their outstanding performance in handling graph-related tasks, such as social network analysis, protein design, and so on. Despite their widespread…

Cryptography and Security · Computer Science 2025-01-03 Xiao Lin , Mingjie Li , Yisen Wang

Graph Neural Networks (GNNs) have shown remarkable effectiveness in capturing abundant information in graph-structured data. However, the black-box nature of GNNs hinders users from understanding and trusting the models, thus leading to…

Machine Learning · Computer Science 2022-07-25 Jiaxuan Xie , Yezi Liu , Yanning Shen

Graph Neural Networks (GNNs) are a large class of relational models for graph processing. Recent theoretical studies on the expressive power of GNNs have focused on two issues. On the one hand, it has been proven that GNNs are as powerful…

Graph neural networks are attractive for learning properties of atomic structures thanks to their intuitive graph encoding of atoms and bonds. However, conventional encoding does not include angular information, which is critical for…

Graph neural networks (GNNs) excel at predictive tasks on graph-structured data but often lack the ability to incorporate symbolic domain knowledge and perform general reasoning. Relational Bayesian Networks (RBNs), in contrast, enable…

Artificial Intelligence · Computer Science 2025-07-30 Raffaele Pojer , Andrea Passerini , Kim G. Larsen , Manfred Jaeger

Graph neural networks (GNNs) have shown great ability in modeling graphs, however, their performance would significantly degrade when there are noisy edges connecting nodes from different classes. To alleviate negative effect of noisy edges…

Social and Information Networks · Computer Science 2023-09-15 Xiao Shen , Mengqiu Shao , Shirui Pan , Laurence T. Yang , Xi Zhou

We introduce a novel masked graph autoencoder (MGAE) framework to perform effective learning on graph structure data. Taking insights from self-supervised learning, we randomly mask a large proportion of edges and try to reconstruct these…

Machine Learning · Computer Science 2022-01-10 Qiaoyu Tan , Ninghao Liu , Xiao Huang , Rui Chen , Soo-Hyun Choi , Xia Hu

Recent architectural developments have enabled recurrent neural networks (RNNs) to reach and even surpass the performance of Transformers on certain sequence modeling tasks. These modern RNNs feature a prominent design pattern: linear…

Graph Convolutional Networks (GCNs) have gained great popularity in tackling various analytics tasks on graph and network data. However, some recent studies raise concerns about whether GCNs can optimally integrate node features and…

Machine Learning · Computer Science 2020-07-14 Xiao Wang , Meiqi Zhu , Deyu Bo , Peng Cui , Chuan Shi , Jian Pei

Graph neural networks (GNNs) have been widely used to learn vector representation of graph-structured data and achieved better task performance than conventional methods. The foundation of GNNs is the message passing procedure, which…

Machine Learning · Computer Science 2022-01-31 Takeshi D. Itoh , Takatomi Kubo , Kazushi Ikeda

Graph Neural Networks (GNNs) have demonstrated remarkable success in various domains such as social networks, molecular chemistry, and more. A crucial component of GNNs is the pooling procedure, in which the node features calculated by the…

Machine Learning · Computer Science 2026-05-19 Yaniv Galron , Hadar Sinai , Haggai Maron , Moshe Eliasof

Brain graphs, which model the structural and functional relationships between brain regions, are crucial in neuroscientific and clinical applications involving graph classification. However, dense brain graphs pose computational challenges…

Machine Learning · Computer Science 2023-06-27 Gaotang Li , Marlena Duda , Xiang Zhang , Danai Koutra , Yujun Yan