English
Related papers

Related papers: Global Attention Improves Graph Networks Generaliz…

200 papers

Graph neural networks (GNNs) have recently exploded in popularity thanks to their broad applicability to ubiquitous graph-related problems such as quantum chemistry, drug discovery, and high energy physics. However, meeting demand for novel…

Machine Learning · Computer Science 2022-01-24 Stefan Abi-Karam , Yuqi He , Rishov Sarkar , Lakshmi Sathidevi , Zihang Qiao , Cong Hao

The generalized Gauss-Newton (GGN) approximation is often used to make practical Bayesian deep learning approaches scalable by replacing a second order derivative with a product of first order derivatives. In this paper we argue that the…

Machine Learning · Statistics 2021-02-26 Alexander Immer , Maciej Korzepa , Matthias Bauer

This work presents a novel reconfigurable architecture for Low Latency Graph Neural Network (LL-GNN) designs for particle detectors, delivering unprecedented low latency performance. Incorporating FPGA-based GNNs into particle detectors…

Hardware Architecture · Computer Science 2024-01-19 Zhiqiang Que , Hongxiang Fan , Marcus Loo , He Li , Michaela Blott , Maurizio Pierini , Alexander Tapper , Wayne Luk

Face information is mainly concentrated among facial key points, and frontier research has begun to use graph neural networks to segment faces into patches as nodes to model complex face representations. However, these methods construct…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yiping Zhang , Yuntao Shou , Wei Ai , Tao Meng , Keqin Li

With the ever-growing popularity of Graph Neural Networks (GNNs), efficient GNN inference is gaining tremendous attention. Field-Programming Gate Arrays (FPGAs) are a promising execution platform due to their fine-grained parallelism,…

Machine Learning · Computer Science 2023-09-29 Chenfeng Zhao , Zehao Dong , Yixin Chen , Xuan Zhang , Roger D. Chamberlain

Graph Neural Networks have become one of the indispensable tools to learn from graph-structured data, and their usefulness has been shown in wide variety of tasks. In recent years, there have been tremendous improvements in architecture…

Machine Learning · Statistics 2021-11-15 Sunil Kumar Maurya , Xin Liu , Tsuyoshi Murata

Numerous subgraph-enhanced graph neural networks (GNNs) have emerged recently, provably boosting the expressive power of standard (message-passing) GNNs. However, there is a limited understanding of how these approaches relate to each other…

Machine Learning · Computer Science 2022-10-18 Chendi Qian , Gaurav Rattan , Floris Geerts , Christopher Morris , Mathias Niepert

Graph Neural Networks (GNNs) have exhibited remarkable efficacy in learning from multi-view graph data. In the framework of multi-view graph neural networks, a critical challenge lies in effectively combining diverse views, where each view…

Machine Learning · Computer Science 2026-05-18 Junyu Chen , Long Shi , Badong Chen

End-to-end training with global optimization have popularized graph neural networks (GNNs) for node classification, yet inadvertently introduced vulnerabilities to adversarial edge-perturbing attacks. Adversaries can exploit the inherent…

Machine Learning · Computer Science 2024-12-12 Ao Liu , Wenshan Li , Tao Li , Beibei Li , Guangquan Xu , Pan Zhou , Wengang Ma , Hanyuan Huang

Graph Neural Networks (GNNs) have recently become the predominant tools for studying graph data. Despite state-of-the-art performance on graph classification tasks, GNNs are overwhelmingly trained in a single domain under supervision, thus…

Machine Learning · Computer Science 2025-02-18 Tao Wen , Elynn Chen , Yuzhou Chen , Qi Lei

Recurrent neural networks (RNNs) are capable of modeling temporal dependencies of complex sequential data. In general, current available structures of RNNs tend to concentrate on controlling the contributions of current and previous…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Pengfei Zhang , Jianru Xue , Cuiling Lan , Wenjun Zeng , Zhanning Gao , Nanning Zheng

Graph neural networks (GNNs) have emerged as a powerful tool for learning software engineering tasks including code completion, bug finding, and program repair. They benefit from leveraging program structure like control flow graphs, but…

Machine Learning · Computer Science 2020-10-27 David Bieber , Charles Sutton , Hugo Larochelle , Daniel Tarlow

Graph Neural Networks (GNNs) have emerged as the de facto standard for modeling graph data, with attention mechanisms and transformers significantly enhancing their performance on graph-based tasks. Despite these advancements, the…

Machine Learning · Computer Science 2025-04-07 Nikhil Shivakumar Nayak

Explaining graph neural networks (GNNs) has become more and more important recently. Higher-order interpretation schemes, such as GNN-LRP (layer-wise relevance propagation for GNN), emerged as powerful tools for unraveling how different…

Machine Learning · Computer Science 2026-05-22 Ping Xiong , Thomas Schnake , Grégoire Montavon , Klaus-Robert Müller , Shinichi Nakajima

Graph neural networks (GNNs) are a class of neural networks that allow to efficiently perform inference on data that is associated to a graph structure, such as, e.g., citation networks or knowledge graphs. While several variants of GNNs…

Neural and Evolutionary Computing · Computer Science 2018-02-27 Simone Scardapane , Steven Van Vaerenbergh , Danilo Comminiello , Aurelio Uncini

Large Language Models (LLMs) excel at intuitive, implicit reasoning. Guiding LLMs to construct thought chains can enhance their deliberate reasoning abilities, but also faces challenges such as hallucination. Knowledge Graphs (KGs) can…

Computation and Language · Computer Science 2025-03-07 Guangyi Liu , Yongqi Zhang , Yong Li , Quanming Yao

Deep learning techniques have become prominent in modern fault diagnosis for complex processes. In particular, convolutional neural networks (CNNs) have shown an appealing capacity to deal with multivariate time-series data by converting…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Saif S. S. Al-Wahaibi , Qiugang Lu

Graph Neural Networks (GNNs) have led to state-of-the-art performance on a variety of machine learning tasks such as recommendation, node classification and link prediction. Graph neural network models generate node embeddings by merging…

Machine Learning · Computer Science 2020-11-04 Yunpeng Weng , Xu Chen , Liang Chen , Wei Liu

\textit{Attention} computes the dependency between representations, and it encourages the model to focus on the important selective features. Attention-based models, such as Transformer and graph attention network (GAT), are widely utilized…

Machine Learning · Computer Science 2021-03-02 Kyungwoo Song , Yohan Jung , Dongjun Kim , Il-Chul Moon

Managing evolving graph data presents substantial challenges in storage and privacy, and training graph neural networks (GNNs) on such data often leads to catastrophic forgetting, impairing performance on earlier tasks. Despite existing…

Machine Learning · Computer Science 2025-05-29 Yinlin Zhu , Miao Hu , Di Wu