English
Related papers

Related papers: Pre-training Graph Neural Networks with Structural…

200 papers

Graph neural networks (GNNs) have been applied to a large variety of applications in materials science and chemistry. Here, we recapitulate the graph construction for crystalline (periodic) materials and investigate its impact on the GNNs…

Machine Learning · Computer Science 2023-08-10 Robin Ruff , Patrick Reiser , Jan Stühmer , Pascal Friederich

Recent works have demonstrated the potential of Graph Neural Networks (GNN) for network intrusion detection. Despite their advantages, a significant gap persists between real-world scenarios, where detection speed is critical, and existing…

Machine Learning · Computer Science 2024-06-21 Louis Van Langendonck , Ismael Castell-Uroz , Pere Barlet-Ros

Graph Neural Networks (GNNs) have gained significant attention owing to their ability to handle graph-structured data and the improvement in practical applications. However, many of these models prioritize high utility performance, such as…

Machine Learning · Computer Science 2023-09-20 Yi Zhang , Yuying Zhao , Zhaoqing Li , Xueqi Cheng , Yu Wang , Olivera Kotevska , Philip S. Yu , Tyler Derr

Pre-trained models have been successful in many protein engineering tasks. Most notably, sequence-based models have achieved state-of-the-art performance on protein fitness prediction while structure-based models have been used…

Machine Learning · Computer Science 2023-07-25 Antonia Boca , Simon Mathis

Various machine learning models have been used to predict the properties of polycrystalline materials, but none of them directly consider the physical interactions among neighboring grains despite such microscopic interactions critically…

Materials Science · Physics 2021-07-16 Minyi Dai , Mehmet F. Demirel , Yingyu Liang , Jia-Mian Hu

Early detection of faults is of importance to avoid catastrophic accidents and ensure safe operation of machinery. A novel graph neural network-based fault detection method is proposed to build a bridge between AI and real-world running…

Machine Learning · Computer Science 2022-04-26 Xusheng Du , Jiong Yu

Graph learning models have demonstrated great prowess in learning expressive representations from large-scale graph data in a wide variety of real-world scenarios. As a prevalent strategy for training powerful graph learning models, the…

Machine Learning · Computer Science 2025-06-11 Xingbo Fu , Zehong Wang , Zihan Chen , Jiazheng Li , Yaochen Zhu , Zhenyu Lei , Cong Shen , Yanfang Ye , Chuxu Zhang , Jundong Li

Recently, graph neural networks (GNNs) have gained much attention as a growing area of deep learning capable of learning on graph-structured data. However, the computational and memory requirements for training GNNs on large-scale graphs…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-13 Nikolai Merkel , Daniel Stoll , Ruben Mayer , Hans-Arno Jacobsen

In recent years, with the rapid enhancement of computing power, deep learning methods have been widely applied in wireless networks and achieved impressive performance. To effectively exploit the information of graph-structured data as well…

Information Theory · Computer Science 2021-11-19 S. He , S. Xiong , Y. Ou , J. Zhang , J. Wang , Y. Huang , Y. Zhang

We introduce a novel masked pre-training technique for graph neural networks (GNNs) applied to computational fluid dynamics (CFD) problems. By randomly masking up to 40\% of input mesh nodes during pre-training, we force the model to learn…

Machine Learning · Computer Science 2025-08-27 Paul Garnier , Vincent Lannelongue , Jonathan Viquerat , Elie Hachem

The recent success of graph neural networks has significantly boosted molecular property prediction, advancing activities such as drug discovery. The existing deep neural network methods usually require large training dataset for each…

Machine Learning · Computer Science 2021-02-17 Zhichun Guo , Chuxu Zhang , Wenhao Yu , John Herr , Olaf Wiest , Meng Jiang , Nitesh V. Chawla

Semi-supervised node classification in graphs is a fundamental problem in graph mining, and the recently proposed graph neural networks (GNNs) have achieved unparalleled results on this task. Due to their massive success, GNNs have…

Machine Learning · Computer Science 2019-06-19 Oleksandr Shchur , Maximilian Mumme , Aleksandar Bojchevski , Stephan Günnemann

Graph transformers have gained popularity in various graph-based tasks by addressing challenges faced by traditional Graph Neural Networks. However, the quadratic complexity of self-attention operations and the extensive layering in graph…

Machine Learning · Computer Science 2023-09-20 Reza Shirkavand , Heng Huang

Signed Graph Neural Networks (SGNNs) are effective in learning expressive representations for signed graphs but typically require substantial task-specific labels, limiting their applicability in label-scarce industrial scenarios. In…

Machine Learning · Computer Science 2025-08-19 Zian Zhai , Sima Qing , Xiaoyang Wang , Wenjie Zhang

Graph neural networks (GNNs) are designed to extract latent patterns from graph-structured data, making them particularly well suited for crystal representation learning. Here, we propose a GNN model tailored for estimating electronic…

Materials Science · Physics 2026-04-07 Yuxuan Zeng , Wei Cao , Yijing Zuo , Fang Lyu , Wenhao Xie , Tan Peng , Yue Hou , Ling Miao , Ziyu Wang , Jing Shi

Graph Neural Networks (GNNs) have emerged as a flexible and powerful approach for learning over graphs. Despite this success, existing GNNs are constrained by their local message-passing architecture and are provably limited in their…

Machine Learning · Computer Science 2021-10-29 Rajat Talak , Siyi Hu , Lisa Peng , Luca Carlone

Recent research has demonstrated the efficacy of pre-training graph neural networks (GNNs) to capture the transferable graph semantics and enhance the performance of various downstream tasks. However, the semantic knowledge learned from…

Machine Learning · Computer Science 2023-12-19 Mouxiang Chen , Zemin Liu , Chenghao Liu , Jundong Li , Qiheng Mao , Jianling Sun

Pretraining plays a pivotal role in acquiring generalized knowledge from large-scale data, achieving remarkable successes as evidenced by large models in CV and NLP. However, progress in the graph domain remains limited due to fundamental…

Artificial Intelligence · Computer Science 2024-06-21 Yu Song , Haitao Mao , Jiachen Xiao , Jingzhe Liu , Zhikai Chen , Wei Jin , Carl Yang , Jiliang Tang , Hui Liu

Graph neural networks (GNNs) have been widely applied in the recommendation tasks and have obtained very appealing performance. However, most GNN-based recommendation methods suffer from the problem of data sparsity in practice. Meanwhile,…

Information Retrieval · Computer Science 2021-12-15 Yiqi Wang , Chaozhuo Li , Zheng Liu , Mingzheng Li , Jiliang Tang , Xing Xie , Lei Chen , Philip S. Yu

Graph neural networks (GNNs) have received massive attention in the field of machine learning on graphs. Inspired by the success of neural networks, a line of research has been conducted to train GNNs to deal with various tasks, such as…

Machine Learning · Computer Science 2022-04-11 Manh Tuan Do , Noseong Park , Kijung Shin
‹ Prev 1 8 9 10 Next ›