English
Related papers

Related papers: Pre-training Graph Neural Networks with Kernels

200 papers

Graph learning is currently dominated by graph kernels, which, while powerful, suffer some significant limitations. Convolutional Neural Networks (CNNs) offer a very appealing alternative, but processing graphs with CNNs is not trivial. To…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Antoine Jean-Pierre Tixier , Giannis Nikolentzos , Polykarpos Meladianos , Michalis Vazirgiannis

Graph neural networks (GNNs) have received massive attention in the field of machine learning on graphs. Inspired by the success of neural networks, a line of research has been conducted to train GNNs to deal with various tasks, such as…

Machine Learning · Computer Science 2022-04-11 Manh Tuan Do , Noseong Park , Kijung Shin

Graphs neural networks (GNNs) learn node features by aggregating and combining neighbor information, which have achieved promising performance on many graph tasks. However, GNNs are mostly treated as black-boxes and lack human intelligible…

Machine Learning · Computer Science 2020-06-05 Hao Yuan , Jiliang Tang , Xia Hu , Shuiwang Ji

Lots of learning tasks require dealing with graph data which contains rich relation information among elements. Modeling physics systems, learning molecular fingerprints, predicting protein interface, and classifying diseases demand a model…

Machine Learning · Computer Science 2021-10-07 Jie Zhou , Ganqu Cui , Shengding Hu , Zhengyan Zhang , Cheng Yang , Zhiyuan Liu , Lifeng Wang , Changcheng Li , Maosong Sun

Graph neural networks (GNNs) have demonstrated great success in representation learning for graph-structured data. The layer-wise graph convolution in GNNs is shown to be powerful at capturing graph topology. During this process, GNNs are…

Machine Learning · Computer Science 2021-12-10 Mingxuan Ju , Shifu Hou , Yujie Fan , Jianan Zhao , Liang Zhao , Yanfang Ye

This study aims to build a pre-trained Graph Neural Network (GNN) model on molecules without human annotations or prior knowledge. Although various attempts have been proposed to overcome limitations in acquiring labeled molecules, the…

Machine Learning · Computer Science 2024-12-23 Van Thuy Hoang , O-Joun Lee

Graph neural networks (GNNs) have attracted much attention due to their ability to leverage the intrinsic geometries of the underlying data. Although many different types of GNN models have been developed, with many benchmarking procedures…

Network data can be conveniently modeled as a graph signal, where data values are assigned to nodes of a graph that describes the underlying network topology. Successful learning from network data is built upon methods that effectively…

Machine Learning · Computer Science 2021-05-26 Fernando Gama , Elvin Isufi , Geert Leus , Alejandro Ribeiro

Property prediction on molecular graphs is an important application of Graph Neural Networks. Recently, unlabeled molecular data has become abundant, which facilitates the rapid development of self-supervised learning for GNNs in the…

Machine Learning · Computer Science 2023-10-31 Kha-Dinh Luong , Ambuj Singh

Graph neural network (GNN) is a popular tool to learn the lower-dimensional representation of a graph. It facilitates the applicability of machine learning tasks on graphs by incorporating domain-specific features. There are various options…

Machine Learning · Computer Science 2020-08-21 Md. Khaledur Rahman

Pre-training on graph neural networks (GNNs) aims to learn transferable knowledge for downstream tasks with unlabeled data, and it has recently become an active research area. The success of graph pre-training models is often attributed to…

Machine Learning · Computer Science 2023-11-22 Jiarong Xu , Renhong Huang , Xin Jiang , Yuxuan Cao , Carl Yang , Chunping Wang , Yang Yang

Graph Neural Networks (GNNs) have become a standard approach for learning from graph-structured data. However, their reliance on parametric classifiers (most often linear softmax layers) limits interpretability and sometimes hinders…

Machine Learning · Computer Science 2026-02-03 Zeljko Bolevic , Milos Brajovic , Isidora Stankovic , Ljubisa Stankovic

A long-standing goal in deep learning has been to characterize the learning behavior of black-box models in a more interpretable manner. For graph neural networks (GNNs), considerable advances have been made in formalizing what functions…

Machine Learning · Computer Science 2024-06-19 Chenxiao Yang , Qitian Wu , David Wipf , Ruoyu Sun , Junchi Yan

Graph Neural Networks (GNNs), a generalization of deep neural networks on graph data have been widely used in various domains, ranging from drug discovery to recommender systems. However, GNNs on such applications are limited when there are…

Machine Learning · Computer Science 2021-11-09 Debmalya Mandal , Sourav Medya , Brian Uzzi , Charu Aggarwal

This paper is devoted to signal processing on point-clouds by means of neural networks. Nowadays, state-of-the-art in image processing and computer vision is mostly based on training deep convolutional neural networks on large datasets.…

Machine Learning · Computer Science 2021-04-06 Amitoz Azad , Julien Rabin , Abderrahim Elmoataz

Graph Neural Networks (GNN) have recently gained popularity in the forecasting domain due to their ability to model complex spatial and temporal patterns in tasks such as traffic forecasting and region-based demand forecasting. Most of…

Machine Learning · Computer Science 2023-12-08 Abishek Sriramulu , Nicolas Fourrier , Christoph Bergmeir

Graph Neural Networks (GNNs) have shown great ability in modeling graph-structured data for various domains. However, GNNs are known as black-box models that lack interpretability. Without understanding their inner working, we cannot fully…

Machine Learning · Computer Science 2022-10-06 Enyan Dai , Suhang Wang

Graphs can model complex relationships between objects, enabling a myriad of Web applications such as online page/article classification and social recommendation. While graph neural networks(GNNs) have emerged as a powerful tool for graph…

Machine Learning · Computer Science 2023-02-28 Zemin Liu , Xingtong Yu , Yuan Fang , Xinming Zhang

Extracting informative representations of molecules using Graph neural networks (GNNs) is crucial in AI-driven drug discovery. Recently, the graph research community has been trying to replicate the success of self-supervised pretraining in…

Machine Learning · Computer Science 2022-11-03 Ruoxi Sun , Hanjun Dai , Adams Wei Yu

Graph neural networks (GNNs) are widely applied in graph data modeling. However, existing GNNs are often trained in a task-driven manner that fails to fully capture the intrinsic nature of the graph structure, resulting in sub-optimal node…

Machine Learning · Computer Science 2024-07-17 Zhenhua Huang , Kunhao Li , Shaojie Wang , Zhaohong Jia , Wentao Zhu , Sharad Mehrotra