English
Related papers

Related papers: Pre-Training Graph Neural Networks for Generic Str…

200 papers

Extracting informative representations of molecules using Graph neural networks (GNNs) is crucial in AI-driven drug discovery. Recently, the graph research community has been trying to replicate the success of self-supervised pretraining in…

Machine Learning · Computer Science 2022-11-03 Ruoxi Sun , Hanjun Dai , Adams Wei Yu

Graph neural networks (GNN) suffer from severe inefficiency. It is mainly caused by the exponential growth of node dependency with the increase of layers. It extremely limits the application of stochastic optimization algorithms so that the…

Machine Learning · Computer Science 2024-04-23 Hongyuan Zhang , Yanan Zhu , Xuelong Li

Graph Neural Networks (GNNs), neural network architectures targeted to learning representations of graphs, have become a popular learning model for prediction tasks on nodes, graphs and configurations of points, with wide success in…

Machine Learning · Computer Science 2022-04-19 Stefanie Jegelka

Graph neural networks (GNN) have shown outstanding applications in many fields where data is fundamentally represented as graphs (e.g., chemistry, biology, recommendation systems). In this vein, communication networks comprise many…

Deep learning methods for graphs achieve remarkable performance on many node-level and graph-level prediction tasks. However, despite the proliferation of the methods and their success, prevailing Graph Neural Networks (GNNs) neglect…

Machine Learning · Computer Science 2020-11-10 Emily Alsentzer , Samuel G. Finlayson , Michelle M. Li , Marinka Zitnik

To improve the performance of Graph Neural Networks (GNNs), Graph Structure Learning (GSL) has been extensively applied to reconstruct or refine original graph structures, effectively addressing issues like heterophily, over-squashing, and…

Machine Learning · Computer Science 2024-11-13 Yilun Zheng , Zhuofan Zhang , Ziming Wang , Xiang Li , Sitao Luan , Xiaojiang Peng , Lihui Chen

Convolution Neural Networks on Graphs are important generalization and extension of classical CNNs. While previous works generally assumed that the graph structures of samples are regular with unified dimensions, in many applications, they…

Machine Learning · Computer Science 2017-08-17 Ruoyu Li , Junzhou Huang

The task of graph node classification is often approached by utilizing a local Graph Neural Network (GNN), that learns only local information from the node input features and their adjacency. In this paper, we propose to improve the…

Machine Learning · Computer Science 2024-06-18 Moshe Eliasof , Eran Treister

Training graph neural networks on large datasets has long been a challenge. Traditional approaches include efficiently representing the whole graph in-memory, designing parameter efficient and sampling-based models, and graph partitioning…

Machine Learning · Computer Science 2024-11-19 Dmytro Lopushanskyy , Borun Shi

Graph Neural Networks (GNNs) have achieved state-of-the-art performance in solving graph classification tasks. However, most GNN architectures aggregate information from all nodes and edges in a graph, regardless of their relevance to the…

Machine Learning · Statistics 2024-04-19 Pablo Sanchez-Martin , Kinaan Aamir Khan , Isabel Valera

Exploring the complex structure of the human brain is crucial for understanding its functionality and diagnosing brain disorders. Thanks to advancements in neuroimaging technology, a novel approach has emerged that involves modeling the…

Machine Learning · Computer Science 2024-06-06 Xuexiong Luo , Jia Wu , Jian Yang , Shan Xue , Amin Beheshti , Quan Z. Sheng , David McAlpine , Paul Sowman , Alexis Giral , Philip S. Yu

Graph neural networks (GNNs) use graph convolutions to exploit network invariances and learn meaningful feature representations from network data. However, on large-scale graphs convolutions incur in high computational cost, leading to…

Machine Learning · Computer Science 2022-06-29 Juan Cervino , Luana Ruiz , Alejandro Ribeiro

In this paper, we explore a novel model reusing task tailored for graph neural networks (GNNs), termed as "deep graph reprogramming". We strive to reprogram a pre-trained GNN, without amending raw node features nor model parameters, to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Yongcheng Jing , Chongbin Yuan , Li Ju , Yiding Yang , Xinchao Wang , Dacheng Tao

Despite much research, Graph Neural Networks (GNNs) still do not display the favorable scaling properties of other deep neural networks such as Convolutional Neural Networks and Transformers. Previous work has identified issues such as…

Machine Learning · Computer Science 2023-12-19 Ameen Ali , Hakan Cevikalp , Lior Wolf

Graph structure learning (GSL), which aims to learn the adjacency matrix for graph neural networks (GNNs), has shown great potential in boosting the performance of GNNs. Most existing GSL works apply a joint learning framework where the…

Machine Learning · Computer Science 2023-03-02 Jianan Zhao , Qianlong Wen , Mingxuan Ju , Chuxu Zhang , Yanfang Ye

Graph Neural Networks (GNNs) have become a central tool for learning on graph-structured data, yet their applicability to real-world systems remains limited by key challenges such as scalability, temporality, directionality, data…

Machine Learning · Computer Science 2025-10-28 Emanuele Rossi

Graph Neural Networks (GNNs) are an effective framework for representation learning of graphs. GNNs follow a neighborhood aggregation scheme, where the representation vector of a node is computed by recursively aggregating and transforming…

Machine Learning · Computer Science 2019-02-26 Keyulu Xu , Weihua Hu , Jure Leskovec , Stefanie Jegelka

Recently, graph Convolutional Neural Networks (graph CNNs) have been widely used for graph data representation and semi-supervised learning tasks. However, existing graph CNNs generally use a fixed graph which may be not optimal for…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Bo Jiang , Ziyan Zhang , Doudou Lin , Jin Tang

Recent advancements in graph learning have revolutionized the way to understand and analyze data with complex structures. Notably, Graph Neural Networks (GNNs), i.e. neural network architectures designed for learning graph representations,…

Machine Learning · Computer Science 2024-07-09 Yu Huang , Min Zhou , Menglin Yang , Zhen Wang , Muhan Zhang , Jie Wang , Hong Xie , Hao Wang , Defu Lian , Enhong Chen

Graph Neural Networks (GNNs) are popular models for graph learning problems. GNNs show strong empirical performance in many practical tasks. However, the theoretical properties have not been completely elucidated. In this paper, we…

Machine Learning · Computer Science 2024-03-26 Ryoma Sato