中文
相关论文

相关论文: TuneUp: A Simple Improved Training Strategy for Gr…

200 篇论文

Scalability of graph neural networks remains one of the major challenges in graph machine learning. Since the representation of a node is computed by recursively aggregating and transforming representation vectors of its neighboring nodes…

机器学习 · 计算机科学 2021-06-10 Zengfeng Huang , Shengzhong Zhang , Chong Xi , Tang Liu , Min Zhou

Graph neural networks (GNNs) have achieved remarkable success across a wide range of applications, such as recommendation, drug discovery, and question answering. Behind the success of GNNs lies the backpropagation (BP) algorithm, which is…

机器学习 · 计算机科学 2024-04-16 Namyong Park , Xing Wang , Antoine Simoulin , Shuai Yang , Grey Yang , Ryan Rossi , Puja Trivedi , Nesreen Ahmed

Neural network training is inherently sequential where the layers finish the forward propagation in succession, followed by the calculation and back-propagation of gradients (based on a loss function) starting from the last layer. The…

机器学习 · 计算机科学 2023-12-01 Vahid Janfaza , Shantanu Mandal , Farabi Mahmud , Abdullah Muzahid

Graph neural networks (GNNs) are emerging for machine learning research on graph-structured data. GNNs achieve state-of-the-art performance on many tasks, but they face scalability challenges when it comes to real-world applications that…

机器学习 · 计算机科学 2026-04-02 Shichang Zhang , Atefeh Sohrabizadeh , Cheng Wan , Zijie Huang , Ziniu Hu , Yewen Wang , Yingyan , Lin , Jason Cong , Yizhou Sun

To improve the performance of Graph Neural Networks (GNNs), Graph Structure Learning (GSL) has been extensively applied to reconstruct or refine original graph structures, effectively addressing issues like heterophily, over-squashing, and…

机器学习 · 计算机科学 2024-11-13 Yilun Zheng , Zhuofan Zhang , Ziming Wang , Xiang Li , Sitao Luan , Xiaojiang Peng , Lihui Chen

Graph Neural Networks (GNNs) have greatly advanced the semi-supervised node classification task on graphs. The majority of existing GNNs are trained in an end-to-end manner that can be viewed as tackling a bi-level optimization problem.…

机器学习 · 计算机科学 2023-07-20 Haoyu Han , Xiaorui Liu , Haitao Mao , MohamadAli Torkamani , Feng Shi , Victor Lee , Jiliang Tang

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art method for graph-based learning tasks. However, training GCNs at scale is still challenging, hindering both the exploration of more sophisticated GCN architectures and…

机器学习 · 计算机科学 2022-03-29 Cheng Wan , Youjie Li , Ang Li , Nam Sung Kim , Yingyan Lin

In this paper, we study using graph neural networks (GNNs) for \textit{multi-node representation learning}, where a representation for a set of more than one node (such as a link) is to be learned. Existing GNNs are mainly designed to learn…

机器学习 · 计算机科学 2025-03-11 Xiyuan Wang , Pan Li , Muhan Zhang

Graph convolutional neural networks (GCNNs) have received much attention recently, owing to their capability in handling graph-structured data. Among the existing GCNNs, many methods can be viewed as instances of a neural message passing…

机器学习 · 计算机科学 2021-03-19 Tien Huu Do , Duc Minh Nguyen , Giannis Bekoulis , Adrian Munteanu , Nikos Deligiannis

Graph neural networks (GNNs) extend convolutional neural networks (CNNs) to graph-based data. A question that arises is how much performance improvement does the underlying graph structure in the GNN provide over the CNN (that ignores this…

机器学习 · 计算机科学 2020-12-17 Lavender Yao Jiang , John Shi , Mark Cheung , Oren Wright , José M. F. Moura

Link prediction is a fundamental problem in many graph based applications, such as protein-protein interaction prediction. Graph neural network (GNN) has recently been widely used for link prediction. However, existing GNN based link…

机器学习 · 计算机科学 2023-03-02 Kai-Lang Yao , Wu-Jun Li

Graph Neural Networks (GNNs) have become the backbone for a myriad of tasks pertaining to graphs and similar topological data structures. While many works have been established in domains related to node and graph classification/regression…

机器学习 · 计算机科学 2022-09-07 Appan Rakaraddi , Siew Kei Lam , Mahardhika Pratama , Marcus De Carvalho

Graph neural networks (GNNs) have emerged as a powerful tool for learning software engineering tasks including code completion, bug finding, and program repair. They benefit from leveraging program structure like control flow graphs, but…

机器学习 · 计算机科学 2020-10-27 David Bieber , Charles Sutton , Hugo Larochelle , Daniel Tarlow

In this work, we propose to train a graph neural network via resampling from a graphon estimate obtained from the underlying network data. More specifically, the graphon or the link probability matrix of the underlying network is first…

机器学习 · 计算机科学 2021-09-07 Ziqing Hu , Yihao Fang , Lizhen Lin

Textual graphs (TGs) are graphs whose nodes correspond to text (sentences or documents), which are widely prevalent. The representation learning of TGs involves two stages: (i) unsupervised feature extraction and (ii) supervised graph…

计算与语言 · 计算机科学 2023-08-08 Keyu Duan , Qian Liu , Tat-Seng Chua , Shuicheng Yan , Wei Tsang Ooi , Qizhe Xie , Junxian He

End-to-end training of graph neural networks (GNN) on large graphs presents several memory and computational challenges, and limits the application to shallow architectures as depth exponentially increases the memory and space complexities.…

机器学习 · 计算机科学 2023-09-06 Oscar Pina , Verónica Vilaplana

Graph Neural Networks (GNNs) have shown success in learning from graph structured data containing node/edge feature information, with application to social networks, recommendation, fraud detection and knowledge graph reasoning. In this…

机器学习 · 计算机科学 2021-11-24 Xiang Song , Runjie Ma , Jiahang Li , Muhan Zhang , David Paul Wipf

Training graph neural networks (GNNs) on large graphs is complex and extremely time consuming. This is attributed to overheads caused by sparse matrix multiplication, which are sidestepped when training multi-layer perceptrons (MLPs) with…

机器学习 · 计算机科学 2023-04-11 Xiaotian Han , Tong Zhao , Yozen Liu , Xia Hu , Neil Shah

Self-supervised learning has gradually emerged as a powerful technique for graph representation learning. However, transferable, generalizable, and robust representation learning on graph data still remains a challenge for pre-training…

机器学习 · 计算机科学 2021-12-13 Pengyong Li , Jun Wang , Ziliang Li , Yixuan Qiao , Xianggen Liu , Fei Ma , Peng Gao , Seng Song , Guotong Xie

Graph Neural Networks (GNNs) require a large number of labeled graph samples to obtain good performance on the graph classification task. The performance of GNNs degrades significantly as the number of labeled graph samples decreases. To…

机器学习 · 计算机科学 2023-09-20 Abdullah Alchihabi , Yuhong Guo