English
Related papers

Related papers: Learn Locally, Correct Globally: A Distributed Alg…

200 papers

Graphs are pervasive in the real-world, such as social network analysis, bioinformatics, and knowledge graphs. Graph neural networks (GNNs) have great ability in node classification, a fundamental task on graphs. Unfortunately, conventional…

Machine Learning · Computer Science 2024-09-05 Quan Li , Tianxiang Zhao , Lingwei Chen , Junjie Xu , Suhang Wang

Graph Neural Networks (GNNs) and their message passing framework that leverages both structural and feature information, have become a standard method for solving graph-based machine learning problems. However, these approaches still…

Machine Learning · Computer Science 2024-11-20 Simon Delarue , Thomas Bonald , Tiphaine Viard

Graph Convolutional Networks (GCNs) have achieved impressive empirical advancement across a wide variety of semi-supervised node classification tasks. Despite their great success, training GCNs on large graphs suffers from computational and…

Machine Learning · Computer Science 2021-11-02 Weilin Cong , Morteza Ramezani , Mehrdad Mahdavi

Graph Neural Networks (GNNs) have attracted considerable attention and have emerged as a new promising paradigm to process graph-structured data. GNNs are usually stacked to multiple layers and the node representations in each layer are…

Machine Learning · Computer Science 2020-09-25 Yihao Chen , Xin Tang , Xianbiao Qi , Chun-Guang Li , Rong Xiao

Graph Neural Networks (GNNs) are widely used today in recommendation systems, fraud detection, and node/link classification tasks. Real world GNNs continue to scale in size and require a large memory footprint for storing graphs and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-31 Jeongmin Brian Park , Kun Wu , Vikram Sharma Mailthody , Zaid Quresh , Scott Mahlke , Wen-mei Hwu

The message passing-based graph neural networks (GNNs) have achieved great success in many real-world applications. However, training GNNs on large-scale graphs suffers from the well-known neighbor explosion problem, i.e., the exponentially…

Machine Learning · Computer Science 2025-03-18 Zhihao Shi , Xize Liang , Jie Wang

Graphs are omnipresent and GNNs are a powerful family of neural networks for learning over graphs. Despite their popularity, scaling GNNs either by deepening or widening suffers from prevalent issues of unhealthy gradients,…

Machine Learning · Computer Science 2023-08-25 Ajay Jaiswal , Shiwei Liu , Tianlong Chen , Ying Ding , Zhangyang Wang

Social recommendation based on social network has achieved great success in improving the performance of recommendation system. Since social network (user-user relations) and user-item interactions are both naturally represented as…

Information Retrieval · Computer Science 2021-09-27 Yiming Zhang , Lingfei Wu , Qi Shen , Yitong Pang , Zhihua Wei , Fangli Xu , Ethan Chang , Bo Long

Graph Neural Networks (GNNs) have shown promising results in modeling graphs in various tasks. The training of GNNs, especially on specialized tasks such as bioinformatics, demands extensive expert annotations, which are expensive and…

Machine Learning · Computer Science 2025-05-27 Minhua Lin , Enyan Dai , Junjie Xu , Jinyuan Jia , Xiang Zhang , Suhang Wang

Consistency training is a popular method to improve deep learning models in computer vision and natural language processing. Graph neural networks (GNNs) have achieved remarkable performance in a variety of network science learning tasks,…

Machine Learning · Computer Science 2021-10-14 Cole Hawkins , Vassilis N. Ioannidis , Soji Adeshina , George Karypis

Graph Neural Networks (GNNs) are a powerful tool for handling structured graph data and addressing tasks such as node classification, graph classification, and clustering. However, the sparse nature of GNN computation poses new challenges…

Machine Learning · Computer Science 2023-08-24 Julia Bazinska , Andrei Ivanov , Tal Ben-Nun , Nikoli Dryden , Maciej Besta , Siyuan Shen , Torsten Hoefler

Graph Neural Networks (GNNs) have become a prominent approach for learning from graph-structured data. However, their effectiveness can be significantly compromised when the graph structure is suboptimal. To address this issue, Graph…

Machine Learning · Computer Science 2025-02-20 Shen Han , Zhiyao Zhou , Jiawei Chen , Zhezheng Hao , Sheng Zhou , Gang Wang , Yan Feng , Chun Chen , Can Wang

This paper presents FLGC, a simple yet effective fully linear graph convolutional network for semi-supervised and unsupervised learning. Instead of using gradient descent, we train FLGC based on computing a global optimal closed-form…

Machine Learning · Computer Science 2021-11-16 Yaoming Cai , Zijia Zhang , Zhihua Cai , Xiaobo Liu , Yao Ding , Pedram Ghamisi

Graph neural networks (GNNs) are widely used as surrogates for costly experiments and first-principles simulations to study the behavior of compounds at atomistic scale, and their architectural complexity is constantly increasing to enable…

Machine Learning · Computer Science 2026-05-04 Arindam Chowdhury , Massimiliano Lupo Pasini

In recent years, Graph Neural Networks (GNNs) have shown superior performance on diverse applications on real-world datasets. To improve the model capacity and alleviate the over-smoothing problem, several methods proposed to incorporate…

Machine Learning · Computer Science 2021-12-28 Lanning Wei , Huan Zhao , Zhiqiang He

Graph neural networks (GNNs) have been attracting increasing popularity due to their simplicity and effectiveness in a variety of fields. However, a large number of labeled data is generally required to train these networks, which could be…

Machine Learning · Computer Science 2020-10-26 Shengding Hu , Zheng Xiong , Meng Qu , Xingdi Yuan , Marc-Alexandre Côté , Zhiyuan Liu , Jian Tang

Graph Neural Networks (GNNs) training often necessitates gathering raw user data on a central server, which raises significant privacy concerns. Federated learning emerges as a solution, enabling collaborative model training without users…

Machine Learning · Computer Science 2024-10-01 Zhidong Gao , Yuanxiong Guo , Yanmin Gong

Training deep neural networks on large datasets containing high-dimensional data requires a large amount of computation. A solution to this problem is data-parallel distributed training, where a model is replicated into several…

Machine Learning · Computer Science 2021-03-18 Lusine Abrahamyan , Yiming Chen , Giannis Bekoulis , Nikos Deligiannis

In decision-making problems under uncertainty, predicting unknown parameters is often considered independent of the optimization part. Decision-focused learning (DFL) is a task-oriented framework that integrates prediction and optimization…

Machine Learning · Computer Science 2025-02-11 Haeun Jeon , Hyunglip Bae , Minsu Park , Chanyeong Kim , Woo Chang Kim

Graph neural network (GNN) has gained increasing popularity in recent years owing to its capability and flexibility in modeling complex graph structure data. Among all graph learning methods, hypergraph learning is a technique for exploring…

Machine Learning · Computer Science 2024-12-31 Tiehua Zhang , Yuze Liu , Zhishu Shen , Xingjun Ma , Peng Qi , Zhijun Ding , Jiong Jin