English
Related papers

Related papers: LTE4G: Long-Tail Experts for Graph Neural Networks

200 papers

Graph neural networks (GNN) have shown great success in learning from graph-structured data. They are widely used in various applications, such as recommendation, fraud detection, and search. In these domains, the graphs are typically…

Machine Learning · Computer Science 2021-08-04 Da Zheng , Chao Ma , Minjie Wang , Jinjing Zhou , Qidong Su , Xiang Song , Quan Gan , Zheng Zhang , George Karypis

In federated graph learning (FGL), a complete graph is divided into multiple subgraphs stored in each client due to privacy concerns, and all clients jointly train a global graph model by only transmitting model parameters. A pain point of…

Machine Learning · Computer Science 2025-03-26 Bo Yan , Zhongjian Zhang , Huabin Sun , Mengmei Zhang , Yang Cao , Chuan Shi

Textual graphs (TGs) are graphs whose nodes correspond to text (sentences or documents), which are widely prevalent. The representation learning of TGs involves two stages: (i) unsupervised feature extraction and (ii) supervised graph…

Computation and Language · Computer Science 2023-08-08 Keyu Duan , Qian Liu , Tat-Seng Chua , Shuicheng Yan , Wei Tsang Ooi , Qizhe Xie , Junxian He

Deploying deep models in real-world scenarios entails a number of challenges, including computational efficiency and real-world (e.g., long-tailed) data distributions. We address the combined challenge of learning long-tailed distributions…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jihun Kim , Dahyun Kim , Hyungrok Jung , Taeil Oh , Jonghyun Choi

Graphs are data structures used to represent irregular networks and are prevalent in numerous real-world applications. Previous methods directly model graph structures and achieve significant success. However, these methods encounter…

Machine Learning · Computer Science 2025-01-03 Shuo Yu , Yingbo Wang , Ruolin Li , Guchun Liu , Yanming Shen , Shaoxiong Ji , Bowen Li , Fengling Han , Xiuzhen Zhang , Feng Xia

Recent studies have shown that graph neural networks (GNNs) exhibit strong biases towards the node degree: they usually perform satisfactorily on high-degree nodes with rich neighbor information but struggle with low-degree nodes. Existing…

Machine Learning · Computer Science 2023-10-03 Mingxuan Ju , Tong Zhao , Wenhao Yu , Neil Shah , Yanfang Ye

In this work, we tackle the challenging problem of long-tailed image recognition. Previous long-tailed recognition approaches mainly focus on data augmentation or re-balancing strategies for the tail classes to give them more attention…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Weide Liu , Zhonghua Wu , Yiming Wang , Henghui Ding , Fayao Liu , Jie Lin , Guosheng Lin

Graph Neural Networks (GNNs) are deep-learning architectures designed for graph-type data, where understanding relationships among individual observations is crucial. However, achieving promising GNN performance, especially on unseen data,…

Machine Learning · Computer Science 2024-05-22 Lequan Lin , Dai Shi , Andi Han , Zhiyong Wang , Junbin Gao

Language Models (LMs) are increasingly challenging the dominance of domain-specific models, such as Graph Neural Networks (GNNs) and Graph Transformers (GTs), in graph learning tasks. Following this trend, we propose a novel approach that…

Computation and Language · Computer Science 2026-01-27 Zhe Xu , Kaveh Hassani , Si Zhang , Hanqing Zeng , Michihiro Yasunaga , Limei Wang , Dongqi Fu , Ning Yao , Bo Long , Hanghang Tong

Graph neural networks (GNNs) are important tools for transductive learning tasks, such as node classification in graphs, due to their expressive power in capturing complex interdependency between nodes. To enable graph neural network…

Machine Learning · Computer Science 2022-05-17 Man Wu , Shirui Pan , Lan Du , Xingquan Zhu

Different from deep neural networks for non-graph data classification, graph neural networks (GNNs) leverage the information exchange between nodes (or samples) when representing nodes. The category distribution shows an imbalance or even a…

Machine Learning · Computer Science 2021-10-19 Rui Wang , Weixuan Xiong , Qinghu Hou , Ou Wu

Heterogeneous graph neural networks (HGNNs) have attracted increasing research interest in recent three years. Most existing HGNNs fall into two classes. One class is meta-path-based HGNNs which either require domain knowledge to handcraft…

Machine Learning · Computer Science 2022-09-02 Nan Wu , Chaofan Wang

Graph neural networks (GNNs) have been demonstrated to be powerful in modeling graph-structured data. However, training GNNs usually requires abundant task-specific labeled data, which is often arduously expensive to obtain. One effective…

Machine Learning · Computer Science 2020-06-30 Ziniu Hu , Yuxiao Dong , Kuansan Wang , Kai-Wei Chang , Yizhou Sun

Federated Graph Learning (FGL) is tasked with training machine learning models, such as Graph Neural Networks (GNNs), for multiple clients, each with its own graph data. Existing methods usually assume that each client has both node…

Machine Learning · Computer Science 2024-11-14 Xingbo Fu , Song Wang , Yushun Dong , Binchi Zhang , Chen Chen , Jundong Li

Although Graph Neural Networks (GNNs) have been successful in node classification tasks, their performance heavily relies on the availability of a sufficient number of labeled nodes per class. In real-world situations, not all classes have…

Machine Learning · Computer Science 2023-06-27 Sungwon Kim , Junseok Lee , Namkyeong Lee , Wonjoong Kim , Seungyoon Choi , Chanyoung Park

Graph neural networks (GNN) have shown great advantages in many graph-based learning tasks but often fail to predict accurately for a task-based on sets of nodes such as link/motif prediction and so on. Many works have recently proposed to…

Machine Learning · Computer Science 2022-06-24 Haorui Wang , Haoteng Yin , Muhan Zhang , Pan Li

Graph Neural Networks (GNNs) for prediction tasks like node classification or edge prediction have received increasing attention in recent machine learning from graphically structured data. However, a large quantity of labeled graphs is…

Machine Learning · Computer Science 2021-11-22 Yuexin Wu , Yichong Xu , Aarti Singh , Yiming Yang , Artur Dubrawski

Graph Neural Networks (GNNs) are a promising deep learning approach for circumventing many real-world problems on graph-structured data. However, these models usually have at least one of four fundamental limitations: over-smoothing,…

Machine Learning · Computer Science 2022-10-03 Xun Liu , Alex Hay-Man Ng , Fangyuan Lei , Yikuan Zhang , Zhengmin Li

Graph Neural Networks (GNNs) have become essential tools for learning on relational data, yet the performance of a single GNN is often limited by the heterogeneity present in real-world graphs. Recent advances in Mixture-of-Experts (MoE)…

Machine Learning · Computer Science 2025-10-22 Gangda Deng , Yuxin Yang , Ömer Faruk Akgül , Hanqing Zeng , Yinglong Xia , Rajgopal Kannan , Viktor Prasanna

Graph Neural Networks (GNNs) often perform better for high-degree nodes than low-degree nodes on node classification tasks. This degree bias can reinforce social marginalization by, e.g., privileging celebrities and other high-degree actors…

Machine Learning · Computer Science 2024-11-04 Arjun Subramonian , Jian Kang , Yizhou Sun