English
Related papers

Related papers: SAILOR: Structural Augmentation Based Tail Node Re…

200 papers

Graph neural networks (GNNs) have evolved into one of the most popular deep learning architectures. However, GNNs suffer from over-smoothing node information and, therefore, struggle to solve tasks where global graph properties are…

Machine Learning · Computer Science 2023-08-31 Bernhard Schäfl , Lukas Gruber , Johannes Brandstetter , Sepp Hochreiter

Recently, motivated by real applications, a major research direction in graph neural networks (GNNs) is to explore deeper structures. For instance, the graph connectivity is not always consistent with the label distribution (e.g., the…

Machine Learning · Computer Science 2022-10-26 Lecheng Zheng , Dongqi Fu , Ross Maciejewski , Jingrui He

Graph neural networks (GNN) are powerful models for many graph-structured tasks. Existing models often assume that the complete structure of the graph is available during training. In practice, however, graph-structured data is usually…

Machine Learning · Computer Science 2022-03-29 Chen Wang , Yuheng Qiu , Dasong Gao , Sebastian Scherer

Graphical models capture relations between entities in a wide range of applications including social networks, biology, and natural language processing, among others. Graph neural networks (GNN) are neural models that operate over graphs,…

Machine Learning · Computer Science 2024-02-08 Xu Zheng , Farhad Shirani , Tianchun Wang , Shouwei Gao , Wenqian Dong , Wei Cheng , Dongsheng Luo

Recent studies have highlighted the limitations of message-passing based graph neural networks (GNNs), e.g., limited model expressiveness, over-smoothing, over-squashing, etc. To alleviate these issues, Graph Transformers (GTs) have been…

Machine Learning · Computer Science 2023-03-06 Qiheng Mao , Zemin Liu , Chenghao Liu , Jianling Sun

Graph Neural Networks (GNNs) with numerical node features and graph structure as inputs have demonstrated superior performance on various supervised learning tasks with graph data. However the numerical node features utilized by GNNs are…

Machine Learning · Computer Science 2022-06-20 Jiuhai Chen , Jonas Mueller , Vassilis N. Ioannidis , Tom Goldstein , David Wipf

Under circumstances of heterophily, where nodes with different labels tend to be connected based on semantic meanings, Graph Neural Networks (GNNs) often exhibit suboptimal performance. Current studies on graph heterophily mainly focus on…

Machine Learning · Computer Science 2024-11-13 Yilun Zheng , Jiahao Xu , Lihui Chen

Graph Neural Networks (GNNs) extend basic Neural Networks (NNs) by additionally making use of graph structure based on the relational inductive bias (edge bias), rather than treating the nodes as collections of independent and identically…

Machine Learning · Computer Science 2023-11-07 Sitao Luan , Chenqing Hua , Qincheng Lu , Jiaqi Zhu , Xiao-Wen Chang , Doina Precup

Deep long-tailed learning aims to train useful deep networks on practical, real-world imbalanced distributions, wherein most labels of the tail classes are associated with a few samples. There has been a large body of work to train…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Harsh Rangwani , Naman Jaswani , Tejan Karmali , Varun Jampani , R. Venkatesh Babu

Graph Neural Networks (GNNs) have led to state-of-the-art performance on a variety of machine learning tasks such as recommendation, node classification and link prediction. Graph neural network models generate node embeddings by merging…

Machine Learning · Computer Science 2020-11-04 Yunpeng Weng , Xu Chen , Liang Chen , Wei Liu

Graph neural networks (GNNs) have emerged as the standard method for numerous tasks on graph-structured data such as node classification. However, real-world graphs are often evolving over time and even new classes may arise. We model these…

Machine Learning · Computer Science 2021-12-21 Lukas Galke , Benedikt Franke , Tobias Zielke , Ansgar Scherp

Graph Neural Networks (GNNs), neural network architectures targeted to learning representations of graphs, have become a popular learning model for prediction tasks on nodes, graphs and configurations of points, with wide success in…

Machine Learning · Computer Science 2022-04-19 Stefanie Jegelka

Recently, graph neural networks (GNNs) have shown prominent performance in graph representation learning by leveraging knowledge from both graph structure and node features. However, most of them have two major limitations. First, GNNs can…

Machine Learning · Computer Science 2022-06-20 Wentao Zhang , Zeang Sheng , Mingyu Yang , Yang Li , Yu Shen , Zhi Yang , Bin Cui

In recent years, graph neural networks (GNNs) have emerged as a successful tool in a variety of graph-related applications. However, the performance of GNNs can be deteriorated when noisy connections occur in the original graph structures;…

Machine Learning · Computer Science 2022-01-19 Yixin Liu , Yu Zheng , Daokun Zhang , Hongxu Chen , Hao Peng , Shirui Pan

In this paper, we provide a theory of using graph neural networks (GNNs) for multi-node representation learning (where we are interested in learning a representation for a set of more than one node, such as link). We know that GNN is…

Machine Learning · Computer Science 2022-01-19 Muhan Zhang , Pan Li , Yinglong Xia , Kai Wang , Long Jin

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

Machine Learning · Computer Science 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo

Graph structured data, specifically text-attributed graphs (TAG), effectively represent relationships among varied entities. Such graphs are essential for semi-supervised node classification tasks. Graph Neural Networks (GNNs) have emerged…

Machine Learning · Computer Science 2024-04-18 Kaiwen Dong , Zhichun Guo , Nitesh V. Chawla

Existing Graph Neural Networks (GNNs) usually assume a balanced situation where both the class distribution and the node degree distribution are balanced. However, in real-world situations, we often encounter cases where a few classes…

Machine Learning · Computer Science 2022-09-09 Sukwon Yun , Kibum Kim , Kanghoon Yoon , Chanyoung Park

Graph neural networks, a powerful deep learning tool to model graph-structured data, have demonstrated remarkable performance on numerous graph learning tasks. To address the data noise and data scarcity issues in deep graph learning, the…

Machine Learning · Computer Science 2022-11-22 Kaize Ding , Zhe Xu , Hanghang Tong , Huan Liu

Deep learning methods for graphs achieve remarkable performance on many node-level and graph-level prediction tasks. However, despite the proliferation of the methods and their success, prevailing Graph Neural Networks (GNNs) neglect…

Machine Learning · Computer Science 2020-11-10 Emily Alsentzer , Samuel G. Finlayson , Michelle M. Li , Marinka Zitnik