English
Related papers

Related papers: Are We Measuring Oversmoothing in Graph Neural Net…

200 papers

Graph Neural Network (GNN) resembles the diffusion process, leading to the over-smoothing of learned representations when stacking many layers. Hence, the reverse process of message passing can produce the distinguishable node…

Social and Information Networks · Computer Science 2024-06-12 MoonJeong Park , Jaeseung Heo , Dongwoo Kim

Recently, motivated by real applications, a major research direction in graph neural networks (GNNs) is to explore deeper structures. For instance, the graph connectivity is not always consistent with the label distribution (e.g., the…

Machine Learning · Computer Science 2022-10-26 Lecheng Zheng , Dongqi Fu , Ross Maciejewski , Jingrui He

In recent years, graph neural networks (GNNs) have achieved great success in the field of graph representation learning. Although prior work has shed light on the expressiveness of those models (\ie whether they can distinguish pairs of…

Machine Learning · Computer Science 2024-11-25 Giannis Nikolentzos , Michail Chatzianastasis , Michalis Vazirgiannis

In this paper we show that simple noise regularisation can be an effective way to address GNN oversmoothing. First we argue that regularisers addressing oversmoothing should both penalise node latent similarity and encourage meaningful node…

Graph Neural Networks (GNNs) are limited in their propagation operators. In many cases, these operators often contain non-negative elements only and are shared across channels, limiting the expressiveness of GNNs. Moreover, some GNNs suffer…

Machine Learning · Computer Science 2023-05-08 Moshe Eliasof , Lars Ruthotto , Eran Treister

Graph neural networks (GNNs) are commonly used in semi-supervised settings. Previous research has primarily focused on finding appropriate graph filters (e.g. aggregation methods) to perform well on both homophilic and heterophilic graphs.…

Machine Learning · Computer Science 2025-01-17 Yoonhyuk Choi , Jiho Choi , Taewook Ko , Chong-Kwon Kim

Real data collected from different applications that have additional topological structures and connection information are amenable to be represented as a weighted graph. Considering the node labeling problem, Graph Neural Networks (GNNs)…

Social and Information Networks · Computer Science 2020-02-06 Xiaoxiao Li , Joao Saude

The computation of distance measures between nodes in graphs is inefficient and does not scale to large graphs. We explore dense vector representations as an effective way to approximate the same information: we introduce a simple yet…

Computation and Language · Computer Science 2019-06-18 Andrey Kutuzov , Mohammad Dorgham , Oleksiy Oliynyk , Chris Biemann , Alexander Panchenko

Node classification is an important research topic in graph learning. Graph neural networks (GNNs) have achieved state-of-the-art performance of node classification. However, existing GNNs address the problem where node samples for…

Machine Learning · Computer Science 2021-03-17 Tianxiang Zhao , Xiang Zhang , Suhang Wang

Collaborative filtering methods based on graph neural networks (GNNs) have witnessed significant success in recommender systems (RS), capitalizing on their ability to capture collaborative signals within intricate user-item relationships…

Information Retrieval · Computer Science 2024-04-16 Wei Wu , Chao Wang , Dazhong Shen , Chuan Qin , Liyi Chen , Hui Xiong

In image generation, generative models can be evaluated naturally by visually inspecting model outputs. However, this is not always the case for graph generative models (GGMs), making their evaluation challenging. Currently, the standard…

Machine Learning · Computer Science 2022-04-29 Rylee Thompson , Boris Knyazev , Elahe Ghalebi , Jungtaek Kim , Graham W. Taylor

Graph convolutional networks learn effective node embeddings that have proven to be useful in achieving high-accuracy prediction results in semi-supervised learning tasks, such as node classification. However, these networks suffer from the…

Machine Learning · Computer Science 2020-10-21 Mahsa Mesgaran , A. Ben Hamza

Dynamic graphs arise in a plethora of practical scenarios such as social networks, communication networks, and financial transaction networks. Given a dynamic graph, it is fundamental and essential to learn a graph representation that is…

Machine Learning · Computer Science 2021-06-15 Menglin Yang , Ziqiao Meng , Irwin King

Graph classification benchmarks, vital for assessing and developing graph neural networks (GNNs), have recently been scrutinized, as simple methods like MLPs have demonstrated comparable performance. This leads to an important question: Do…

Machine Learning · Computer Science 2024-08-14 Zhengdao Li , Yong Cao , Kefan Shuai , Yiming Miao , Kai Hwang

Graph convolutional networks (GCNs) are a powerful deep learning approach for graph-structured data. Recently, GCNs and subsequent variants have shown superior performance in various application areas on real-world datasets. Despite their…

Machine Learning · Computer Science 2020-07-07 Ming Chen , Zhewei Wei , Zengfeng Huang , Bolin Ding , Yaliang Li

Graph Neural Networks (GNNs) have excelled in predicting graph properties in various applications ranging from identifying trends in social networks to drug discovery and malware detection. With the abundance of new architectures and…

Machine Learning · Computer Science 2024-06-06 Roya Aliakbarisani , Robert Jankowski , M. Ángeles Serrano , Marián Boguñá

Graph embedding is the task of representing nodes of a graph in a low-dimensional space and its applications for graph tasks have gained significant traction in academia and industry. The primary difference among the many recently proposed…

Social and Information Networks · Computer Science 2019-08-28 Palash Goyal , Di Huang , Ankita Goswami , Sujit Rokka Chhetri , Arquimedes Canedo , Emilio Ferrara

Graph neural networks (GNNs) have achieved strong performance in various applications. In the real world, network data is usually formed in a streaming fashion. The distributions of patterns that refer to neighborhood information of nodes…

Machine Learning · Computer Science 2020-12-07 Junshan Wang , Guojie Song , Yi Wu , Liang Wang

Graph Neural Networks (GNNs) have become the state-of-the-art method for many applications on graph structured data. GNNs are a model for graph representation learning, which aims at learning to generate low dimensional node embeddings that…

Machine Learning · Computer Science 2022-05-23 Davide Buffelli , Fabio Vandin

We study the problem of semi-supervised learning on graphs, for which graph neural networks (GNNs) have been extensively explored. However, most existing GNNs inherently suffer from the limitations of over-smoothing, non-robustness, and…

Machine Learning · Computer Science 2021-09-22 Wenzheng Feng , Jie Zhang , Yuxiao Dong , Yu Han , Huanbo Luan , Qian Xu , Qiang Yang , Evgeny Kharlamov , Jie Tang