English
Related papers

Related papers: Transfer Entropy in Graph Convolutional Neural Net…

200 papers

While Graph Neural Networks (GNNs) have achieved enormous success in multiple graph analytical tasks, modern variants mostly rely on the strong inductive bias of homophily. However, real-world networks typically exhibit both homophilic and…

Machine Learning · Computer Science 2024-09-18 Jingwei Guo , Kaizhu Huang , Rui Zhang , Xinping Yi

A common issue in Graph Neural Networks (GNNs) is known as over-smoothing. By increasing the number of iterations within the message-passing of GNNs, the nodes' representations of the input graph align with each other and become…

Machine Learning · Computer Science 2021-10-22 Christian M. M. Frey , Yunpu Ma , Matthias Schubert

Clustering techniques attempt to group objects with similar properties into a cluster. Clustering the nodes of an attributed graph, in which each node is associated with a set of feature attributes, has attracted significant attention.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Chaojie Ji , Hongwei Chen , Ruxin Wang , Yunpeng Cai , Hongyan Wu

Graph convolutional neural networks (GCNs) generalize tradition convolutional neural networks (CNNs) from low-dimensional regular graphs (e.g., image) to high dimensional irregular graphs (e.g., text documents on word embeddings). Due to…

Machine Learning · Computer Science 2021-03-30 Mehrnaz Najafi , Philip S. Yu

The current success of Graph Neural Networks (GNNs) usually relies on loading the entire attributed graph for processing, which may not be satisfied with limited memory resources, especially when the attributed graph is large. This paper…

Machine Learning · Computer Science 2022-10-25 Junfu Wang , Yuanfang Guo , Liang Yang , Yunhong Wang

Graph convolutional networks (GCNs) are powerful deep neural networks for graph-structured data. However, GCN computes the representation of a node recursively from its neighbors, making the receptive field size grow exponentially with the…

Machine Learning · Statistics 2018-03-02 Jianfei Chen , Jun Zhu , Le Song

Linearized Graph Neural Networks (GNNs) have attracted great attention in recent years for graph representation learning. Compared with nonlinear Graph Neural Network (GNN) models, linearized GNNs are much more time-efficient and can…

Machine Learning · Computer Science 2023-02-02 Yulin Zhu , Xing Ai , Qimai Li , Xiao-Ming Wu , Kai Zhou

Graph neural networks (GNNs) are one of the most popular research topics for deep learning. GNN methods typically have been designed on top of the graph signal processing theory. In particular, diffusion equations have been widely used for…

Machine Learning · Computer Science 2023-06-16 Jeongwhan Choi , Seoyoung Hong , Noseong Park , Sung-Bae Cho

Heterophily, or the tendency of connected nodes in networks to have different class labels or dissimilar features, has been identified as challenging for many Graph Neural Network (GNN) models. While the challenges of applying GNNs for node…

Machine Learning · Computer Science 2024-09-27 Jiong Zhu , Gaotang Li , Yao-An Yang , Jing Zhu , Xuehao Cui , Danai Koutra

Graph neural networks (GNNs) excel in modeling relational data such as biological, social, and transportation networks, but the underpinnings of their success are not well understood. Traditional complexity measures from statistical…

Machine Learning · Computer Science 2024-01-24 Cheng Shi , Liming Pan , Hong Hu , Ivan Dokmanić

In recent years, Graph Convolutional Networks (GCNs) and their variants have been widely utilized in learning tasks that involve graphs. These tasks include recommendation systems, node classification, among many others. In node…

Machine Learning · Computer Science 2019-12-23 Mustafa Coskun , Burcu Bakir Gungor , Mehmet Koyuturk

Heterogeneous information network (HIN) embedding, aiming to map the structure and semantic information in a HIN to distributed representations, has drawn considerable research attention. Graph neural networks for HIN embeddings typically…

Social and Information Networks · Computer Science 2020-07-07 Di Jin , Zhizhi Yu , Dongxiao He , Carl Yang , Philip S. Yu , Jiawei Han

Node classification is a classical graph machine learning task on which Graph Neural Networks (GNNs) have recently achieved strong results. However, it is often believed that standard GNNs only work well for homophilous graphs, i.e., graphs…

Machine Learning · Computer Science 2024-03-05 Oleg Platonov , Denis Kuznedelev , Michael Diskin , Artem Babenko , Liudmila Prokhorenkova

Many recent works have studied the performance of Graph Neural Networks (GNNs) in the context of graph homophily - a label-dependent measure of connectivity. Traditional GNNs generate node embeddings by aggregating information from a node's…

Machine Learning · Computer Science 2021-06-08 Hesham Mostafa , Marcel Nassar , Somdeb Majumdar

Oversmoothing has been assumed to be the major cause of performance drop in deep graph convolutional networks (GCNs). In this paper, we propose a new view that deep GCNs can actually learn to anti-oversmooth during training. This work…

Machine Learning · Computer Science 2020-06-19 Chaoqi Yang , Ruijie Wang , Shuochao Yao , Shengzhong Liu , Tarek Abdelzaher

Graph Convolution Network (GCN) has attracted significant attention and become the most popular method for learning graph representations. In recent years, many efforts have been focused on integrating GCN into the recommender tasks and…

Machine Learning · Computer Science 2020-07-14 Kang Liu , Feng Xue , Richang Hong

Graph Neural Networks (GNNs) have shown advantages in various graph-based applications. Most existing GNNs assume strong homophily of graph structure and apply permutation-invariant local aggregation of neighbors to learn a representation…

Machine Learning · Computer Science 2022-01-04 Tianmeng Yang , Yujing Wang , Zhihan Yue , Yaming Yang , Yunhai Tong , Jing Bai

Graph Neural Networks (GNNs) excel at analyzing graph-structured data but struggle on heterophilic graphs, where connected nodes often belong to different classes. While this challenge is commonly addressed with specialized GNN…

Machine Learning · Computer Science 2025-05-20 Harel Mendelman , Haggai Maron , Ronen Talmon

Two architectures that generalize convolutional neural networks (CNNs) for the processing of signals supported on graphs are introduced. We start with the selection graph neural network (GNN), which replaces linear time invariant filters…

Signal Processing · Electrical Eng. & Systems 2019-01-30 Fernando Gama , Antonio G. Marques , Geert Leus , Alejandro Ribeiro

Graph convolutional networks (GCNs), aiming to integrate high-order neighborhood information through stacked graph convolution layers, have demonstrated remarkable power in many network analysis tasks. However, topological limitations,…

Machine Learning · Computer Science 2021-03-08 Di Jin , Xiangchen Song , Zhizhi Yu , Ziyang Liu , Heling Zhang , Zhaomeng Cheng , Jiawei Han