English
Related papers

Related papers: Improving Graph Attention Networks with Large Marg…

200 papers

Long-range interactions are essential for the correct description of complex systems in many scientific fields. The price to pay for including them in the calculations, however, is a dramatic increase in the overall computational costs.…

Due to the over-smoothing issue, most existing graph neural networks can only capture limited dependencies with their inherently finite aggregation layers. To overcome this limitation, we propose a new kind of graph convolution, called…

Machine Learning · Computer Science 2022-06-30 Qi Chen , Yifei Wang , Yisen Wang , Jiansheng Yang , Zhouchen Lin

In recent years, Graph Neural Networks (GNNs) have shown superior performance on diverse applications on real-world datasets. To improve the model capacity and alleviate the over-smoothing problem, several methods proposed to incorporate…

Machine Learning · Computer Science 2021-12-28 Lanning Wei , Huan Zhao , Zhiqiang He

Graph neural networks (GNNs) have shown great ability in modeling graphs, however, their performance would significantly degrade when there are noisy edges connecting nodes from different classes. To alleviate negative effect of noisy edges…

Social and Information Networks · Computer Science 2023-09-15 Xiao Shen , Mengqiu Shao , Shirui Pan , Laurence T. Yang , Xi Zhou

Affinity graphs are widely used in deep architectures, including graph convolutional neural networks and attention networks. Thus far, the literature has focused on abstracting features from such graphs, while the learning of the affinities…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Chu Wang , Babak Samari , Vladimir G. Kim , Siddhartha Chaudhuri , Kaleem Siddiqi

Curvature notions on graphs provide a theoretical description of graph topology, highlighting bottlenecks and denser connected regions. Artifacts of the message passing paradigm in Graph Neural Networks, such as oversmoothing and…

Machine Learning · Computer Science 2026-02-25 Floriano Tori , Lorenzo Bini , Marco Sorbi , Stéphane Marchand-Maillet , Vincent Ginis

Graph Neural Networks (GNNs) have been widely used to learn representations on graphs and tackle many real-world problems from a wide range of domains. In this paper we propose wsGAT, an extension of the Graph Attention Network (GAT)…

Social and Information Networks · Computer Science 2022-02-01 Marco Grassia , Giuseppe Mangioni

Graph Neural Networks (GNNs) have shown tremendous strides in performance for graph-structured problems especially in the domains of natural language processing, computer vision and recommender systems. Inspired by the success of the…

Machine Learning · Computer Science 2022-06-08 Kaustubh D. Dhole , Carl Yang

Graph neural networks (GNNs) are processing architectures that exploit graph structural information to model representations from network data. Despite their success, GNNs suffer from sub-optimal generalization performance given limited…

Machine Learning · Computer Science 2021-06-08 Zhan Gao , Subhrajit Bhattacharya , Leiming Zhang , Rick S. Blum , Alejandro Ribeiro , Brian M. Sadler

Heterogeneous graphs have multiple node and edge types and are semantically richer than homogeneous graphs. To learn such complex semantics, many graph neural network approaches for heterogeneous graphs use metapaths to capture multi-hop…

Machine Learning · Computer Science 2022-07-26 See Hian Lee , Feng Ji , Wee Peng Tay

Collaborative filtering methods based on graph neural networks (GNNs) have witnessed significant success in recommender systems (RS), capitalizing on their ability to capture collaborative signals within intricate user-item relationships…

Information Retrieval · Computer Science 2024-04-16 Wei Wu , Chao Wang , Dazhong Shen , Chuan Qin , Liyi Chen , Hui Xiong

Graph representation learning has rapidly emerged as a pivotal field of study. Despite its growing popularity, the majority of research has been confined to embedding single-layer graphs, which fall short in representing complex systems…

Machine Learning · Computer Science 2024-03-29 Marco Bongiovanni , Luca Gallo , Roberto Grasso , Alfredo Pulvirenti

Knowledge graphs (KGs) play a vital role in enhancing search results and recommendation systems. With the rapid increase in the size of the KGs, they are becoming inaccuracy and incomplete. This problem can be solved by the knowledge graph…

Machine Learning · Computer Science 2024-08-06 Wanxu Wei , Yitong Song , Bin Yao

Graph Neural Networks (GNNs) are a promising deep learning approach for circumventing many real-world problems on graph-structured data. However, these models usually have at least one of four fundamental limitations: over-smoothing,…

Machine Learning · Computer Science 2022-10-03 Xun Liu , Alex Hay-Man Ng , Fangyuan Lei , Yikuan Zhang , Zhengmin Li

Unsupervised attributed graph representation learning is challenging since both structural and feature information are required to be represented in the latent space. Existing methods concentrate on learning latent representation via…

Machine Learning · Computer Science 2021-04-28 Zelin Zang , Siyuan Li , Di Wu , Jianzhu Guo , Yongjie Xu , Stan Z. Li

Implicit Graph Neural Networks (GNNs) have achieved significant success in addressing graph learning problems recently. However, poorly designed implicit GNN layers may have limited adaptability to learn graph metrics, experience…

Machine Learning · Computer Science 2024-02-16 Guoji Fu , Mohammed Haroon Dupty , Yanfei Dong , Lee Wee Sun

Linearized Graph Neural Networks (GNNs) have attracted great attention in recent years for graph representation learning. Compared with nonlinear Graph Neural Network (GNN) models, linearized GNNs are much more time-efficient and can…

Machine Learning · Computer Science 2023-02-02 Yulin Zhu , Xing Ai , Qimai Li , Xiao-Ming Wu , Kai Zhou

In node classification tasks, graph convolutional neural networks (GCNs) have demonstrated competitive performance over traditional methods on diverse graph data. However, it is known that the performance of GCNs degrades with increasing…

Machine Learning · Computer Science 2022-11-29 Yujun Yan , Milad Hashemi , Kevin Swersky , Yaoqing Yang , Danai Koutra

Graph neural networks (GNNs) aim to learn well-trained representations in a lower-dimension space for downstream tasks while preserving the topological structures. In recent years, attention mechanism, which is brilliant in the fields of…

Social and Information Networks · Computer Science 2026-05-12 Chengcheng Sun , Chenhao Li , Xiang Lin , Tianji Zheng , Fanrong Meng , Xiaobin Rui , Zhixiao Wang

In recent years, powered by the learned discriminative representation via graph neural network (GNN) models, deep graph matching methods have made great progresses in the task of matching semantic features. However, these methods usually…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 He Liu , Tao Wang , Yidong Li , Congyan Lang , Yi Jin , Haibin Ling