English
Related papers

Related papers: On the Global Self-attention Mechanism for Graph C…

200 papers

We propose Scalable Message Passing Neural Networks (SMPNNs) and demonstrate that, by integrating standard convolutional message passing into a Pre-Layer Normalization Transformer-style block instead of attention, we can produce…

Machine Learning · Computer Science 2026-03-11 Haitz Sáez de Ocáriz Borde , Artem Lukoianov , Anastasis Kratsios , Michael Bronstein , Xiaowen Dong

In this paper,an Enhanced Self-Attention (ESA) mechanism has been put forward for robust feature extraction.The proposed ESA is integrated with the recursive gated convolution and self-attention mechanism.In particular, the former is used…

Sound · Computer Science 2023-05-23 J. Li , Z. Duan , S. Li , X. Yu , G. Yang

Following the success of deep convolutional networks in various vision and speech related tasks, researchers have started investigating generalizations of the well-known technique for graph-structured data. A recently-proposed method called…

Social and Information Networks · Computer Science 2018-09-21 John Boaz Lee , Ryan A. Rossi , Xiangnan Kong , Sungchul Kim , Eunyee Koh , Anup Rao

Learning useful node and graph representations with graph neural networks (GNNs) is a challenging task. It is known that deep GNNs suffer from over-smoothing where, as the number of layers increases, node representations become nearly…

Machine Learning · Computer Science 2022-02-28 Pantelis Elinas , Edwin V. Bonilla

Graph Convolutional Networks (GCNs) gained traction for graph representation learning, with recent attention on improving performance on heterophilic graphs for various real-world applications. The localized feature aggregation in a typical…

Machine Learning · Computer Science 2025-07-30 Garv Kaushik

Graph Neural Networks (GNNs) have achieved tremendous success in various real-world applications due to their strong ability in graph representation learning. GNNs explore the graph structure and node features by aggregating and…

Machine Learning · Computer Science 2021-03-09 Wei Jin , Tyler Derr , Yiqi Wang , Yao Ma , Zitao Liu , Jiliang Tang

Recently, Graph Convolutional Networks (GCNs) have proven to be a powerful mean for Computer Aided Diagnosis (CADx). This approach requires building a population graph to aggregate structural information, where the graph adjacency matrix…

Artificial Intelligence · Computer Science 2021-06-17 Hao Chen , Fuzhen Zhuang , Li Xiao , Ling Ma , Haiyan Liu , Ruifang Zhang , Huiqin Jiang , Qing He

Graph Neural Networks (GNNs) have achieved a lot of success with graph-structured data. However, it is observed that the performance of GNNs does not improve (or even worsen) as the number of layers increases. This effect has known as…

Machine Learning · Computer Science 2023-01-10 Yeskendir Koishekenov

In this paper, we study the problem of learning Graph Convolutional Networks (GCNs) for regression. Current architectures of GCNs are limited to the small receptive field of convolution filters and shared transformation matrix for each…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Long Zhao , Xi Peng , Yu Tian , Mubbasir Kapadia , Dimitris N. Metaxas

Although group convolution operators are increasingly used in deep convolutional neural networks to improve the computational efficiency and to reduce the number of parameters, most existing methods construct their group convolution…

Machine Learning · Computer Science 2020-09-30 Qingbei Guo , Xiao-Jun Wu , Josef Kittler , Zhiquan Feng

Representation learning on user-item graph for recommendation has evolved from using single ID or interaction history to exploiting higher-order neighbors. This leads to the success of graph convolution networks (GCNs) for recommendation…

Information Retrieval · Computer Science 2021-06-21 Jiancan Wu , Xiang Wang , Fuli Feng , Xiangnan He , Liang Chen , Jianxun Lian , Xing Xie

Nowadays, deep learning methods, especially the Graph Convolutional Network (GCN), have shown impressive performance in hyperspectral image (HSI) classification. However, the current GCN-based methods treat graph construction and image…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Sheng Wan , Chen Gong , Shirui Pan , Jie Yang , Jian Yang

To deepen our understanding of graph neural networks, we investigate the representation power of Graph Convolutional Networks (GCN) through the looking glass of graph moments, a key property of graph topology encoding path of various…

Machine Learning · Computer Science 2019-11-04 Nima Dehmamy , Albert-László Barabási , Rose Yu

Clustering techniques attempt to group objects with similar properties into a cluster. Clustering the nodes of an attributed graph, in which each node is associated with a set of feature attributes, has attracted significant attention.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Chaojie Ji , Hongwei Chen , Ruxin Wang , Yunpeng Cai , Hongyan Wu

Recently, graph Convolutional Neural Networks (graph CNNs) have been widely used for graph data representation and semi-supervised learning tasks. However, existing graph CNNs generally use a fixed graph which may be not optimal for…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Bo Jiang , Ziyan Zhang , Doudou Lin , Jin Tang

We analyze the performance of graph neural network (GNN) architectures from the perspective of random graph theory. Our approach promises to complement existing lenses on GNN analysis, such as combinatorial expressive power and worst-case…

Machine Learning · Computer Science 2023-10-12 Drake Brown , Trevor Garrity , Kaden Parker , Jason Oliphant , Stone Carson , Cole Hanson , Zachary Boyd

Graph neural network (GNN) based methods have saturated the field of recommender systems. The gains of these systems have been significant, showing the advantages of interpreting data through a network structure. However, despite the…

Machine Learning · Computer Science 2022-09-12 Rebecca Salganik , Fernando Diaz , Golnoosh Farnadi

Graph Convolutional Networks (GCNs) have emerged as powerful tools for learning on network structured data. Although empirically successful, GCNs exhibit certain behaviour that has no rigorous explanation -- for instance, the performance of…

Machine Learning · Computer Science 2023-11-07 Mahalakshmi Sabanayagam , Pascal Esser , Debarghya Ghoshdastidar

Recommender systems are essential components of modern online platforms which presents personalized content in various domain. The traditional collaborative filtering methods depends on static user-item interaction graphs and a limited…

Information Retrieval · Computer Science 2026-05-08 Aadarsh Senapati , Neha Kujur , Vivek Yelleti

We propose a unified framework for adaptive connection sampling in graph neural networks (GNNs) that generalizes existing stochastic regularization methods for training GNNs. The proposed framework not only alleviates over-smoothing and…

‹ Prev 1 8 9 10 Next ›