中文
相关论文

相关论文: Self-Attention Graph Pooling

200 篇论文

Graph Neural Networks (GNNs) are powerful tools for graph classification. One important operation for GNNs is the downsampling or pooling that can learn effective embeddings from the node representations. In this paper, we propose a new…

机器学习 · 计算机科学 2024-05-17 Zhehan Zhao , Lu Bai , Lixin Cui , Ming Li , Yue Wang , Lixiang Xu , Edwin R. Hancock

We propose an extension to the transformer neural network architecture for general-purpose graph learning by adding a dedicated pathway for pairwise structural information, called edge channels. The resultant framework - which we call…

机器学习 · 计算机科学 2022-06-06 Md Shamim Hussain , Mohammed J. Zaki , Dharmashankar Subramanian

Graph classification is an important problem with applications across many domains, like chemistry and bioinformatics, for which graph neural networks (GNNs) have been state-of-the-art (SOTA) methods. GNNs are designed to learn node-level…

机器学习 · 计算机科学 2021-08-25 Lanning Wei , Huan Zhao , Quanming Yao , Zhiqiang He

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate…

信息检索 · 计算机科学 2022-01-10 Sai Mitheran , Abhinav Java , Surya Kant Sahu , Arshad Shaikh

Convolutional neural network (CNN) architectures utilize downsampling layers, which restrict the subsequent layers to learn spatially invariant features while reducing computational costs. However, such a downsampling operation makes it…

计算机视觉与模式识别 · 计算机科学 2018-04-02 Akito Takeki , Daiki Ikami , Go Irie , Kiyoharu Aizawa

Brain surface analysis is essential to neuroscience, however, the complex geometry of the brain cortex hinders computational methods for this task. The difficulty arises from a discrepancy between 3D imaging data, which is represented in…

计算机视觉与模式识别 · 计算机科学 2019-11-25 Karthik Gopinath , Christian Desrosiers , Herve Lombaert

In this paper we propose a pooling approach for convolutional information processing on graphs relying on the theory of graphons and limits of dense graph sequences. We present three methods that exploit the induced graphon representation…

机器学习 · 计算机科学 2023-08-24 Alejandro Parada-Mayorga , Zhiyang Wang , Alejandro Ribeiro

How to utilize deep learning methods for graph classification tasks has attracted considerable research attention in the past few years. Regarding graph classification tasks, the graphs to be classified may have various graph sizes (i.e.,…

机器学习 · 计算机科学 2020-04-16 Yanyan Liang , Yanfeng Zhang , Dechao Gao , Qian Xu

Graph Neural networks (GNNs) have recently become a powerful technique for many graph-related tasks including graph classification. Current GNN models apply different graph pooling methods that reduce the number of nodes and edges to learn…

机器学习 · 计算机科学 2023-03-08 Muhammad Ifte Khairul Islam , Max Khanov , Esra Akbas

In representation learning on graph-structured data, many popular graph neural networks (GNNs) fail to capture long-range dependencies, leading to performance degradation. Furthermore, this weakness is magnified when the concerned graph is…

机器学习 · 计算机科学 2024-03-07 Mengying Jiang , Guizhong Liu , Yuanchao Su , Xinliang Wu

Graph pooling is a central component of a myriad of graph neural network (GNN) architectures. As an inheritance from traditional CNNs, most approaches formulate graph pooling as a cluster assignment problem, extending the idea of local…

机器学习 · 计算机科学 2020-10-23 Diego Mesquita , Amauri H. Souza , Samuel Kaski

Graph neural networks (GNNs) have demonstrated a significant success in various graph learning tasks, from graph classification to anomaly detection. There recently has emerged a number of approaches adopting a graph pooling operation…

机器学习 · 计算机科学 2023-03-28 Yuzhou Chen , Yulia R. Gel

Graph pooling has been increasingly recognized as crucial for Graph Neural Networks (GNNs) to facilitate hierarchical graph representation learning. Existing graph pooling methods commonly consist of two stages: selecting top-ranked nodes…

机器学习 · 计算机科学 2023-11-22 Chuang Liu , Wenhang Yu , Kuang Gao , Xueqi Ma , Yibing Zhan , Jia Wu , Bo Du , Wenbin Hu

Graph Neural Networks (GNNs) have been highly successful for the node classification task. GNNs typically assume graphs are homophilic, i.e. neighboring nodes are likely to belong to the same class. However, a number of real-world graphs…

机器学习 · 计算机科学 2024-09-20 Yurui Lai , Taiyan Zhang , Rui Fan

The spatial convolution layer which is widely used in the Graph Neural Networks (GNNs) aggregates the feature vector of each node with the feature vectors of its neighboring nodes. The GNN is not aware of the locations of the nodes in the…

机器学习 · 计算机科学 2019-10-04 Mostafa Rahmani , Ping Li

Graph neural networks (GNN) have been proven to be mature enough for handling graph-structured data on node-level graph representation learning tasks. However, the graph pooling technique for learning expressive graph-level representation…

机器学习 · 计算机科学 2021-04-14 Ning Liu , Songlei Jian , Dongsheng Li , Yiming Zhang , Zhiquan Lai , Hongzuo Xu

Graph neural networks (GNNs) extends the functionality of traditional neural networks to graph-structured data. Similar to CNNs, an optimized design of graph convolution and pooling is key to success. Borrowing ideas from physics, we…

机器学习 · 计算机科学 2022-01-12 Zheng Ma , Junyu Xuan , Yu Guang Wang , Ming Li , Pietro Lio

Transformers have demonstrated remarkable performance across diverse domains. The key component of Transformers is self-attention, which learns the relationship between any two tokens in the input sequence. Recent studies have revealed that…

机器学习 · 计算机科学 2025-05-14 Hyowon Wi , Jeongwhan Choi , Noseong Park

Recently many effective attention modules are proposed to boot the model performance by exploiting the internal information of convolutional neural networks in computer vision. In general, many previous works ignore considering the design…

机器学习 · 计算机科学 2022-10-25 Shanshan Zhong , Wushao Wen , Jinghui Qin

Graph Neural Networks achieve state-of-the-art performance on a plethora of graph classification tasks, especially due to pooling operators, which aggregate learned node embeddings hierarchically into a final graph representation. However,…

机器学习 · 计算机科学 2022-09-09 Alexandre Duval , Fragkiskos Malliaros