English
Related papers

Related papers: PiNet: Attention Pooling for Graph Classification

200 papers

Explanations obtained from transformer-based architectures in the form of raw attention, can be seen as a class-agnostic saliency map. Additionally, attention-based pooling serves as a form of masking the in feature space. Motivated by this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Felipe Torres , Hanwei Zhang , Ronan Sicre , Stéphane Ayache , Yannis Avrithis

Graph Neural Networks (GNNs) are powerful tools for graph classification. One important operation for GNNs is the downsampling or pooling that can learn effective embeddings from the node representations. In this paper, we propose a new…

Machine Learning · Computer Science 2024-05-17 Zhehan Zhao , Lu Bai , Lixin Cui , Ming Li , Yue Wang , Lixiang Xu , Edwin R. Hancock

Graph neural networks (GNNs) have been widely used to learn vector representation of graph-structured data and achieved better task performance than conventional methods. The foundation of GNNs is the message passing procedure, which…

Machine Learning · Computer Science 2022-01-31 Takeshi D. Itoh , Takatomi Kubo , Kazushi Ikeda

While convolutional neural networks (CNNs) have recently made great strides in supervised classification of data structured on a grid (e.g. images composed of pixel grids), in several interesting datasets, the relations between features can…

Machine Learning · Computer Science 2018-11-02 Shrey Gadiya , Deepak Anand , Amit Sethi

Graph representation learning has become a crucial task in machine learning and data mining due to its potential for modeling complex structures such as social networks, chemical compounds, and biological systems. Spiking neural networks…

Artificial Intelligence · Computer Science 2024-03-27 Huifeng Yin , Mingkun Xu , Jing Pei , Lei Deng

In high energy physics, graph-based implementations have the advantage of treating the input data sets in a similar way as they are collected by collider experiments. To expand on this concept, we propose a graph neural network enhanced by…

Data Analysis, Statistics and Probability · Physics 2020-09-29 Vinicius Mikuni , Florencia Canelli

Graph neural networks, which generalize deep neural network models to graph structured data, have attracted increasing attention in recent years. They usually learn node representations by transforming, propagating and aggregating node…

Machine Learning · Computer Science 2019-05-21 Yao Ma , Suhang Wang , Charu C. Aggarwal , Jiliang Tang

Graph Convolutional Networks (GCNs) have shown to be effective in handling unordered data like point clouds and meshes. In this work we propose novel approaches for graph convolution, pooling and unpooling, inspired from finite differences…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Moshe Eliasof , Eran Treister

Node classification has gained significant importance in graph deep learning with real-world applications such as recommendation systems, drug discovery, and citation networks. Graph Convolutional Networks and Graph Transformers have…

Social and Information Networks · Computer Science 2025-04-04 Aman Singh , Shahid Shafi Dar , Ranveer Singh , Nagendra Kumar

Graph neural networks (GNNs) have revolutionized the field of machine learning on non-Euclidean data such as graphs and networks. GNNs effectively implement node representation learning through neighborhood aggregation and achieve…

Machine Learning · Computer Science 2024-04-30 Zehao Dong , Muhan Zhang , Yixin Chen

Graph neural networks (GNNs) extends the functionality of traditional neural networks to graph-structured data. Similar to CNNs, an optimized design of graph convolution and pooling is key to success. Borrowing ideas from physics, we…

Machine Learning · Computer Science 2022-01-12 Zheng Ma , Junyu Xuan , Yu Guang Wang , Ming Li , Pietro Lio

A graph with semantically attributed nodes are a common data structure in a wide range of domains. It could be interlinked web data or citation networks of scientific publications. The essential problem for such a data type is to determine…

Machine Learning · Computer Science 2025-12-09 Elizaveta Kovtun , Maksim Makarenko , Natalia Semenova , Alexey Zaytsev , Semen Budennyy

With the widespread applications of deep convolutional neural networks (DCNNs), it becomes increasingly important for DCNNs not only to make accurate predictions but also to explain how they make their decisions. In this work, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Xinrui Cui , Dan Wang , Z. Jane Wang

Many real-world problems can be represented as graph-based learning problems. In this paper, we propose a novel framework for learning spatial and attentional convolution neural networks on arbitrary graphs. Different from previous…

Machine Learning · Computer Science 2019-02-26 Hao Peng , Jianxin Li , Qiran Gong , Senzhang Wang , Yuanxing Ning , Philip S. Yu

Graph neural networks (GNN) has been demonstrated to be effective in classifying graph structures. To further improve the graph representation learning ability, hierarchical GNN has been explored. It leverages the differentiable pooling to…

Social and Information Networks · Computer Science 2019-12-19 Kaixiong Zhou , Qingquan Song , Xiao Huang , Daochen Zha , Na Zou , Xia Hu

Graph pooling is a family of operations which take graphs as input and produce shrinked graphs as output. Modern graph pooling methods are trainable and, in general inserted in Graph Neural Networks (GNNs) architectures as graph shrinking…

Machine Learning · Computer Science 2024-12-05 Yizhu Chen

Graph neural networks (GNN) have been proven to be mature enough for handling graph-structured data on node-level graph representation learning tasks. However, the graph pooling technique for learning expressive graph-level representation…

Machine Learning · Computer Science 2021-04-14 Ning Liu , Songlei Jian , Dongsheng Li , Yiming Zhang , Zhiquan Lai , Hongzuo Xu

Graph Neural Networks (GNNs) have shown significant success for graph-based tasks. Motivated by the prevalence of large datasets in real-world applications, pooling layers are crucial components of GNNs. By reducing the size of input…

Machine Learning · Computer Science 2026-01-13 Katharina Limbeck , Lydia Mezrag , Guy Wolf , Bastian Rieck

Deep learning methods for graphs have seen rapid progress in recent years with much focus awarded to generalising Convolutional Neural Networks (CNN) to graph data. CNNs are typically realised by alternating convolutional and pooling layers…

Machine Learning · Computer Science 2020-06-04 Yaniv Shulman

We propose a novel technique to incorporate attention within convolutional neural networks using feature maps generated by a separate convolutional autoencoder. Our attention architecture is well suited for incorporation with deep…

Computer Vision and Pattern Recognition · Computer Science 2019-02-11 Chaitanya Kaul , Suresh Manandhar , Nick Pears