English
Related papers

Related papers: Edge Contraction Pooling for Graph Neural Networks

200 papers

Convolutional layers in graph neural networks are a fundamental type of layer which output a representation or embedding of each graph vertex. The representation typically encodes information about the vertex in question and its…

Machine Learning · Computer Science 2020-08-26 Padraig Corcoran

Graph Neural Networks (GNNs) have demonstrated remarkable success in various domains such as social networks, molecular chemistry, and more. A crucial component of GNNs is the pooling procedure, in which the node features calculated by the…

Machine Learning · Computer Science 2026-05-19 Yaniv Galron , Hadar Sinai , Haggai Maron , Moshe Eliasof

Graph Neural Networks (GNNs), which generalize deep neural networks to graph-structured data, have drawn considerable attention and achieved state-of-the-art performance in numerous graph related tasks. However, existing GNN models mainly…

Machine Learning · Computer Science 2019-12-30 Zhen Zhang , Jiajun Bu , Martin Ester , Jianfeng Zhang , Chengwei Yao , Zhi Yu , Can Wang

Graph neural networks (GNNs), which learn the representation of a node by aggregating its neighbors, have become an effective computational tool in downstream applications. Over-smoothing is one of the key issues which limit the performance…

Machine Learning · Computer Science 2020-06-15 Kaixiong Zhou , Xiao Huang , Yuening Li , Daochen Zha , Rui Chen , Xia Hu

Recent advancements in graph representation learning have led to the emergence of condensed encodings that capture the main properties of a graph. However, even though these abstract representations are powerful for downstream tasks, they…

Machine Learning · Computer Science 2020-02-21 Cristian Bodnar , Cătălina Cangea , Pietro Liò

Over-squashing and over-smoothing are two critical issues, that limit the capabilities of graph neural networks (GNNs). While over-smoothing eliminates the differences between nodes making them indistinguishable, over-squashing refers to…

Machine Learning · Computer Science 2023-09-01 Cedric Sanders , Andreas Roth , Thomas Liebig

Brain surface analysis is essential to neuroscience, however, the complex geometry of the brain cortex hinders computational methods for this task. The difficulty arises from a discrepancy between 3D imaging data, which is represented in…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Karthik Gopinath , Christian Desrosiers , Herve Lombaert

Deep learning methods for graphs have seen rapid progress in recent years with much focus awarded to generalising Convolutional Neural Networks (CNN) to graph data. CNNs are typically realised by alternating convolutional and pooling layers…

Machine Learning · Computer Science 2020-06-04 Yaniv Shulman

Two architectures that generalize convolutional neural networks (CNNs) for the processing of signals supported on graphs are introduced. We start with the selection graph neural network (GNN), which replaces linear time invariant filters…

Signal Processing · Electrical Eng. & Systems 2019-01-30 Fernando Gama , Antonio G. Marques , Geert Leus , Alejandro Ribeiro

Despite much research, Graph Neural Networks (GNNs) still do not display the favorable scaling properties of other deep neural networks such as Convolutional Neural Networks and Transformers. Previous work has identified issues such as…

Machine Learning · Computer Science 2023-12-19 Ameen Ali , Hakan Cevikalp , Lior Wolf

Spectral graph convolutional neural networks (GCNNs) have been producing encouraging results in graph classification tasks. However, most spectral GCNNs utilize fixed graphs when aggregating node features, while omitting edge feature…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Yang Yi , Xuequan Lu , Shang Gao , Antonio Robles-Kelly , Yuejie Zhang

Graph Neural Networks (GNNs) are attracting growing attention due to their effectiveness and flexibility in modeling a variety of graph-structured data. Exiting GNN architectures usually adopt simple pooling operations (eg. sum, average,…

Machine Learning · Computer Science 2022-10-21 Chenqing Hua , Guillaume Rabusseau , Jian Tang

Graph Neural Networks achieve state-of-the-art performance on a plethora of graph classification tasks, especially due to pooling operators, which aggregate learned node embeddings hierarchically into a final graph representation. However,…

Machine Learning · Computer Science 2022-09-09 Alexandre Duval , Fragkiskos Malliaros

Graph-based neural network models are gaining traction in the field of representation learning due to their ability to uncover latent topological relationships between entities that are otherwise challenging to identify. These models have…

Image and Video Processing · Electrical Eng. & Systems 2023-07-25 Aryan Singh , Pepijn Van de Ven , Ciarán Eising , Patrick Denny

Nowadays, Deep Neural Networks are among the main tools used in various sciences. Convolutional Neural Network is a special type of DNN consisting of several convolution layers, each followed by an activation function and a pooling layer.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-17 Hossein Gholamalinezhad , Hossein Khosravi

Graph neural networks (GNNs) have been successfully applied to learning representation on graphs in many relational tasks. Recently, researchers study neural architecture search (NAS) to reduce the dependence of human expertise and explore…

Machine Learning · Computer Science 2021-09-06 Shaofei Cai , Liang Li , Xinzhe Han , Zheng-jun Zha , Qingming Huang

Graph pooling methods have been widely used on downsampling graphs, achieving impressive results on multiple graph-level tasks like graph classification and graph generation. An important line called node dropping pooling aims at exploiting…

Artificial Intelligence · Computer Science 2023-11-01 Gaichao Li , Jinsong Chen , John E. Hopcroft , Kun He

Graph neural networks (GNNs) integrate deep architectures and topological structure modeling in an effective way. However, the performance of existing GNNs would decrease significantly when they stack many layers, because of the…

Machine Learning · Computer Science 2021-07-07 Kaixiong Zhou , Xiao Huang , Daochen Zha , Rui Chen , Li Li , Soo-Hyun Choi , Xia Hu

Convolutional Neural Networks (CNNs) have enabled major advances in image classification through convolution and pooling. In particular, image pooling transforms a connected discrete lattice into a reduced lattice with the same connectivity…

Machine Learning · Computer Science 2023-07-26 Stevan Stanovic , Benoit Gaüzère , Luc Brun

While message passing Graph Neural Networks (GNNs) have become increasingly popular architectures for learning with graphs, recent works have revealed important shortcomings in their expressive power. In response, several higher-order GNNs…

Machine Learning · Computer Science 2025-02-28 Behrooz Tahmasebi , Derek Lim , Stefanie Jegelka