English
Related papers

Related papers: Hierarchical Representation Learning in Graph Neur…

200 papers

In Graph Neural Networks (GNNs), hierarchical pooling operators generate local summaries of the data by coarsening the graph structure and the vertex features. While considerable attention has been devoted to analyzing the expressive power…

Machine Learning · Computer Science 2023-10-16 Filippo Maria Bianchi , Veronica Lachi

Graph neural networks (GNN) has been demonstrated to be effective in classifying graph structures. To further improve the graph representation learning ability, hierarchical GNN has been explored. It leverages the differentiable pooling to…

Social and Information Networks · Computer Science 2019-12-19 Kaixiong Zhou , Qingquan Song , Xiao Huang , Daochen Zha , Na Zou , Xia Hu

Graph-structured data naturally occurs in many research fields, such as chemistry and sociology. The relational information contained therein can be leveraged to statistically model graph properties through geometrical deep learning. Graph…

Machine Learning · Computer Science 2024-09-19 T. Snelleman , B. M. Renting , H. H. Hoos , J. N. van Rijn

Graph Neural Network (GNN) research has concentrated on improving convolutional layers, with little attention paid to developing graph pooling layers. Yet pooling layers can enable GNNs to reason over abstracted groups of nodes instead of…

Machine Learning · Computer Science 2019-05-28 Frederik Diehl

Graph Neural Networks (GNNs) are powerful techniques in representation learning for graphs and have been increasingly deployed in a multitude of different applications that involve node- and graph-wise tasks. Most existing studies solve…

Artificial Intelligence · Computer Science 2022-03-21 Zhiqiang Zhong , Cheng-Te Li , Jun Pang

We propose a deep Graph Neural Network (GNN) model that alternates two types of layers. The first type is inspired by Reservoir Computing (RC) and generates new vertex features by iterating a non-linear map until it converges to a fixed…

Machine Learning · Computer Science 2021-04-13 Filippo Maria Bianchi , Claudio Gallicchio , Alessio Micheli

Partitioning is a known problem in computer science and is critical in chip design workflows, as advancements in this area can significantly influence design quality and efficiency. Deep Learning (DL) techniques, particularly those…

Hardware Architecture · Computer Science 2024-09-04 Muhammad Hadir Khan , Bugra Onal , Eren Dogan , Matthew R. Guthaus

Graph neural networks (GNNs) are deep learning models designed specifically for graph data, and they typically rely on node features as the input to the first layer. When applying such a type of network on the graph without node features,…

Graph neural networks (GNNs), which learn the representation of a node by aggregating its neighbors, have become an effective computational tool in downstream applications. Over-smoothing is one of the key issues which limit the performance…

Machine Learning · Computer Science 2020-06-15 Kaixiong Zhou , Xiao Huang , Yuening Li , Daochen Zha , Rui Chen , Xia Hu

Knowledge distillation is a learning paradigm for boosting resource-efficient graph neural networks (GNNs) using more expressive yet cumbersome teacher models. Past work on distillation for GNNs proposed the Local Structure Preserving loss…

Machine Learning · Computer Science 2023-02-07 Chaitanya K. Joshi , Fayao Liu , Xu Xun , Jie Lin , Chuan-Sheng Foo

Graph convolutional neural networks (GCNNs) are a powerful extension of deep learning techniques to graph-structured data problems. We empirically evaluate several pooling methods for GCNNs, and combinations of those graph pooling methods…

Signal Processing · Electrical Eng. & Systems 2020-04-08 Mark Cheung , John Shi , Lavender Yao Jiang , Oren Wright , José M. F. Moura

Graph Convolutional Networks (GCNs) have shown to be effective in handling unordered data like point clouds and meshes. In this work we propose novel approaches for graph convolution, pooling and unpooling, inspired from finite differences…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Moshe Eliasof , Eran Treister

Graphs serve as fundamental descriptors for systems composed of interacting elements, capturing a wide array of data types, from molecular interactions to social networks and knowledge graphs. In this paper, we present an exhaustive review…

Machine Learning · Computer Science 2024-11-13 Chenqing Hua

Graph neural networks (GNNs) have revolutionized the field of machine learning on non-Euclidean data such as graphs and networks. GNNs effectively implement node representation learning through neighborhood aggregation and achieve…

Machine Learning · Computer Science 2024-04-30 Zehao Dong , Muhan Zhang , Yixin Chen

While graph neural networks (GNNs) have been successful for node classification tasks and link prediction tasks in graph, learning graph-level representations still remains a challenge. For the graph-level representation, it is important to…

Machine Learning · Computer Science 2023-03-02 Sangseon Lee , Dohoon Lee , Yinhua Piao , Sun Kim

Graph neural networks have been widely used on modeling graph data, achieving impressive results on node classification and link prediction tasks. Yet, obtaining an accurate representation for a graph further requires a pooling function…

Machine Learning · Computer Science 2021-06-29 Jinheon Baek , Minki Kang , Sung Ju Hwang

A key component of many graph neural networks (GNNs) is the pooling operation, which seeks to reduce the size of a graph while preserving important structural information. However, most existing graph pooling strategies rely on an…

Machine Learning · Computer Science 2023-10-17 Mahsa Mesgaran , A. Ben Hamza

Downsampling produces coarsened, multi-resolution representations of data and it is used, for example, to produce lossy compression and visualization of large images, reduce computational costs, and boost deep neural representation…

Machine Learning · Computer Science 2023-07-04 Davide Bacciu , Alessio Conte , Francesco Landolfi

Graph representation learning based on graph neural networks (GNNs) can greatly improve the performance of downstream tasks, such as node and graph classification. However, the general GNN models do not aggregate node information in a…

Machine Learning · Computer Science 2020-07-30 Fei Ding , Xiaohong Zhang , Justin Sybrandt , Ilya Safro

Graph pooling has been increasingly considered for graph neural networks (GNNs) to facilitate hierarchical graph representation learning. Existing graph pooling methods commonly consist of two stages, i.e., selecting the top-ranked nodes…

Machine Learning · Computer Science 2022-04-28 Mingxing Xu , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong