English
Related papers

Related papers: Beyond Graph Convolutional Network: An Interpretab…

200 papers

We present a simple and effective approach to incorporating syntactic structure into neural attention-based encoder-decoder models for machine translation. We rely on graph-convolutional networks (GCNs), a recent class of neural networks…

Computation and Language · Computer Science 2020-06-22 Jasmijn Bastings , Ivan Titov , Wilker Aziz , Diego Marcheggiani , Khalil Sima'an

We introduce Attention Graphs, a new tool for mechanistic interpretability of Graph Neural Networks (GNNs) and Graph Transformers based on the mathematical equivalence between message passing in GNNs and the self-attention mechanism in…

Machine Learning · Computer Science 2025-02-26 Batu El , Deepro Choudhury , Pietro Liò , Chaitanya K. Joshi

In this paper, we aim at improving the computational efficiency of graph convolutional networks (GCNs) for learning on point clouds. The basic graph convolution that is typically composed of a $K$-nearest neighbor (KNN) search and a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Yawei Li , He Chen , Zhaopeng Cui , Radu Timofte , Marc Pollefeys , Gregory Chirikjian , Luc Van Gool

\textbf{G}raph \textbf{C}onvolutional \textbf{N}etwork (\textbf{GCN}) is widely used in graph data learning tasks such as recommendation. However, when facing a large graph, the graph convolution is very computationally expensive thus is…

Machine Learning · Computer Science 2021-01-19 Wenhui Yu , Zheng Qin

With the increasing demands of training graph neural networks (GNNs) on large-scale graphs, graph data condensation has emerged as a critical technique to relieve the storage and time costs during the training phase. It aims to condense the…

Machine Learning · Computer Science 2024-06-10 Zhanyu Liu , Chaolv Zeng , Guanjie Zheng

A dynamic graph (DG) is frequently encountered in numerous real-world scenarios. Consequently, A dynamic graph convolutional network (DGCN) has been successfully applied to perform precise representation learning on a DG. However,…

Machine Learning · Computer Science 2025-04-23 Minglian Han

Graph convolutional networks (GCNs) have achieved great success on graph-structured data. Many graph convolutional networks can be thought of as low-pass filters for graph signals. In this paper, we propose a more powerful graph…

Machine Learning · Computer Science 2023-06-22 Zhixian Chen , Tengfei Ma , Zhihua Jin , Yangqiu Song , Yang Wang

In this work, we have proposed an approach for improving the GCN for predicting ratings in social networks. Our model is expanded from the standard model with several layers of transformer architecture. The main focus of the paper is on the…

Machine Learning · Computer Science 2024-01-15 Thi Linh Hoang , Tuan Dung Pham , Viet Cuong Ta

The fundamental principle of Graph Neural Networks (GNNs) is to exploit the structural information of the data by aggregating the neighboring nodes using a `graph convolution' in conjunction with a suitable choice for the network…

Machine Learning · Computer Science 2023-11-01 Mahalakshmi Sabanayagam , Pascal Esser , Debarghya Ghoshdastidar

Document-level relation extraction with graph neural networks faces a fundamental graph construction gap between training and inference - the golden graph structure only available during training, which causes that most methods adopt…

Computation and Language · Computer Science 2022-10-11 Ji Qi , Bin Xu , Kaisheng Zeng , Jinxin Liu , Jifan Yu , Qi Gao , Juanzi Li , Lei Hou

Graph Neural Networks are notorious for its memory consumption. A recent Transformer-based GNN called Graph Transformer is shown to obtain superior performances when long range dependencies exist. However, combining graph data and…

Machine Learning · Computer Science 2024-03-25 Eugene Ku

Convolutional Neural Networks (CNNs) have recently led to incredible breakthroughs on a variety of pattern recognition problems. Banks of finite impulse response filters are learned on a hierarchy of layers, each contributing more abstract…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Felipe Petroski Such , Shagan Sah , Miguel Dominguez , Suhas Pillai , Chao Zhang , Andrew Michael , Nathan Cahill , Raymond Ptucha

We analyze the performance of graph neural network (GNN) architectures from the perspective of random graph theory. Our approach promises to complement existing lenses on GNN analysis, such as combinatorial expressive power and worst-case…

Machine Learning · Computer Science 2023-10-12 Drake Brown , Trevor Garrity , Kaden Parker , Jason Oliphant , Stone Carson , Cole Hanson , Zachary Boyd

Graph embedding is an important approach for graph analysis tasks such as node classification and link prediction. The goal of graph embedding is to find a low dimensional representation of graph nodes that preserves the graph information.…

Machine Learning · Computer Science 2019-08-27 Mahsa Ghorbani , Mahdieh Soleymani Baghshah , Hamid R. Rabiee

Graph Convolutional Networks (GCNs) have been successfully applied to analyze non-grid data, where the classical convolutional neural networks (CNNs) cannot be directly used. One similarity shared by GCNs and CNNs is the requirement of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Qikui Zhu , Bo Du , Pingkun Yan

Graph Neural Networks (GNNs) are a powerful tool for machine learning on graphs.GNNs combine node feature information with the graph structure by recursively passing neural messages along edges of the input graph. However, incorporating…

Machine Learning · Computer Science 2019-11-15 Rex Ying , Dylan Bourgeois , Jiaxuan You , Marinka Zitnik , Jure Leskovec

Graph convolutional network (GCN) has become popular in various natural language processing (NLP) tasks with its superiority in long-term and non-consecutive word interactions. However, existing single-hop graph reasoning in GCN may miss…

Computation and Language · Computer Science 2021-06-10 Shuoran Jiang , Qingcai Chen , Xin Liu , Baotian Hu , Lisai Zhang

Graph Convolutional Networks (GCNs) have been widely studied for compact data representation and semi-supervised learning tasks. However, existing GCNs usually use a fixed neighborhood graph which is not guaranteed to be optimal for…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Bo Jiang , Leiling Wang , Jin Tang , Bin Luo

Graph convolutional neural networks~(GCNs) have recently demonstrated promising results on graph-based semi-supervised classification, but little work has been done to explore their theoretical properties. Recently, several deep neural…

Machine Learning · Computer Science 2020-02-28 Jilin Hu , Jianbing Shen , Bin Yang , Ling Shao

We present our ongoing work on understanding the limitations of graph convolutional networks (GCNs) as well as our work on generalizations of graph convolutions for representing more complex node attribute dependencies. Based on an analysis…

Machine Learning · Computer Science 2018-05-07 Mathias Niepert , Alberto Garcia-Duran