English
Related papers

Related papers: Multi-hop Attention Graph Neural Network

200 papers

Graph Neural Networks (GNNs) have shown advantages in various graph-based applications. Most existing GNNs assume strong homophily of graph structure and apply permutation-invariant local aggregation of neighbors to learn a representation…

Machine Learning · Computer Science 2022-01-04 Tianmeng Yang , Yujing Wang , Zhihan Yue , Yaming Yang , Yunhai Tong , Jing Bai

Spatial reasoning in text plays a crucial role in various real-world applications. Existing approaches for spatial reasoning typically infer spatial relations from pure text, which overlooks the gap between natural language and symbolic…

Computation and Language · Computer Science 2024-03-11 Shuaiyi Li , Yang Deng , Wai Lam

Transformer-based methods have demonstrated excellent performance on super-resolution visual tasks, surpassing conventional convolutional neural networks. However, existing work typically restricts self-attention computation to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Shu-Chuan Chu , Zhi-Chao Dou , Jeng-Shyang Pan , Shaowei Weng , Junbao Li

Deep learning methods for graphs achieve remarkable performance on many node-level and graph-level prediction tasks. However, despite the proliferation of the methods and their success, prevailing Graph Neural Networks (GNNs) neglect…

Machine Learning · Computer Science 2020-11-10 Emily Alsentzer , Samuel G. Finlayson , Michelle M. Li , Marinka Zitnik

Graph neural networks (GNNs) excel in graph representation learning by integrating graph structure and node features. Existing GNNs, unfortunately, fail to account for the uncertainty of class probabilities that vary with the depth of the…

Machine Learning · Computer Science 2025-06-17 Qingfeng Chen , Shiyuan Li , Yixin Liu , Shirui Pan , Geoffrey I. Webb , Shichao Zhang

Modern data analysis pipelines are becoming increasingly complex due to the presence of multi-view information sources. While graphs are effective in modeling complex relationships, in many scenarios a single graph is rarely sufficient to…

Machine Learning · Statistics 2019-04-02 Uday Shankar Shanthamallu , Jayaraman J. Thiagarajan , Huan Song , Andreas Spanias

In recent years, powered by the learned discriminative representation via graph neural network (GNN) models, deep graph matching methods have made great progresses in the task of matching semantic features. However, these methods usually…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 He Liu , Tao Wang , Yidong Li , Congyan Lang , Yi Jin , Haibin Ling

Graph neural networks are powerful architectures for structured datasets. However, current methods struggle to represent long-range dependencies. Scaling the depth or width of GNNs is insufficient to broaden receptive fields as larger GNNs…

Machine Learning · Computer Science 2022-01-24 Zhanghao Wu , Paras Jain , Matthew A. Wright , Azalia Mirhoseini , Joseph E. Gonzalez , Ion Stoica

While Graph Neural Networks (GNNs) recently became powerful tools in graph learning tasks, considerable efforts have been spent on improving GNNs' structural encoding ability. A particular line of work proposed subgraph GNNs that use…

Machine Learning · Computer Science 2023-10-31 Lecheng Kong , Jiarui Feng , Hao Liu , Dacheng Tao , Yixin Chen , Muhan Zhang

Graph Neural Networks (GNNs) have become a prominent approach to machine learning with graphs and have been increasingly applied in a multitude of domains. Nevertheless, since most existing GNN models are based on flat message-passing…

Machine Learning · Computer Science 2022-10-27 Zhiqiang Zhong , Cheng-Te Li , Jun Pang

Network alignment (NA) aims to find a node mapping between molecular networks of different species that identifies topologically or functionally similar network regions. Analogous to genomic sequence alignment, NA can be used to transfer…

Molecular Networks · Quantitative Biology 2016-04-07 Vipin Vijayan , Tijana Milenkovic

Graph Transformers (GTs) have significantly advanced the field of graph representation learning by overcoming the limitations of message-passing graph neural networks (GNNs) and demonstrating promising performance and expressive power.…

Machine Learning · Computer Science 2024-05-07 Wenhao Zhu , Guojie Song , Liang Wang , Shaoguo Liu

The recent proliferation of knowledge graphs (KGs) coupled with incomplete or partial information, in the form of missing relations (links) between entities, has fueled a lot of research on knowledge base completion (also known as relation…

Machine Learning · Computer Science 2019-06-05 Deepak Nathani , Jatin Chauhan , Charu Sharma , Manohar Kaul

Graph neural networks (GNNs), and especially message-passing neural networks, excel in various domains such as physics, drug discovery, and molecular modeling. The expressivity of GNNs with respect to their ability to discriminate…

Graph Neural Networks (GNNs) have become powerful tools for learning from graph-structured data, finding applications across diverse domains. However, as graph sizes and connectivity increase, standard GNN training methods face significant…

Machine Learning · Computer Science 2025-12-01 Eshed Gal , Moshe Eliasof , Carola-Bibiane Schönlieb , Ivan I. Kyrchei , Eldad Haber , Eran Treister

Many real-world problems can be represented as graph-based learning problems. In this paper, we propose a novel framework for learning spatial and attentional convolution neural networks on arbitrary graphs. Different from previous…

Machine Learning · Computer Science 2019-02-26 Hao Peng , Jianxin Li , Qiran Gong , Senzhang Wang , Yuanxing Ning , Philip S. Yu

Graph Neural Networks (GNNs) have demonstrated significant success in learning from graph-structured data but often struggle on heterophilous graphs, where connected nodes differ in features or class labels. This limitation arises from…

Machine Learning · Computer Science 2025-09-30 Zhongtian Sun , Anoushka Harit , Alexandra Cristea , Christl A. Donnelly , Pietro Liò

Graph neural networks (GNNs) have been widely used in representation learning on graphs and achieved state-of-the-art performance in tasks such as node classification and link prediction. However, most existing GNNs are designed to learn…

Machine Learning · Computer Science 2020-02-06 Seongjun Yun , Minbyul Jeong , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Heterogeneous graph neural networks (GNNs) achieve strong performance on node classification tasks in a semi-supervised learning setting. However, as in the simpler homogeneous GNN case, message-passing-based heterogeneous GNNs may struggle…

Machine Learning · Computer Science 2022-10-24 Hongjoon Ahn , Yongyi Yang , Quan Gan , Taesup Moon , David Wipf

Attention mechanism is a significant part of Transformer models. It helps extract features from embedded vectors by adding global information and its expressivity has been proved to be powerful. Nevertheless, the quadratic complexity…

Machine Learning · Computer Science 2025-11-11 Hanwen Liu , Yixuan Ma , Shi Jin , Yuguang Wang