English
Related papers

Related papers: Attention Models in Graphs: A Survey

200 papers

Graphs are essential representations of many real-world data such as social networks. Recent years have witnessed the increasing efforts made to extend the neural network models to graph-structured data. These methods, which are usually…

Machine Learning · Computer Science 2018-11-07 Yao Ma , Ziyi Guo , Zhaochun Ren , Eric Zhao , Jiliang Tang , Dawei Yin

Graphs are widely used in various fields of computer science. They have also found application in unrelated areas, leading to a diverse range of problems. These problems can be modeled as relationships between entities in various contexts,…

Data Structures and Algorithms · Computer Science 2024-05-20 Davide Rucci

Graph Neural Networks (GNNs) extend the success of neural networks to graph-structured data by accounting for their intrinsic geometry. While extensive research has been done on developing GNN models with superior performance according to a…

Graph neural networks (GNNs) have attracted much attention because of their excellent performance on tasks such as node classification. However, there is inadequate understanding on how and why GNNs work, especially for node representation…

Machine Learning · Computer Science 2020-06-09 Guoji Fu , Yifan Hou , Jian Zhang , Kaili Ma , Barakeel Fanseu Kamhoua , James Cheng

Graph Neural Networks (GNN) have shown remarkable performance in different tasks. However, there are a few studies about GNN on recommender systems. GCN as a type of GNNs can extract high-quality embeddings for different entities in a…

Information Retrieval · Computer Science 2022-01-17 Taher Hekmatfar , Saman Haratizadeh , Parsa Razban , Sama Goliaei

One of the emerging techniques in node classification in heterogeneous graphs is to restrict message aggregation to pre-defined, semantically meaningful structures called metapaths. This work is the first attempt to incorporate attention…

Machine Learning · Computer Science 2024-12-31 Calder Katyal

Graphs naturally appear in several real-world contexts including social networks, the web network, and telecommunication networks. While the analysis and the understanding of graph structures have been a central area of study in algorithm…

Data Structures and Algorithms · Computer Science 2019-09-17 Gramoz Goranci

We argue that Transformers are essentially graph-to-graph models, with sequences just being a special case. Attention weights are functionally equivalent to graph edges. Our Graph-to-Graph Transformer architecture makes this ability…

Computation and Language · Computer Science 2023-10-30 James Henderson , Alireza Mohammadshahi , Andrei C. Coman , Lesly Miculicich

Scene graph representations, which form a graph of visual object nodes together with their attributes and relations, have proved useful across a variety of vision and language applications. Recent work in the area has used Natural Language…

Computation and Language · Computer Science 2019-09-16 Martin Andrews , Yew Ken Chia , Sam Witteveen

Recently, several studies have explored methods for using KG embedding to answer logical queries. These approaches either treat embedding learning and query answering as two separated learning tasks, or fail to deal with the variability of…

Machine Learning · Computer Science 2019-10-02 Gengchen Mai , Krzysztof Janowicz , Bo Yan , Rui Zhu , Ling Cai , Ni Lao

Graph neural networks (GNNs) are powerful deep learning models for graph-structured data, demonstrating remarkable success across diverse domains. Recently, the database (DB) community has increasingly recognized the potentiality of GNNs,…

Databases · Computer Science 2025-02-20 Ziming Li , Youhuan Li , Yuyu Luo , Guoliang Li , Chuxu Zhang

Graph-structured data appears frequently in domains including chemistry, natural language semantics, social networks, and knowledge bases. In this work, we study feature learning techniques for graph-structured inputs. Our starting point is…

Machine Learning · Computer Science 2017-09-26 Yujia Li , Daniel Tarlow , Marc Brockschmidt , Richard Zemel

We present an attention-based spatial graph convolution (AGC) for graph neural networks (GNNs). Existing AGCs focus on only using node-wise features and utilizing one type of attention function when calculating attention weights. Instead,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Li , Yuichi Tanaka

Graph learning is a prevalent domain that endeavors to learn the intricate relationships among nodes and the topological structure of graphs. Over the years, graph learning has transcended from graph theory to graph data mining. With the…

Artificial Intelligence · Computer Science 2024-09-24 Shaopeng Wei , Jun Wang , Yu Zhao , Xingyan Chen , Qing Li , Fuzhen Zhuang , Ji Liu , Fuji Ren , Gang Kou

While advances in computing resources have made processing enormous amounts of data possible, human ability to identify patterns in such data has not scaled accordingly. Efficient computational methods for condensing and simplifying data…

Information Retrieval · Computer Science 2020-04-03 Yike Liu , Tara Safavi , Abhilash Dighe , Danai Koutra

Data augmentation has recently seen increased interest in graph machine learning given its demonstrated ability to improve model performance and generalization by added training data. Despite this recent surge, the area is still relatively…

Machine Learning · Computer Science 2023-01-20 Tong Zhao , Wei Jin , Yozen Liu , Yingheng Wang , Gang Liu , Stephan Günnemann , Neil Shah , Meng Jiang

In today's information-driven world, access to scientific publications has become increasingly easy. At the same time, filtering through the massive volume of available research has become more challenging than ever. Graph Neural Networks…

Information Retrieval · Computer Science 2025-12-23 Shikshya Shiwakoti , Samuel Goldsmith , Ujjwal Pandit

Graph Neural Networks (GNNs) have attracted increasing attention in recent years and have achieved excellent performance in semi-supervised node classification tasks. The success of most GNNs relies on one fundamental assumption, i.e., the…

Machine Learning · Computer Science 2024-12-03 Junchao Lin , Yuan Wan , Jingwen Xu , Xingchen Qi

In the last decade or so, we have witnessed deep learning reinvigorating the machine learning field. It has solved many problems in the domains of computer vision, speech recognition, natural language processing, and various other tasks…

Machine Learning · Computer Science 2021-09-09 Lilapati Waikhom , Ripon Patgiri

This paper designs and implements an explainable recommendation model that integrates knowledge graphs with structure-aware attention mechanisms. The model is built on graph neural networks and incorporates a multi-hop neighbor aggregation…

Information Retrieval · Computer Science 2025-10-14 Shuangquan Lyu , Ming Wang , Huajun Zhang , Jiasen Zheng , Junjiang Lin , Xiaoxuan Sun