English
Related papers

Related papers: Tailoring Self-Attention for Graph via Rooted Subt…

200 papers

Graph Attention Networks(GATs) are useful deep learning models to deal with the graph data. However, recent works show that the classical GAT is vulnerable to adversarial attacks. It degrades dramatically with slight perturbations.…

Machine Learning · Computer Science 2022-08-05 Xianchen Zhou , Yaoyun Zeng , Hongxia Wang

Graph neural networks (GNNs) have attracted significant attention for their outstanding performance in graph learning and node classification tasks. However, their vulnerability to adversarial attacks, particularly through susceptible…

Machine Learning · Computer Science 2024-11-19 Sepideh Neshatfar , Salimeh Yasaei Sekeh

Graph neural networks have become the standard approach for dealing with learning problems on graphs. Among the different variants of graph neural networks, graph attention networks (GATs) have been applied with great success to different…

Machine Learning · Computer Science 2023-07-18 Michail Chatzianastasis , Giannis Nikolentzos , Michalis Vazirgiannis

Noise and inconsistency commonly exist in real-world information networks, due to inherent error-prone nature of human or user privacy concerns. To date, tremendous efforts have been made to advance feature learning from networks, including…

Machine Learning · Computer Science 2019-12-30 Min Shi , Yufei Tang , Xingquan Zhu , Jianxun Liu

Attention mechanism in graph neural networks is designed to assign larger weights to important neighbor nodes for better representation. However, what graph attention learns is not understood well, particularly when graphs are noisy. In…

Machine Learning · Computer Science 2022-04-12 Dongkwan Kim , Alice Oh

Predicting road traffic speed is a challenging task due to different types of roads, abrupt speed change and spatial dependencies between roads; it requires the modeling of dynamically changing spatial dependencies among roads and temporal…

Machine Learning · Computer Science 2020-10-21 Cheonbok Park , Chunggi Lee , Hyojin Bahng , Yunwon Tae , Kihwan Kim , Seungmin Jin , Sungahn Ko , Jaegul Choo

Accurate classification of Whole Slide Images (WSIs) and Regions of Interest (ROIs) is a fundamental challenge in computational pathology. While mainstream approaches often adopt Multiple Instance Learning (MIL), they struggle to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Mingxi Fu , Xitong Ling , Yuxuan Chen , Jiawen Li , fanglei fu , Huaitian Yuan , Tian Guan , Yonghong He , Lianghui Zhu

A common issue in Graph Neural Networks (GNNs) is known as over-smoothing. By increasing the number of iterations within the message-passing of GNNs, the nodes' representations of the input graph align with each other and become…

Machine Learning · Computer Science 2021-10-22 Christian M. M. Frey , Yunpu Ma , Matthias Schubert

The success of graph neural networks on graph-based web mining highly relies on abundant human-annotated data, which is laborious to obtain in practice. When only few labeled nodes are available, how to improve their robustness is a key to…

Machine Learning · Computer Science 2022-12-13 Kaize Ding , Elnaz Nouri , Guoqing Zheng , Huan Liu , Ryen White

Graph data, also known as complex network data, is omnipresent across various domains and applications. Prior graph neural network models primarily focused on extracting task-specific structural features through supervised learning…

Machine Learning · Computer Science 2024-03-26 Hongyin Zhu

Graphs are widely used to model relational data. As graphs are getting larger and larger in real-world scenarios, there is a trend to store and compute subgraphs in multiple local systems. For example, recently proposed \emph{subgraph…

Machine Learning · Computer Science 2024-01-30 Zaixi Zhang , Qingyong Hu , Yang Yu , Weibo Gao , Qi Liu

While Graph Neural Network (GNN) has shown superiority in learning node representations of homogeneous graphs, leveraging GNN on heterogeneous graphs remains a challenging problem. The dominating reason is that GNN learns node…

Social and Information Networks · Computer Science 2020-09-22 Ziyue Qiao , Pengyang Wang , Yanjie Fu , Yi Du , Pengfei Wang , Yuanchun Zhou

Transformers have demonstrated remarkable performance across diverse domains. The key component of Transformers is self-attention, which learns the relationship between any two tokens in the input sequence. Recent studies have revealed that…

Machine Learning · Computer Science 2025-05-14 Hyowon Wi , Jeongwhan Choi , Noseong Park

Session-based recommendation is a challenging problem in the real-world scenes, e.g., ecommerce, short video platforms, and music platforms, which aims to predict the next click action based on the anonymous session. Recently, graph neural…

Information Retrieval · Computer Science 2022-03-15 Guanghui Zhu , Haojun Hou , Jingfan Chen , Chunfeng Yuan , Yihua Huang

Currently, attention mechanisms have garnered increasing attention in Graph Neural Networks (GNNs), such as Graph Attention Networks (GATs) and Graph Transformers (GTs). It is not only due to the commendable boost in performance they offer…

Machine Learning · Computer Science 2024-10-10 Lijie Hu , Tianhao Huang , Lu Yu , Wanyu Lin , Tianhang Zheng , Di Wang

Graph attention networks learn neighbor importance through data-dependent coefficients, but standard layers lack explicit control over unreliable feature dimensions and use fixed sharpness of attention coefficient distributions. This paper…

Machine Learning · Computer Science 2026-05-29 Zhongtian Ma , Hao Wu , Yexin Zhang , Qiaosheng Zhang , Zhen Wang

The task of link prediction aims to solve the problem of incomplete knowledge caused by the difficulty of collecting facts from the real world. GCNs-based models are widely applied to solve link prediction problems due to their…

Artificial Intelligence · Computer Science 2022-09-07 Shuanglong Yao , Dechang Pi , Junfu Chen , Yufei Liu , Zhiyuan Wu

Graph Neural Networks (GNNs) have been successfully used in many problems involving graph-structured data, achieving state-of-the-art performance. GNNs typically employ a message-passing scheme, in which every node aggregates information…

Machine Learning · Computer Science 2022-11-22 Michail Chatzianastasis , Johannes F. Lutzeyer , George Dasoulas , Michalis Vazirgiannis

Graph classification is a pivotal challenge in machine learning, especially within the realm of graph-based data, given its importance in numerous real-world applications such as social network analysis, recommendation systems, and…

Machine Learning · Computer Science 2024-07-03 Bowen Zhang , Zhichao Huang , Genan Dai , Guangning Xu , Xiaomao Fan , Hu Huang

The Transformer architecture has achieved remarkable success in a number of domains including natural language processing and computer vision. However, when it comes to graph-structured data, transformers have not achieved competitive…

Machine Learning · Computer Science 2022-10-11 Zaixi Zhang , Qi Liu , Qingyong Hu , Chee-Kong Lee