English
Related papers

Related papers: LightTopoGAT: Enhancing Graph Attention Networks w…

200 papers

Graph neural networks (GNN) have shown significant capabilities in handling structured data, yet their application to dynamic, temporal data remains limited. This paper presents a new type of graph attention network, called TempoKGAT, which…

Machine Learning · Computer Science 2024-12-24 Lena Sasal , Daniel Busby , Abdenour Hadid

Graph Attention Network (GAT) is one of the most popular Graph Neural Network (GNN) architecture, which employs the attention mechanism to learn edge weights and has demonstrated promising performance in various applications. However, since…

Machine Learning · Computer Science 2024-03-05 Qincheng Lu , Jiaqi Zhu , Sitao Luan , Xiao-Wen Chang

The attention mechanism has demonstrated superior performance for inference over nodes in graph neural networks (GNNs), however, they result in a high computational burden during both training and inference. We propose FastGAT, a method to…

Machine Learning · Computer Science 2020-10-06 Rakshith S Srinivasa , Cao Xiao , Lucas Glass , Justin Romberg , Jimeng Sun

Online continual learning for image classification is crucial for models to adapt to new data while retaining knowledge of previously learned tasks. This capability is essential to address real-world challenges involving dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Adjovi Sim , Zhengkui Wang , Aik Beng Ng , Shalini De Mello , Simon See , Wonmin Byeon

Graph Neural Networks (GNNs) have been widely studied for graph data representation and learning. However, existing GNNs generally conduct context-aware learning on node feature representation only which usually ignores the learning of edge…

Machine Learning · Computer Science 2019-10-07 Bo Jiang , Leiling Wang , Jin Tang , Bin Luo

Graph Attention Networks (GATs) are the state-of-the-art neural architecture for representation learning with graphs. GATs learn attention functions that assign weights to nodes so that different nodes have different influences in the…

Machine Learning · Computer Science 2019-10-29 Guangtao Wang , Rex Ying , Jing Huang , Jure Leskovec

Graph Attention Networks (GATs) have emerged as powerful models for learning expressive representations from such data by adaptively weighting neighboring nodes through attention mechanisms. However, most existing approaches primarily rely…

Machine Learning · Computer Science 2026-02-05 Farshad Noravesh , Reza Haffari , Layki Soon , Arghya Pal

Text classification is a critical research topic with broad applications in natural language processing. Recently, graph neural networks (GNNs) have received increasing attention in the research community and demonstrated their promising…

Computation and Language · Computer Science 2020-11-03 Kaize Ding , Jianling Wang , Jundong Li , Dingcheng Li , Huan Liu

In this paper, we present CrimeGAT, a novel application of Graph Attention Networks (GATs) for predictive policing in criminal networks. Criminal networks pose unique challenges for predictive analytics due to their complex structure,…

Social and Information Networks · Computer Science 2023-12-01 Chen Yang

Heterogeneous graphs have multiple node and edge types and are semantically richer than homogeneous graphs. To learn such complex semantics, many graph neural network approaches for heterogeneous graphs use metapaths to capture multi-hop…

Machine Learning · Computer Science 2022-07-26 See Hian Lee , Feng Ji , Wee Peng Tay

Graph Attention Network (GAT) and GraphSAGE are neural network architectures that operate on graph-structured data and have been widely studied for link prediction and node classification. One challenge raised by GraphSAGE is how to smartly…

Machine Learning · Computer Science 2020-06-09 Anderson de Andrade , Chen Liu

We present graph attention networks (GATs), novel neural network architectures that operate on graph-structured data, leveraging masked self-attentional layers to address the shortcomings of prior methods based on graph convolutions or…

Machine Learning · Statistics 2018-02-06 Petar Veličković , Guillem Cucurull , Arantxa Casanova , Adriana Romero , Pietro Liò , Yoshua Bengio

In recent years, graph representation learning has undergone a paradigm shift, driven by the emergence and proliferation of graph neural networks (GNNs) and their heterogeneous counterparts. Heterogeneous GNNs have shown remarkable success…

Machine Learning · Computer Science 2024-11-28 Yichen Wang , Jie Wang , Fulin Wang , Xiang Li , Hao Yin , Bhiksha Raj

Graph Neural Networks (GNNs) have garnered substantial attention due to their remarkable capability in learning graph representations. However, real-world graphs often exhibit substantial noise and incompleteness, which severely degrades…

Machine Learning · Computer Science 2025-06-30 Tao Liu , Longlong Lin , Yunfeng Yu , Xi Ou , Youan Zhang , Zhiqiu Ye , Tao Jia

We present an attention-based spatial graph convolution (AGC) for graph neural networks (GNNs). Existing AGCs focus on only using node-wise features and utilizing one type of attention function when calculating attention weights. Instead,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Li , Yuichi Tanaka

Lots of neural network architectures have been proposed to deal with learning tasks on graph-structured data. However, most of these models concentrate on only node features during the learning process. The edge features, which usually play…

Machine Learning · Computer Science 2021-01-20 Jun Chen , Haopeng Chen

Linear attention mechanisms have emerged as efficient alternatives to full self-attention in Graph Transformers, offering linear time complexity. However, existing linear attention models often suffer from a significant drop in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Zhaolin Hu , Kun Li , Hehe Fan , Yi Yang

For automotive applications, the Graph Attention Network (GAT) is a prominently used architecture to include relational information of a traffic scenario during feature embedding. As shown in this work, however, one of the most popular GAT…

Machine Learning · Computer Science 2023-05-26 Marion Neumeier , Andreas Tollkühn , Sebastian Dorn , Michael Botsch , Wolfgang Utschick

Graph Neural Networks (GNNs) have demonstrated significant success in learning from graph-structured data but often struggle on heterophilous graphs, where connected nodes differ in features or class labels. This limitation arises from…

Machine Learning · Computer Science 2025-09-30 Zhongtian Sun , Anoushka Harit , Alexandra Cristea , Christl A. Donnelly , Pietro Liò

Graph representation learning methods have been widely adopted in financial applications to enhance company representations by leveraging inter-firm relationships. However, current approaches face three key challenges: (1) The advantages of…

Statistical Finance · Quantitative Finance 2025-07-04 Yingjie Niu , Mingchuan Zhao , Valerio Poti , Ruihai Dong
‹ Prev 1 2 3 10 Next ›