English
Related papers

Related papers: Plain Transformers are Surprisingly Powerful Link …

200 papers

Graphs face challenges when dealing with massive datasets. They are essential tools for modeling interconnected data and often become computationally expensive. Graph embedding techniques, on the other hand, provide an efficient approach.…

Databases · Computer Science 2024-12-16 Plácido A Souza Neto

Graph convolutional networks (GCNs) are widely used in graph-based applications such as graph classification and segmentation. However, current GCNs have limitations on implementation such as network architectures due to their irregular…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Yecheng Lyu , Xinming Huang , Ziming Zhang

Heterogeneous graphs are ubiquitous in real-world applications because they can represent various relationships between different types of entities. Therefore, learning embeddings in such graphs is a critical problem in graph machine…

Machine Learning · Computer Science 2024-04-02 Yue Zhang , Yuntian He , Saket Gurukar , Srinivasan Parthasarathy

Graph Transformers (GTs) have recently demonstrated remarkable performance across diverse domains. By leveraging attention mechanisms, GTs are capable of modeling long-range dependencies and complex structural relationships beyond local…

Machine Learning · Computer Science 2025-06-06 Jiachen Tang , Zhonghao Wang , Sirui Chen , Sheng Zhou , Jiawei Chen , Jiajun Bu

To alleviate the local receptive issue of GCN, Transformers have been exploited to capture the long range dependences of nodes for graph data representation and learning. However, existing graph Transformers generally employ regular…

Machine Learning · Computer Science 2023-05-15 Bo Jiang , Fei Xu , Ziyan Zhang , Jin Tang , Feiping Nie

A few models have tried to tackle the link prediction problem, also known as knowledge graph completion, by embedding knowledge graphs in comparably lower dimensions. However, the state-of-the-art results are attained at the cost of…

Machine Learning · Computer Science 2022-11-29 Peyman Baghershahi , Reshad Hosseini , Hadi Moradi

Graph neural networks (GNNs) have limited expressive power, failing to represent many graph classes correctly. While more expressive graph representation learning (GRL) alternatives can distinguish some of these classes, they are…

Machine Learning · Computer Science 2021-12-08 Leonardo Cotta , Christopher Morris , Bruno Ribeiro

Multiplex graphs capture diverse relations among shared nodes. Most predictors either collapse layers or treat them independently. This loses crucial inter-layer dependencies and struggles with scalability. To overcome this, we frame…

Machine Learning · Computer Science 2025-09-30 Devesh Sharma , Aditya Kishore , Ayush Garg , Debajyoti Mazumder , Debasis Mohapatra , Jasabanta Patro

Graph Neural Networks (GNNs) have demonstrated significant success in learning from graph-structured data but often struggle on heterophilous graphs, where connected nodes differ in features or class labels. This limitation arises from…

Machine Learning · Computer Science 2025-09-30 Zhongtian Sun , Anoushka Harit , Alexandra Cristea , Christl A. Donnelly , Pietro Liò

Graph transformer networks (GTN) are a variant of graph convolutional networks (GCN) that are targeted to heterogeneous graphs in which nodes and edges have associated type information that can be exploited to improve inference accuracy.…

Artificial Intelligence · Computer Science 2021-06-17 Loc Hoang , Udit Agarwal , Gurbinder Gill , Roshan Dathathri , Abhik Seal , Brian Martin , Keshav Pingali

Software vulnerability detection is crucial for high-quality software development. Recently, some studies utilizing Graph Neural Networks (GNNs) to learn the graph representation of code in vulnerability detection tasks have achieved…

Software Engineering · Computer Science 2024-12-16 Xin Peng , Shangwen Wang , Yihao Qin , Bo Lin , Liqian Chen , Xiaoguang Mao

Inferring missing links or detecting spurious ones based on observed graphs, known as link prediction, is a long-standing challenge in graph data analysis. With the recent advances in deep learning, graph neural networks have been used for…

Social and Information Networks · Computer Science 2023-01-03 Xingping Xian , Tao Wu , Xiaoke Ma , Shaojie Qiao , Yabin Shao , Chao Wang , Lin Yuan , Yu Wu

Graph Convolutional Networks (GCNs) have been shown to be a powerful concept that has been successfully applied to a large variety of tasks across many domains over the past years. In this work we study the theory that paved the way to the…

Machine Learning · Computer Science 2022-07-13 Matteo Bunino

Graph Neural Networks (GNNs) have shown remarkable success across various scientific fields, yet their adoption in critical decision-making is often hindered by a lack of interpretability. Recently, intrinsically interpretable GNNs have…

Machine Learning · Computer Science 2025-10-07 Cheng Xin , Fan Xu , Xin Ding , Jie Gao , Jiaxin Ding

The dominant paradigm for machine learning on graphs uses Message Passing Graph Neural Networks (MP-GNNs), in which node representations are updated by aggregating information in their local neighborhood. Recently, there have been…

Machine Learning · Computer Science 2023-03-02 Daniel Glickman , Eran Yahav

Collaborative recommendation fundamentally involves learning high-quality user and item representations from interaction data. Recently, graph convolution networks (GCNs) have advanced the field by utilizing high-order connectivity patterns…

Information Retrieval · Computer Science 2024-12-30 Jiajia Chen , Jiancan Wu , Jiawei Chen , Chongming Gao , Yong Li , Xiang Wang

The local inductive bias of message-passing graph neural networks (GNNs) hampers their ability to exploit key structural information (e.g., connectivity and cycles). Positional encoding (PE) and Persistent Homology (PH) have emerged as two…

Machine Learning · Computer Science 2025-06-09 Yogesh Verma , Amauri H. Souza , Vikas Garg

As powerful tools for representation learning on graphs, graph neural networks (GNNs) have facilitated various applications from drug discovery to recommender systems. Nevertheless, the effectiveness of GNNs is immensely challenged by…

Machine Learning · Computer Science 2023-02-28 Wei Jin , Tong Zhao , Jiayuan Ding , Yozen Liu , Jiliang Tang , Neil Shah

Temporal graphs are widespread in real-world applications such as social networks, as well as trade and transportation networks. Predicting dynamic links within these evolving graphs is a key problem. Many memory-based methods use temporal…

Machine Learning · Computer Science 2025-12-16 Xiaohui Zhang , Yanbo Wang , Xiyuan Wang , Muhan Zhang

Graph Neural Networks (GNNs) have shown promising results in various tasks, among which link prediction is an important one. GNN models usually follow a node-centric message passing procedure that aggregates the neighborhood information to…

Machine Learning · Computer Science 2022-01-17 Baole Ai , Zhou Qin , Wenting Shen , Yong Li