English
Related papers

Related papers: OpenGT: A Comprehensive Benchmark For Graph Transf…

200 papers

Graph is a fundamental data structure to model interconnections between entities. Set, on the contrary, stores independent elements. To learn graph representations, current Graph Neural Networks (GNNs) primarily use message passing to…

Machine Learning · Computer Science 2024-06-03 Xiyuan Wang , Pan Li , Muhan Zhang

Vulnerability detection is a critical problem in software security and attracts growing attention both from academia and industry. Traditionally, software security is safeguarded by designated rule-based detectors that heavily rely on…

Software Engineering · Computer Science 2024-06-07 Tiehua Zhang , Rui Xu , Jianping Zhang , Yuze Liu , Xin Chen , Jun Yin , Xi Zheng

The study of Graph Neural Networks has received considerable interest in the past few years. By extending deep learning to graph-structured data, GNNs can solve a diverse set of tasks in fields including social science, chemistry, and…

Machine Learning · Computer Science 2024-03-12 Ashwin Nalwade , Kelly Marshall , Axel Eladi , Umang Sharma

Deep neural networks have enabled researchers to create powerful generalized frameworks, such as transformers, that can be used to solve well-studied problems in various application domains, such as text and image. However, such generalized…

Machine Learning · Computer Science 2025-02-12 Rudrajit Dawn , Madhusudan Ghosh , Partha Basuchowdhuri , Sudip Kumar Naskar

In the last decade or so, we have witnessed deep learning reinvigorating the machine learning field. It has solved many problems in the domains of computer vision, speech recognition, natural language processing, and various other tasks…

Machine Learning · Computer Science 2021-09-09 Lilapati Waikhom , Ripon Patgiri

Graph Neural Networks (GNNs) have gained momentum in graph representation learning and boosted the state of the art in a variety of areas, such as data mining (\emph{e.g.,} social network analysis and recommender systems), computer vision…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Chaoqi Chen , Yushuang Wu , Qiyuan Dai , Hong-Yu Zhou , Mutian Xu , Sibei Yang , Xiaoguang Han , Yizhou Yu

Graph Neural Networks (GNNs) have received considerable attention on graph-structured data learning for a wide variety of tasks. The well-designed propagation mechanism which has been demonstrated effective is the most fundamental part of…

Machine Learning · Computer Science 2021-01-29 Meiqi Zhu , Xiao Wang , Chuan Shi , Houye Ji , Peng Cui

Graph neural networks (GNN) have shown outstanding applications in many fields where data is fundamentally represented as graphs (e.g., chemistry, biology, recommendation systems). In this vein, communication networks comprise many…

In recent years, the Transformer architecture has proven to be very successful in sequence processing, but its application to other data structures, such as graphs, has remained limited due to the difficulty of properly defining positions.…

Machine Learning · Computer Science 2021-10-28 Devin Kreuzer , Dominique Beaini , William L. Hamilton , Vincent Létourneau , Prudencio Tossou

Traffic flow forecasting is a highly challenging task due to the dynamic spatial-temporal road conditions. Graph neural networks (GNN) has been widely applied in this task. However, most of these GNNs ignore the effects of time-varying road…

Machine Learning · Computer Science 2023-07-13 Zhengdao Li , Wei Li , Kai Hwang

The transformer-based semantic segmentation approaches, which divide the image into different regions by sliding windows and model the relation inside each window, have achieved outstanding success. However, since the relation modeling…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Zizhang Wu , Yuanzhu Gan , Tianhao Xu , Fan Wang

It has become a popular paradigm to transfer the knowledge of large-scale pre-trained models to various downstream tasks via fine-tuning the entire model parameters. However, with the growth of model scale and the rising number of…

Machine Learning · Computer Science 2023-05-18 Anchun Gui , Jinqiang Ye , Han Xiao

Graph Neural Networks (GNNs) have emerged as powerful tools for modeling complex, interconnected data, making them particularly well suited for a wide range of Intelligent Transportation System (ITS) applications. This survey presents the…

Emerging Technologies · Computer Science 2025-11-19 Elham Binshaflout , Aymen Hamrouni , Hakim Ghazzai

Graph Neural Networks (GNNs) have gained significant attention in recent years due to their ability to learn representations of graph-structured data. Two common methods for training GNNs are mini-batch training and full-graph training.…

Machine Learning · Computer Science 2024-12-24 Saurabh Bajaj , Hojae Son , Juelin Liu , Hui Guan , Marco Serafini

Graph foundation models (GFMs) have recently attracted interest due to the promise of graph neural network (GNN) architectures that generalize zero-shot across graphs of arbitrary scales, feature dimensions, and domains. While existing work…

Machine Learning · Computer Science 2026-03-25 Benjamin Gutteridge , Michael Bronstein , Xiaowen Dong

Using Large Language Models (LLMs) to process graph-structured data is an active research area, yet current state-of-the-art approaches typically rely on multi-step pipelines with Graph Neural Network (GNN) encoders that compress rich…

Machine Learning · Computer Science 2026-05-12 Dario Vajda

The exploration of Graph Neural Networks (GNNs) for processing graph-structured data has expanded, particularly their potential for causal analysis due to their universal approximation capabilities. Anticipated to significantly enhance…

Machine Learning · Computer Science 2024-01-30 Simi Job , Xiaohui Tao , Taotao Cai , Lin Li , Haoran Xie , Jianming Yong

Inspired by the success of foundation models in applications such as ChatGPT, as graph data has been ubiquitous, one can envision the far-reaching impacts that can be brought by Graph Foundation Models (GFMs) with broader applications in…

Machine Learning · Computer Science 2024-11-12 Zehong Wang , Zheyuan Zhang , Nitesh V Chawla , Chuxu Zhang , Yanfang Ye

Graph Neural Networks (GNNs) have become a central tool for learning on graph-structured data, yet their applicability to real-world systems remains limited by key challenges such as scalability, temporality, directionality, data…

Machine Learning · Computer Science 2025-10-28 Emanuele Rossi

Graph Neural Networks (GNNs) have become the standard method for learning from networks across fields ranging from biology to social systems, yet a principled understanding of what enables them to extract meaningful representations, or why…

Machine Learning · Statistics 2026-03-19 Nil Ayday , Mahalakshmi Sabanayagam , Debarghya Ghoshdastidar