English
Related papers

Related papers: Attention Mechanisms Perspective: Exploring LLM Pr…

200 papers

Graphs with abundant attributes are essential in modeling interconnected entities and enhancing predictions across various real-world applications. Traditional Graph Neural Networks (GNNs) often require re-training for different graph tasks…

Computation and Language · Computer Science 2026-05-26 Yanchao Tan , Hang Lv , Pengxiang Zhan , Shiping Wang , Carl Yang

Graph neural networks (GNNs) are vulnerable to adversarial attacks, especially for topology perturbations, and many methods that improve the robustness of GNNs have received considerable attention. Recently, we have witnessed the…

Machine Learning · Computer Science 2024-12-25 Zhongjian Zhang , Xiao Wang , Huichi Zhou , Yue Yu , Mengmei Zhang , Cheng Yang , Chuan Shi

Developments in Graph-Language Models (GLMs) aim to integrate the structural reasoning capabilities of Graph Neural Networks (GNNs) with the semantic understanding of Large Language Models (LLMs). However, we demonstrate that current…

Computation and Language · Computer Science 2025-08-29 Soham Petkar , Hari Aakash K , Anirudh Vempati , Akshit Sinha , Ponnurangam Kumarauguru , Chirag Agarwal

Graph plays a significant role in representing and analyzing complex relationships in real-world applications such as citation networks, social networks, and biological data. Recently, Large Language Models (LLMs), which have achieved…

Machine Learning · Computer Science 2024-04-25 Yuhan Li , Zhixun Li , Peisong Wang , Jia Li , Xiangguo Sun , Hong Cheng , Jeffrey Xu Yu

Large Language Models (LLMs) show remarkable semantic understanding but often struggle with structural understanding when processing graph topologies in a serialized format. Existing solutions rely on training external graph-based adapters…

Artificial Intelligence · Computer Science 2026-05-19 Yiming Liu , Bin Lu , Xinbing Wang , Chenghu Zhou , Meng Jin

Community detection in social network graphs plays a vital role in uncovering group dynamics, influence pathways, and the spread of information. Traditional methods focus primarily on graph structural properties, but recent advancements in…

Social and Information Networks · Computer Science 2025-08-01 Ekta Gujral , Apurva Sinha

Graph Neural Networks (GNNs) have attracted immense attention in the past decade due to their numerous real-world applications built around graph-structured data. On the other hand, Large Language Models (LLMs) with extensive pretrained…

Graph Neural Networks (GNNs) have attracted increasing attention in recent years and have achieved excellent performance in semi-supervised node classification tasks. The success of most GNNs relies on one fundamental assumption, i.e., the…

Machine Learning · Computer Science 2024-12-03 Junchao Lin , Yuan Wan , Jingwen Xu , Xingchen Qi

Despite significant advancements, Large Language Models (LLMs) exhibit blind spots that impair their ability to retrieve and process relevant contextual data effectively. We demonstrate that LLM performance in graph tasks with complexities…

Artificial Intelligence · Computer Science 2025-01-03 Hamed Firooz , Maziar Sanjabi , Wenlong Jiang , Xiaoling Zhai

Large Language Models (LLMs) have achieved impressive performance in text understanding and have become an essential tool for building smart assistants. Originally focusing on text, they have been enhanced with multimodal capabilities in…

Software Engineering · Computer Science 2024-10-24 Aaron Haag , Vlad Argatu , Oliver Lohse

Large Language Models (LLMs) face significant limitations when applied to large-scale graphs, struggling with context constraints and inflexible reasoning. We present GraphChain, a framework that enables LLMs to analyze complex graphs…

Artificial Intelligence · Computer Science 2025-11-11 Chunyu Wei , Wenji Hu , Xingjia Hao , Xin Wang , Yifan Yang , Yueguo Chen , Yang Tian , Yunhai Wang

Recent prevailing works on graph machine learning typically follow a similar methodology that involves designing advanced variants of graph neural networks (GNNs) to maintain the superior performance of GNNs on different graphs. In this…

Machine Learning · Computer Science 2024-06-07 Yiran Qiao , Xiang Ao , Yang Liu , Jiarong Xu , Xiaoqian Sun , Qing He

The remarkable success of large language models (LLMs) has motivated researchers to adapt them as universal predictors for various graph-related tasks, with the ultimate goal of developing a graph foundation model that generalizes diverse…

Computation and Language · Computer Science 2026-03-03 Zhongjian Zhang , Xiao Wang , Mengmei Zhang , Jiarui Tan , Chuan Shi

Graph problems are fundamentally challenging for large language models (LLMs). While LLMs excel at processing unstructured text, graph tasks require reasoning over explicit structure, permutation invariance, and computationally complex…

Machine Learning · Computer Science 2026-04-23 Angelo Zangari , Peyman Baghershahi , Sourav Medya

Large language models (LLMs) have presented significant opportunities to enhance various machine learning applications, including graph neural networks (GNNs). By leveraging the vast open-world knowledge within LLMs, we can more effectively…

Machine Learning · Computer Science 2025-02-18 Yuxia Wu , Shujie Li , Yuan Fang , Chuan Shi

Large language models (LLMs) are increasingly adopted for a variety of tasks with implicit graphical structures, such as planning in robotics, multi-hop question answering or knowledge probing, structured commonsense reasoning, and more.…

Computation and Language · Computer Science 2024-01-09 Heng Wang , Shangbin Feng , Tianxing He , Zhaoxuan Tan , Xiaochuang Han , Yulia Tsvetkov

Graph-structured data are the commonly used and have wide application scenarios in the real world. For these diverse applications, the vast variety of learning tasks, graph domains, and complex graph learning procedures present challenges…

Machine Learning · Computer Science 2024-02-26 Lanning Wei , Jun Gao , Huan Zhao , Quanming Yao

Large language models are extensively applied across a wide range of tasks, such as customer support, content creation, educational tutoring, and providing financial guidance. However, a well-known drawback is their predisposition to…

Computation and Language · Computer Science 2024-07-08 Noa Nonkes , Sergei Agaronian , Evangelos Kanoulas , Roxana Petcu

Integrating large language models (LLMs) with knowledge graphs derived from domain-specific data represents an important advancement towards more powerful and factual reasoning. As these models grow more capable, it is crucial to enable…

Artificial Intelligence · Computer Science 2024-04-19 Stefan Dernbach , Khushbu Agarwal , Alejandro Zuniga , Michael Henry , Sutanay Choudhury

Graphs are a powerful tool for representing and analyzing complex relationships in real-world applications such as social networks, recommender systems, and computational finance. Reasoning on graphs is essential for drawing inferences…

Machine Learning · Computer Science 2023-10-10 Bahare Fatemi , Jonathan Halcrow , Bryan Perozzi