English
Related papers

Related papers: Teaching LLMs to See Graphs: Unifying Text and Str…

200 papers

While large language models (LLMs) have made significant progress in processing and reasoning over knowledge graphs, current methods suffer from a high non-retrieval rate. This limitation reduces the accuracy of answering questions based on…

Machine Learning · Computer Science 2025-03-31 Song Wang , Junhong Lin , Xiaojie Guo , Julian Shun , Jundong Li , Yada Zhu

Enabling large language models (LLMs) to effectively process and reason with graph-structured data remains a significant challenge despite their remarkable success in natural language tasks. Current approaches either convert graph…

Artificial Intelligence · Computer Science 2025-09-03 Yanbiao Ji , Chang Liu , Xin Chen , Dan Luo , Mei Li , Yue Ding , Wenqing Lin , Hongtao Lu

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation. However, they often struggle with complex reasoning tasks and are prone to hallucination. Recent research has shown…

Computation and Language · Computer Science 2024-12-17 Xue Wu , Kostas Tsioutsiouliklis

Graphs, as a relational data structure, have been widely used for various application scenarios, like molecule design and recommender systems. Recently, large language models (LLMs) are reorganizing in the AI community for their expected…

Artificial Intelligence · Computer Science 2025-02-19 Dongqi Fu , Liri Fang , Zihao Li , Hanghang Tong , Vetle I. Torvik , Jingrui He

Large language models (LLMs) have demonstrated impressive capabilities in natural language understanding and generation, including multi-step reasoning such as mathematical proving. However, existing approaches often lack an explicit and…

Computation and Language · Computer Science 2026-05-19 Yutong Li , Yitian Zhou , Xudong Wang , GuoChen , Caiyan Qin

Large language models (LLMs) have recently taken the world by storm. They can generate coherent text, hold meaningful conversations, and be taught concepts and basic sets of instructions - such as the steps of an algorithm. In this context,…

Human-Computer Interaction · Computer Science 2023-03-17 Sara Di Bartolomeo , Giorgio Severi , Victor Schetinger , Cody Dunne

With the rapid advancement of large language models (LLMs), classic graph learning tasks have greatly benefited from LLMs, including improved encoding of textual features, more efficient construction of graphs from text, and enhanced…

Artificial Intelligence · Computer Science 2026-05-05 Xiyuan Wang , Yi Hu , Yanbo Wang , Chuan Shi , Muhan Zhang

The widespread application of Large Language Models (LLMs) has motivated a growing interest in their capacity for processing dynamic graphs. Temporal motifs, as an elementary unit and important local property of dynamic graphs which can…

Machine Learning · Computer Science 2026-03-09 Bing Hao , Minglai Shao , Zengyi Wo , Yunlong Chu , Yuhang Liu , Ruijie Wang

Rich textual and topological information of textual graphs need to be modeled in real-world applications such as webpages, e-commerce, and academic articles. Practitioners have been long following the path of adopting a shallow text encoder…

Computation and Language · Computer Science 2024-07-25 Yun Zhu , Yaoke Wang , Haizhou Shi , Siliang Tang

Generalizing to unseen graph tasks without task-pecific supervision remains challenging. Graph Neural Networks (GNNs) are limited by fixed label spaces, while Large Language Models (LLMs) lack structural inductive biases. Recent advances in…

Machine Learning · Computer Science 2025-08-29 Yicong Wu , Guangyue Lu , Yuan Zuo , Huarong Zhang , Junjie Wu

Inspired by the success of large language models (LLMs), there is a significant research shift from traditional graph learning methods to LLM-based graph frameworks, formally known as GraphLLMs. GraphLLMs leverage the reasoning power of…

Machine Learning · Computer Science 2025-06-16 Qihai Zhang , Xinyue Sheng , Yuanfu Sun , Qiaoyu Tan

In recent years, large language models (LLMs) have demonstrated remarkable generalization capabilities across various natural language processing (NLP) tasks. Similarly, graph foundation models (GFMs) have emerged as a promising direction…

Machine Learning · Computer Science 2025-05-20 Jianxiang Yu , Jiapeng Zhu , Hao Qian , Ziqi Liu , Zhiqiang Zhang , Xiang Li

Graph representation learning, involving both node features and graph structures, is crucial for real-world applications but often encounters pervasive noise. State-of-the-art methods typically address noise by focusing separately on node…

Machine Learning · Computer Science 2024-10-17 Guangxin Su , Yifan Zhu , Wenjie Zhang , Hanchen Wang , Ying Zhang

In this work, we propose a methodology for investigating the use of semantic attention to enhance the explainability of Graph Neural Network (GNN)-based models. Graph Deep Learning (GDL) has emerged as a promising field for tasks like scene…

Machine Learning · Computer Science 2023-10-24 Efimia Panagiotaki , Daniele De Martini , Lars Kunze

Despite the success of Transformer models in vision and language tasks, they often learn knowledge from enormous data implicitly and cannot utilize structured input data directly. On the other hand, structured learning approaches such as…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Xuehai He , Xin Eric Wang

In precision medicine, quantitative multi-omic features, topological context, and textual biological knowledge play vital roles in identifying disease-critical signaling pathways and targets. Existing pipelines capture only part of…

Artificial Intelligence · Computer Science 2025-12-17 Heming Zhang , Di Huang , Wenyu Li , Michael Province , Yixin Chen , Philip Payne , Fuhai Li

Fusing Knowledge Graphs with Large Language Models (LLMs) is crucial for knowledge-intensive tasks like knowledge graph completion. Existing LLM-based approaches typically inject graph information via prefix concatenation, resulting in…

Artificial Intelligence · Computer Science 2026-03-06 Ruitong Liu , Boxu Lin , Peize Li , Siyuan Li , Yunjia Wu , Te Sun , Chaohan Wu

Representation learning on text-attributed graphs (TAGs) has attracted significant interest due to its wide-ranging real-world applications, particularly through Graph Neural Networks (GNNs). Traditional GNN methods focus on encoding the…

Machine Learning · Computer Science 2024-10-07 Xingyu Ji , Jiale Liu , Lu Li , Maojun Wang , Zeyu Zhang

Many NLP applications can be framed as a graph-to-sequence learning problem. Previous work proposing neural architectures on this setting obtained promising results compared to grammar-based approaches but still rely on linearisation…

Computation and Language · Computer Science 2018-06-27 Daniel Beck , Gholamreza Haffari , Trevor Cohn

Recent advances in test-time scaling have enabled Large Language Models (LLMs) to display sophisticated reasoning abilities via extended Chain-of-Thought (CoT) generation. Despite their potential, these Reasoning LLMs (RLMs) often…

Computation and Language · Computer Science 2025-05-21 Zhen Xiong , Yujun Cai , Zhecheng Li , Yiwei Wang