English
Related papers

Related papers: GraphReason: Enhancing Reasoning Capabilities of L…

200 papers

Large Language Models (LLMs) have demonstrated strong reasoning abilities, making them suitable for complex tasks such as graph computation. Traditional reasoning steps paradigm for graph problems is hindered by unverifiable steps, limited…

Computation and Language · Computer Science 2024-10-28 Qifan Zhang , Xiaobin Hong , Jianheng Tang , Nuo Chen , Yuhan Li , Wenzhong Li , Jing Tang , Jia Li

The advent of Large Language Models (LLMs) has significantly transformed the AI landscape, enhancing machine learning and AI capabilities. Factuality issue is a critical concern for LLMs, as they may generate factually incorrect responses.…

Computation and Language · Computer Science 2024-04-02 Xiaoze Liu , Feijie Wu , Tianyang Xu , Zhuo Chen , Yichi Zhang , Xiaoqian Wang , Jing Gao

Large Language Models (LLMs) have garnered considerable interest within both academic and industrial. Yet, the application of LLMs to graph data remains under-explored. In this study, we evaluate the capabilities of four LLMs in addressing…

Artificial Intelligence · Computer Science 2023-09-12 Chang Liu , Bo Wu

Large Language Models (LLMs) excel at generating natural language answers, yet their outputs often remain unverifiable and difficult to trace. Knowledge Graphs (KGs) offer a complementary strength by representing entities and their…

Computation and Language · Computer Science 2025-12-05 Alfonso Amayuelas , Joy Sain , Simerjot Kaur , Charese Smiley

Large language models (LLMs) have demonstrated impressive capabilities in natural language understanding and generation, including multi-step reasoning such as mathematical proving. However, existing approaches often lack an explicit and…

Computation and Language · Computer Science 2026-05-19 Yutong Li , Yitian Zhou , Xudong Wang , GuoChen , Caiyan Qin

Large Language Models (LLMs) have made remarkable strides in reasoning tasks, yet their performance often falters on novel and complex problems. Domain-specific continued pretraining (CPT) methods, such as those tailored for mathematical…

Artificial Intelligence · Computer Science 2025-07-24 Qifan Zhang , Nuo Chen , Zehua Li , Miao Peng , Jing Tang , Jia Li

Developments in Graph-Language Models (GLMs) aim to integrate the structural reasoning capabilities of Graph Neural Networks (GNNs) with the semantic understanding of Large Language Models (LLMs). However, we demonstrate that current…

Computation and Language · Computer Science 2025-08-29 Soham Petkar , Hari Aakash K , Anirudh Vempati , Akshit Sinha , Ponnurangam Kumarauguru , Chirag Agarwal

While Large Language Models (LLMs) demonstrate exceptional performance in a multitude of Natural Language Processing (NLP) tasks, they encounter challenges in practical applications, including issues with hallucinations, inadequate…

Computation and Language · Computer Science 2024-06-13 Yihao Li , Ru Zhang , Jianyi Liu

Recent research has explored the use of Large Language Models (LLMs) for tackling complex graph reasoning tasks. However, due to the intricacies of graph structures and the inherent limitations of LLMs in handling long text, current…

Artificial Intelligence · Computer Science 2025-11-26 Yuwei Hu , Runlin Lei , Xinyi Huang , Zhewei Wei , Yongchao Liu

Confidence estimation is essential for the reliable deployment of large language models (LLMs). Existing methods are primarily designed for factual QA tasks and often fail to generalize to reasoning tasks. To address this gap, we propose a…

Computation and Language · Computer Science 2025-09-17 Caiqi Zhang , Chang Shu , Ehsan Shareghi , Nigel Collier

Large Language Models (LLMs) have shown remarkable capabilities in processing various data structures, including graphs. While previous research has focused on developing textual encoding methods for graph representation, the emergence of…

Machine Learning · Computer Science 2024-09-16 Zhiqiang Zhong , Davide Mottin

Large Language Models (LLMs) show strong reasoning ability in open-domain question answering, yet their reasoning processes are typically linear and often logically inconsistent. In contrast, real-world reasoning requires integrating…

Computation and Language · Computer Science 2026-01-21 Yingjian Chen , Haoran Liu , Yinhong Liu , Sherry T. Tong , Aosong Feng , Jinghui Lu , Juntao Zhang , Yusuke Iwasawa , Yutaka Matsuo , Irene Li

This paper introduces GraphOmni, a comprehensive benchmark designed to evaluate the reasoning capabilities of LLMs on graph-theoretic tasks articulated in natural language. GraphOmni encompasses diverse graph types, serialization formats,…

With the rapid advancement of large language models (LLMs), classic graph learning tasks have greatly benefited from LLMs, including improved encoding of textual features, more efficient construction of graphs from text, and enhanced…

Artificial Intelligence · Computer Science 2026-05-05 Xiyuan Wang , Yi Hu , Yanbo Wang , Chuan Shi , Muhan Zhang

Large Language Models (LLMs) have shown human-like reasoning abilities but still struggle with complex logical problems. This paper introduces a novel framework, Logic-LM, which integrates LLMs with symbolic solvers to improve logical…

Computation and Language · Computer Science 2023-10-20 Liangming Pan , Alon Albalak , Xinyi Wang , William Yang Wang

The advancement of large language models (LLMs) for real-world applications hinges critically on enhancing their reasoning capabilities. In this work, we explore the reasoning abilities of large language models (LLMs) through their…

Artificial Intelligence · Computer Science 2024-07-04 Romain Cosentino , Sarath Shekkizhar

Large Language Models (LLMs) excel at intuitive, implicit reasoning. Guiding LLMs to construct thought chains can enhance their deliberate reasoning abilities, but also faces challenges such as hallucination. Knowledge Graphs (KGs) can…

Computation and Language · Computer Science 2025-03-07 Guangyi Liu , Yongqi Zhang , Yong Li , Quanming Yao

Large language models (LLMs) are increasingly used for text-rich graph machine learning tasks such as node classification in high-impact domains like fraud detection and recommendation systems. Yet, despite a surge of interest, the field…

Computation and Language · Computer Science 2026-03-03 Ben Finkelshtein , Silviu Cucerzan , Sujay Kumar Jauhar , Ryen White

Large language models (LLMs) have achieved significant success in reasoning tasks, including mathematical reasoning and logical deduction. Among these reasoning tasks, graph problems stand out due to their complexity and unique structural…

Artificial Intelligence · Computer Science 2025-10-15 Yuyao Ge , Shenghua Liu , Baolong Bi , Yiwei Wang , Lingrui Mei , Wenjie Feng , Lizhe Chen , Xueqi Cheng

Do current large language models (LLMs) better solve graph reasoning and generation tasks with parameter updates? In this paper, we propose InstructGraph, a framework that empowers LLMs with the abilities of graph reasoning and generation…

Computation and Language · Computer Science 2024-02-15 Jianing Wang , Junda Wu , Yupeng Hou , Yao Liu , Ming Gao , Julian McAuley