English
Related papers

Related papers: Graph-Augmented Reasoning: Evolving Step-by-Step K…

200 papers

Graph-based retrieval-augmented generation (RAG) enriches large language models (LLMs) with external knowledge for long-context understanding and multi-hop reasoning, but existing methods face a granularity dilemma: fine-grained…

Computation and Language · Computer Science 2025-09-26 Yaxiong Wu , Jianyuan Bo , Yongyue Zhang , Sheng Liang , Yong Liu

Large language models (LLMs) typically improve performance by either retrieving semantically similar information, or enhancing reasoning abilities through structured prompts like chain-of-thought. While both strategies are considered…

Computation and Language · Computer Science 2024-10-16 Yejin Kim , Eojin Kang , Juae Kim , H. Howie Huang

E-Commerce customer support requires quick and accurate answers grounded in product data and past support cases. This paper develops a novel retrieval-augmented generation (RAG) framework that uses knowledge graphs (KGs) to improve the…

Computation and Language · Computer Science 2025-09-19 Piyushkumar Patel

The integration of Knowledge Graphs (KGs) into the Retrieval Augmented Generation (RAG) framework has attracted significant interest, with early studies showing promise in mitigating hallucinations and improving model accuracy. However, a…

Artificial Intelligence · Computer Science 2025-05-20 Xujie Yuan , Yongxu Liu , Shimin Di , Shiwen Wu , Libin Zheng , Rui Meng , Lei Chen , Xiaofang Zhou , Jian Yin

Retrieval-Augmented Generation (RAG) integrates non-parametric knowledge into Large Language Models (LLMs), typically from unstructured texts and structured graphs. While recent progress has advanced text-based RAG to multi-turn reasoning…

Computation and Language · Computer Science 2025-12-11 Yucan Guo , Miao Su , Saiping Guan , Zihao Sun , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

This paper presents RAG-KG-IL, a novel multi-agent hybrid framework designed to enhance the reasoning capabilities of Large Language Models (LLMs) by integrating Retrieval-Augmented Generation (RAG) and Knowledge Graphs (KGs) with an…

Computation and Language · Computer Science 2025-03-19 Hong Qing Yu , Frank McQuade

Large Language Models (LLMs) have showcased impressive reasoning capabilities, particularly when guided by specifically designed prompts in complex reasoning tasks such as math word problems. These models typically solve tasks using a…

Artificial Intelligence · Computer Science 2024-04-23 Lang Cao

Despite the rapid progress of large language models (LLMs), knowledge graph-based question answering (KGQA) remains essential for producing verifiable and hallucination-resistant answers in many real-world settings where answer…

Computation and Language · Computer Science 2026-01-21 Ruijie Wang , Luca Rossetto , Michael Cochez , Abraham Bernstein

Graph-based Retrieval-Augmented Generation (RAG) has proven effective in integrating external knowledge into large language models (LLMs), improving their factual accuracy, adaptability, interpretability, and trustworthiness. A number of…

Information Retrieval · Computer Science 2026-04-28 Yingli Zhou , Yaodong Su , Youran Sun , Shu Wang , Taotao Wang , Runyuan He , Yongwei Zhang , Sicong Liang , Xilin Liu , Yuchi Ma , Yixiang Fang

Graph retrieval-augmented generation (GraphRAG) has emerged as a powerful paradigm for enhancing large language models (LLMs) with external knowledge. It leverages graphs to model the hierarchical structure between specific concepts,…

Computation and Language · Computer Science 2026-02-24 Zhishang Xiang , Chuanjie Wu , Qinggang Zhang , Shengyuan Chen , Zijin Hong , Xiao Huang , Jinsong Su

Recently, large language models (LLMs) have demonstrated remarkable capabilities in natural language processing tasks, yet they remain prone to hallucinations when reasoning with insufficient internal knowledge. While integrating LLMs with…

Computation and Language · Computer Science 2025-05-27 Jiajun Zhu , Ye Liu , Meikai Bao , Kai Zhang , Yanghai Zhang , Qi Liu

Multimodal Large Language Models (MLLMs) demonstrate remarkable capabilities but often struggle with complex, multi-step mathematical reasoning, where minor errors in visual perception or logical deduction can lead to complete failure.…

Computation and Language · Computer Science 2025-08-08 Jianghangfan Zhang , Yibo Yan , Kening Zheng , Xin Zou , Song Dai , Xuming Hu

Large Language Models (LLMs) have shown remarkable reasoning capabilities on complex tasks, but they still suffer from out-of-date knowledge, hallucinations, and opaque decision-making. In contrast, Knowledge Graphs (KGs) can provide…

Artificial Intelligence · Computer Science 2024-11-01 Liyi Chen , Panrong Tong , Zhongming Jin , Ying Sun , Jieping Ye , Hui Xiong

Large Language Models (LLMs) often struggle with producing factually consistent answers due to limitations in their parametric memory. Retrieval-Augmented Generation (RAG) paradigms mitigate this issue by incorporating external knowledge at…

Computation and Language · Computer Science 2026-05-05 Shanglin Wu , Lihui Liu , Jinho D. Choi , Kai Shu

Recently, Knowledge Graphs (KGs) have been successfully coupled with Large Language Models (LLMs) to mitigate their hallucinations and enhance their reasoning capability, such as in KG-based retrieval-augmented frameworks. However, current…

Artificial Intelligence · Computer Science 2024-10-22 Bo Ni , Yu Wang , Lu Cheng , Erik Blasch , Tyler Derr

Large Language Models (LLMs) and Code-LLMs (CLLMs) have significantly improved code generation, but, they frequently face difficulties when dealing with challenging and complex problems. Retrieval-Augmented Generation (RAG) addresses this…

Software Engineering · Computer Science 2025-06-17 Iman Saberi , Fatemeh Fard

Large language models (LLMs) have exhibited remarkable few-shot learning capabilities and unified the paradigm of NLP tasks through the in-context learning (ICL) technique. Despite the success of ICL, the quality of the exemplar…

Computation and Language · Computer Science 2024-12-13 Yukang Lin , Bingchen Zhong , Shuoran Jiang , Joanna Siebert , Qingcai Chen

Despite the superior performance of Large language models on many NLP tasks, they still face significant limitations in memorizing extensive world knowledge. Recent studies have demonstrated that leveraging the Retrieval-Augmented…

Artificial Intelligence · Computer Science 2024-12-23 Xiaqiang Tang , Jian Li , Nan Du , Sihong Xie

Large language models (LLMs) have demonstrated impressive success in a wide range of natural language processing (NLP) tasks due to their extensive general knowledge of the world. Recent works discovered that the performance of LLMs is…

Computation and Language · Computer Science 2024-11-25 Yuze Liu , Tingjie Liu , Tiehua Zhang , Youhua Xia , Jinze Wang , Zhishu Shen , Jiong Jin , Fei Richard Yu

Knowledge Graph-based Retrieval-Augmented Generation (KG-RAG) is an increasingly explored approach for combining the reasoning capabilities of large language models with the structured evidence of knowledge graphs. However, current…

Artificial Intelligence · Computer Science 2026-01-13 Dongzhuoran Zhou , Yuqicheng Zhu , Xiaxia Wang , Hongkuan Zhou , Yuan He , Jiaoyan Chen , Steffen Staab , Evgeny Kharlamov