English
Related papers

Related papers: GraphRAG-Bench: Challenging Domain-Specific Reason…

200 papers

Retrieval Augmented Generation (RAG) has greatly improved the performance of Large Language Model (LLM) responses by grounding generation with context from existing documents. These systems work well when documents are clearly relevant to a…

Computation and Language · Computer Science 2024-05-29 Jialin Dong , Bahare Fatemi , Bryan Perozzi , Lin F. Yang , Anton Tsitsulin

The advancement of Large Language Models (LLMs) has remarkably pushed the boundaries towards artificial general intelligence (AGI), with their exceptional ability on understanding diverse types of information, including but not limited to…

Computation and Language · Computer Science 2023-10-10 Ziwei Chai , Tianjie Zhang , Liang Wu , Kaiqiao Han , Xiaohai Hu , Xuanwen Huang , Yang Yang

Extracting meaningful insights from large and complex datasets poses significant challenges, particularly in ensuring the accuracy and relevance of retrieved information. Traditional data retrieval methods such as sequential search and…

Information Retrieval · Computer Science 2024-09-27 Zahra Sepasdar , Sushant Gautam , Cise Midoglu , Michael A. Riegler , Pål Halvorsen

Integrating large language models (LLMs) with knowledge graphs derived from domain-specific data represents an important advancement towards more powerful and factual reasoning. As these models grow more capable, it is crucial to enable…

Artificial Intelligence · Computer Science 2024-04-19 Stefan Dernbach , Khushbu Agarwal , Alejandro Zuniga , Michael Henry , Sutanay Choudhury

We propose XRAG, a novel benchmark designed to evaluate the generation abilities of LLMs in cross-lingual Retrieval-Augmented Generation (RAG) settings where the user language does not match the retrieval results. XRAG is constructed from…

Computation and Language · Computer Science 2025-05-16 Wei Liu , Sony Trenous , Leonardo F. R. Ribeiro , Bill Byrne , Felix Hieber

Understanding visual art requires reasoning across multiple perspectives -- cultural, historical, and stylistic -- beyond mere object recognition. While recent multimodal large language models (MLLMs) perform well on general image…

Artificial Intelligence · Computer Science 2025-09-08 Shuai Wang , Ivona Najdenkoska , Hongyi Zhu , Stevan Rudinac , Monika Kackovic , Nachoem Wijnberg , Marcel Worring

Despite initial successes and a variety of architectures, retrieval-augmented generation systems still struggle to reliably retrieve and connect the multi-step evidence required for complicated reasoning tasks. Most of the standard RAG…

Artificial Intelligence · Computer Science 2026-05-26 Jovan Pavlović , Miklós Krész , László Hajdu

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm to enhance large language models (LLMs) by conditioning generation on external evidence retrieved at inference time. While RAG addresses critical limitations of…

Information Retrieval · Computer Science 2025-06-03 Chaitanya Sharma

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by integrating them with an external knowledge base to improve the answer relevance and accuracy. In real-world scenarios, beyond pure text, a substantial amount of…

Computation and Language · Computer Science 2025-10-07 Jiaru Zou , Dongqi Fu , Sirui Chen , Xinrui He , Zihao Li , Yada Zhu , Jiawei Han , Jingrui He

Retrieval-Augmented Generation (RAG) enhances the response quality and domain-specific performance of large language models (LLMs) by incorporating external knowledge to combat hallucinations. In recent research, graph structures have been…

Information Retrieval · Computer Science 2025-12-17 Hao Hu , Yifan Feng , Ruoxue Li , Rundong Xue , Xingliang Hou , Zhiqiang Tian , Yue Gao , Shaoyi Du

Retrieval-augmented generation (RAG) is a key means to effectively enhance large language models (LLMs) in many knowledge-based tasks. However, existing RAG methods struggle with knowledge-intensive reasoning tasks, because useful…

Computation and Language · Computer Science 2024-10-28 Zhuoqun Li , Xuanang Chen , Haiyang Yu , Hongyu Lin , Yaojie Lu , Qiaoyu Tang , Fei Huang , Xianpei Han , Le Sun , Yongbin Li

By retrieving contexts from knowledge graphs, graph-based retrieval-augmented generation (GraphRAG) enhances large language models (LLMs) to generate quality answers for user questions. Many GraphRAG methods have been proposed and reported…

Computation and Language · Computer Science 2025-06-10 Qiming Zeng , Xiao Yan , Hao Luo , Yuhao Lin , Yuxiang Wang , Fangcheng Fu , Bo Du , Quanqing Xu , Jiawei Jiang

This article addresses domain knowledge gaps in general large language models for historical text analysis in the context of computational humanities and AIGC technology. We propose the Graph RAG framework, combining chain-of-thought…

Computation and Language · Computer Science 2025-06-19 Yang Fan , Zhang Qi , Xing Wenqian , Liu Chang , Liu Liu

Retrieval-augmented generation (RAG) is widely used to augment large language models (LLMs) with external knowledge. However, many benchmark datasets, designed to test RAG performance, comprise many questions that can already be answered…

Computation and Language · Computer Science 2026-05-12 Jiayi Liu , Jiaxing Zhang , Bowen Jin , Jennifer Neville

Retrieval-Augmented Generation (RAG) is a framework in which a Generator, such as a Large Language Model (LLM), produces answers by retrieving documents from an external collection using a Retriever. In practice, Generators must integrate…

Computation and Language · Computer Science 2026-04-30 Koki Itai , Shunichi Hasegawa , Yuta Yamamoto , Gouki Minegishi , Masaki Otsuki

Large Language Models (LLMs) have demonstrated significant potential across various domains. However, they often struggle with integrating external knowledge and performing complex reasoning, leading to hallucinations and unreliable…

Machine Learning · Computer Science 2025-11-25 Yao Cheng , Yibo Zhao , Jiapeng Zhu , Yao Liu , Xing Sun , Xiang Li

Knowledge Graphs (KGs) represent human-crafted factual knowledge in the form of triplets (head, relation, tail), which collectively form a graph. Question Answering over KGs (KGQA) is the task of answering natural questions grounding the…

Computation and Language · Computer Science 2024-05-31 Costas Mavromatis , George Karypis

Generative large language models as tools in the legal domain have the potential to improve the justice system. However, the reasoning behavior of current generative models is brittle and poorly understood, hence cannot be responsibly…

Artificial Intelligence · Computer Science 2025-05-06 Cor Steging , Silja Renooij , Bart Verheij

Retrieval-Augmented Generation (RAG) has become the standard approach for grounding large language models in information that was not available during training. While existing datasets and benchmarks focus on web or other public sources,…

Information Retrieval · Computer Science 2026-05-21 Yuhong Sun , Joachim Rahmfeld , Chris Weaver , Weijia Chen , Roshan Desai , Wenxi Huang , Mark H. Butler

The growing demand for automated graph algorithm reasoning has attracted increasing attention in the large language model (LLM) community. Recent LLM-based graph reasoning methods typically decouple task descriptions from graph data,…

Software Engineering · Computer Science 2026-03-10 Fali Wang , Chenglin Weng , Xianren Zhang , Siyuan Hong , Hui Liu , Suhang Wang