English
Related papers

Related papers: MEMERAG: A Multilingual End-to-End Meta-Evaluation…

200 papers

Retrieval-Augmented Generation (RAG) is an effective approach to enhance the factual accuracy of large language models (LLMs) by retrieving information from external databases, which are typically composed of diverse sources, to supplement…

Machine Learning · Computer Science 2025-10-15 Jeongyeon Hwang , Junyoung Park , Hyejin Park , Dongwoo Kim , Sangdon Park , Jungseul Ok

We propose XRAG, a novel benchmark designed to evaluate the generation abilities of LLMs in cross-lingual Retrieval-Augmented Generation (RAG) settings where the user language does not match the retrieval results. XRAG is constructed from…

Computation and Language · Computer Science 2025-05-16 Wei Liu , Sony Trenous , Leonardo F. R. Ribeiro , Bill Byrne , Felix Hieber

Short answer assessment is a vital component of science education, allowing evaluation of students' complex three-dimensional understanding. Large language models (LLMs) that possess human-like ability in linguistic tasks are increasingly…

Computation and Language · Computer Science 2025-06-05 Yucheng Chu , Peng He , Hang Li , Haoyu Han , Kaiqi Yang , Yu Xue , Tingting Li , Joseph Krajcik , Jiliang Tang

Recent advances in Retrieval-Augmented Generation (RAG) have significantly improved response accuracy and relevance by incorporating external knowledge into Large Language Models (LLMs). However, existing RAG methods primarily focus on…

Machine Learning · Computer Science 2025-04-22 Qinhan Yu , Zhiyou Xiao , Binghui Li , Zhengren Wang , Chong Chen , Wentao Zhang

Retrieval-augmented generation have become central in natural language processing due to their efficacy in generating factual content. While traditional methods employ single-time retrieval, more recent approaches have shifted towards…

Computation and Language · Computer Science 2024-02-20 Yujia Zhou , Zheng Liu , Jiajie Jin , Jian-Yun Nie , Zhicheng Dou

Large language models (LLMs) has become a significant research focus and is utilized in various fields, such as text generation and dialog systems. One of the most essential applications of LLM is Retrieval Augmented Generation (RAG), which…

Computation and Language · Computer Science 2025-10-06 Sicheng Dong , Vahid Zolfaghari , Nenad Petrovic , Alois Knoll

Evaluating retrieval-augmented generation (RAG) presents challenges, particularly for retrieval models within these systems. Traditional end-to-end evaluation methods are computationally expensive. Furthermore, evaluation of the retrieval…

Computation and Language · Computer Science 2024-04-23 Alireza Salemi , Hamed Zamani

Retrieval-Augmented Generation (RAG) enables Large Language Models (LLMs) to extend their existing knowledge by dynamically incorporating external information. However, practical deployment is fundamentally constrained by the LLM's finite…

Information Retrieval · Computer Science 2026-03-24 Jiarui Guo , Yuemeng Xu , Zongwei Lv , Yangyujia Wang , Xiaolin Wang , Kan Liu , Tao Lan , Lin Qu , Tong Yang

Retrieval-Augmented Generation (RAG) improves Large Language Models (LLMs) by using external knowledge, but it struggles with precise entity information retrieval. In this paper, we proposed MES-RAG framework, which enhances entity-specific…

Computation and Language · Computer Science 2025-03-19 Pingyu Wu , Daiheng Gao , Jing Tang , Huimin Chen , Wenbo Zhou , Weiming Zhang , Nenghai Yu

Recently, Large Language Models (LLMs) have been increasingly used to support various decision-making tasks, assisting humans in making informed decisions. However, when LLMs confidently provide incorrect information, it can lead humans to…

Information Retrieval · Computer Science 2025-10-16 Chaeyun Jang , Deukhwan Cho , Seanie Lee , Hyungi Lee , Juho Lee

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access external knowledge sources, but the effectiveness of RAG relies on the coordination between the retriever and the generator. Since these components are…

Computation and Language · Computer Science 2025-09-24 Junlin Wang , Zehao Wu , Shaowei Lu , Yanlan Li , Xinghao Huang

Retrieval-Augmented Generation (RAG) has recently gained traction in natural language processing. Numerous studies and real-world applications are leveraging its ability to enhance generative models through external information retrieval.…

Computation and Language · Computer Science 2025-02-17 Hao Yu , Aoran Gan , Kai Zhang , Shiwei Tong , Qi Liu , Zhaofeng Liu

Large Language Models (LLMs) augmented with Retrieval-Augmented Generation (RAG) techniques are revolutionizing applications across multiple domains, such as healthcare, finance, and customer service. Despite their potential, evaluating RAG…

Retrieval-Augmented Generation allows to enhance Large Language Models with external knowledge. In response to the recent popularity of generative LLMs, many RAG approaches have been proposed, which involve an intricate number of different…

Computation and Language · Computer Science 2024-07-02 David Rau , Hervé Déjean , Nadezhda Chirkova , Thibault Formal , Shuai Wang , Vassilina Nikoulina , Stéphane Clinchant

Large Language Models (LLMs) have shown versatility in various Natural Language Processing (NLP) tasks, including their potential as effective question-answering systems. However, to provide precise and relevant information in response to…

Computation and Language · Computer Science 2024-09-09 Sriram Veturi , Saurabh Vaichal , Reshma Lal Jagadheesh , Nafis Irtiza Tripto , Nian Yan

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by retrieving relevant memories from an external database. However, existing RAG methods typically organize all memories in a whole database, potentially limiting…

Computation and Language · Computer Science 2024-05-28 Zheng Wang , Shu Xian Teo , Jieer Ouyang , Yongjun Xu , Wei Shi

A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation Download PDF Neal Gregory Lawton, Alfy Samuel, Anoop Kumar, Daben Liu Published: 20 Aug 2025, Retrieval augmented generation (RAG) is a popular…

Computation and Language · Computer Science 2025-10-21 Neal Gregory Lawton , Alfy Samuel , Anoop Kumar , Daben Liu

Retrieval-augmented generation (RAG) is a paradigm that augments large language models (LLMs) with external knowledge to tackle knowledge-intensive question answering. While several benchmarks evaluate Multimodal LLMs (MLLMs) under…

Computation and Language · Computer Science 2025-08-18 Yin Wu , Quanyu Long , Jing Li , Jianfei Yu , Wenya Wang

Retrieval-Augmented Generation (RAG) struggles on long, structured financial filings where relevant evidence is sparse and cross-referenced. This paper presents a systematic investigation of advanced metadata-driven Retrieval-Augmented…

Information Retrieval · Computer Science 2025-10-29 Michail Dadopoulos , Anestis Ladas , Stratos Moschidis , Ioannis Negkakis

Developing the capacity to effectively search for requisite datasets is an urgent requirement to assist data users in identifying relevant datasets considering the very limited available metadata. For this challenge, the utilization of…

Information Retrieval · Computer Science 2024-10-08 Teruaki Hayashi , Hiroki Sakaji , Jiayi Dai , Randy Goebel