English
Related papers

Related papers: LiveRAG: A diverse Q&A dataset with varying diffic…

200 papers

Retrieval-augmented generation (RAG) has proven highly effective in improving large language models (LLMs) across various domains. However, there is no benchmark specifically designed to assess the effectiveness of RAG in the legal domain,…

Computation and Language · Computer Science 2025-03-03 Haitao Li , Yifan Chen , Yiran Hu , Qingyao Ai , Junjie Chen , Xiaoyu Yang , Jianhui Yang , Yueyue Wu , Zeyang Liu , Yiqun Liu

Performance evaluation of Retrieval-Augmented Generation (RAG) systems within enterprise environments is governed by multi-dimensional and composite factors extending far beyond simple final accuracy checks. These factors include reasoning…

Computation and Language · Computer Science 2026-04-06 Kenichirou Narita , Siqi Peng , Taku Fukui , Moyuru Yamada , Satoshi Munakata , Satoru Takahashi

Retrieval-Augmented Generation (RAG) has recently gained significant attention for its enhanced ability to integrate external knowledge sources into open-domain question answering (QA) tasks. However, it remains unclear how these models…

Computation and Language · Computer Science 2025-03-28 Xuyang Wu , Shuowei Li , Hsin-Tai Wu , Zhiqiang Tao , Yi Fang

Retrieval-augmented generation (RAG) synergizes the retrieval of pertinent data with the generative capabilities of Large Language Models (LLMs), ensuring that the generated output is not only contextually relevant but also accurate and…

Retrieval-Augmented Generation (RAG) has gained significant attention in recent years for its potential to enhance natural language understanding and generation by combining large-scale retrieval systems with generative models. RAG…

Computation and Language · Computer Science 2025-03-18 Mingyue Cheng , Yucong Luo , Jie Ouyang , Qi Liu , Huijie Liu , Li Li , Shuo Yu , Bohou Zhang , Jiawei Cao , Jie Ma , Daoyu Wang , Enhong Chen

This research is primarily concerned with the critical problem of synthesizing a structured Retrieval-Augmented Generation (RAG) system for advanced AI applications in the domain of swimming. As the integration of Artificial Intelligence in…

Multiagent Systems · Computer Science 2026-05-14 Ahmad Al-Kabbany , Esraa Kassem

The Retrieval-Augmented Generation (RAG) approach enhances question-answering systems and dialogue generation tasks by integrating information retrieval (IR) technologies with large language models (LLMs). This strategy, which retrieves…

Computation and Language · Computer Science 2025-09-15 Duolin Sun , Dan Yang , Yue Shen , Yihan Jiao , Zhehao Tan , Jie Feng , Lianzhen Zhong , Jian Wang , Peng Wei , Jinjie Gu

While Retrieval-Augmented Generation (RAG) has been swiftly adopted in scientific and clinical QA systems, a comprehensive evaluation benchmark in the medical domain is lacking. To address this gap, we introduce the Medical…

Computation and Language · Computer Science 2026-02-12 Liz Li , Wei Zhu

Retrieval-Augmented Generation (RAG) utilizes external knowledge to augment Large Language Models' (LLMs) reliability. For flexibility, agentic RAG employs autonomous, multi-round retrieval and reasoning to resolve queries. Although recent…

Information Retrieval · Computer Science 2025-11-10 Chao Zhang , Yuhao Wang , Derong Xu , Haoxin Zhang , Yuanjie Lyu , Yuhao Chen , Shuochen Liu , Tong Xu , Xiangyu Zhao , Yan Gao , Yao Hu , Enhong Chen

Large Language Models (LLMs) have shown remarkable capabilities in general domains but often struggle with tasks requiring specialized knowledge. Conventional Retrieval-Augmented Generation (RAG) techniques typically retrieve external…

Computation and Language · Computer Science 2025-02-20 Yucheng Shi , Tianze Yang , Canyu Chen , Quanzheng Li , Tianming Liu , Xiang Li , Ninghao Liu

Retrieval-augmented generation (RAG) is widely used to augment large language models (LLMs) with external knowledge. However, many benchmark datasets, designed to test RAG performance, comprise many questions that can already be answered…

Computation and Language · Computer Science 2026-05-12 Jiayi Liu , Jiaxing Zhang , Bowen Jin , Jennifer Neville

University admissions offices face the significant challenge of managing high volumes of inquiries efficiently while maintaining response quality, which critically impacts prospective students' perceptions. This paper addresses the issues…

Computation and Language · Computer Science 2026-01-09 Aram Virabyan

Large language models (LLMs) are very costly and inefficient to update with new information. To address this limitation, retrieval-augmented generation (RAG) has been proposed as a solution that dynamically incorporates external knowledge…

Computation and Language · Computer Science 2025-07-10 Sezen Perçin , Xin Su , Qutub Sha Syed , Phillip Howard , Aleksei Kuvshinov , Leo Schwinn , Kay-Ulrich Scholl

We introduce StratRAG, an open-source retrieval evaluation dataset for benchmarking Retrieval-Augmented Generation (RAG) systems on multi-hop reasoning tasks under realistic, noisy document-pool conditions. Derived from HotpotQA (distractor…

Information Retrieval · Computer Science 2026-04-28 Aryan Patodiya

Financial analysts face significant challenges extracting information from lengthy 10-K reports, which often exceed 100 pages. This paper presents a Retrieval-Augmented Generation (RAG) system designed to answer questions about S&P 500…

Computation and Language · Computer Science 2026-04-29 Zhiyuan Cheng , Longying Lai , Yue Liu , Kai Cheng , Xiaoxi Qi

Retrieval-augmented generation (RAG) often falls short when retrieved context includes confusing semi-relevant passages, or when answering questions require deep contextual understanding and reasoning. We propose an efficient fine-tuning…

Computation and Language · Computer Science 2025-07-28 Mohammad Kachuee , Teja Gollapudi , Minseok Kim , Yin Huang , Kai Sun , Xiao Yang , Jiaqi Wang , Nirav Shah , Yue Liu , Aaron Colak , Anuj Kumar , Wen-tau Yih , Xin Luna Dong

\Ac{RAG} has emerged as a crucial technique for enhancing large models with real-time and domain-specific knowledge. While numerous improvements and open-source tools have been proposed to refine the \ac{RAG} framework for accuracy,…

Information Retrieval · Computer Science 2025-02-20 Yixing Fan , Qiang Yan , Wenshan Wang , Jiafeng Guo , Ruqing Zhang , Xueqi Cheng

Recent advances in Retrieval-Augmented Generation (RAG) have significantly improved response accuracy and relevance by incorporating external knowledge into Large Language Models (LLMs). However, existing RAG methods primarily focus on…

Machine Learning · Computer Science 2025-04-22 Qinhan Yu , Zhiyou Xiao , Binghui Li , Zhengren Wang , Chong Chen , Wentao Zhang

While Retrieval Augmented Generation (RAG) is now widely adopted to enhance LLMs, evaluating its true performance benefits in a reproducible and interpretable way remains a major hurdle. Existing methods often fall short: they lack domain…

Information Retrieval · Computer Science 2025-08-11 Jiaxuan Liang , Shide Zhou , Kailong Wang

Retrieval Augmented Generation (RAG) has become prevalent in question-answering (QA) tasks due to its ability of utilizing search engine to enhance the quality of long-form question-answering (LFQA). Despite the emergence of various open…

Computation and Language · Computer Science 2024-07-02 Tianchi Cai , Zhiwen Tan , Xierui Song , Tao Sun , Jiyan Jiang , Yunqi Xu , Yinger Zhang , Jinjie Gu