English
Related papers

Related papers: LiveRAG: A diverse Q&A dataset with varying diffic…

200 papers

Large language models (LLMs) has become a significant research focus and is utilized in various fields, such as text generation and dialog systems. One of the most essential applications of LLM is Retrieval Augmented Generation (RAG), which…

Computation and Language · Computer Science 2025-10-06 Sicheng Dong , Vahid Zolfaghari , Nenad Petrovic , Alois Knoll

Retrieval-augmented generation (RAG) is a promising approach to address the limitations of fixed knowledge in large language models (LLMs). However, current benchmarks for evaluating RAG systems suffer from two key deficiencies: (1) they…

Computation and Language · Computer Science 2025-01-28 Zehan Qi , Rongwu Xu , Zhijiang Guo , Cunxiang Wang , Hao Zhang , Wei Xu

We present RAG Playground, an open-source framework for systematic evaluation of Retrieval-Augmented Generation (RAG) systems. The framework implements and compares three retrieval approaches: naive vector search, reranking, and hybrid…

Machine Learning · Computer Science 2024-12-18 Ioannis Papadimitriou , Ilias Gialampoukidis , Stefanos Vrochidis , Ioannis , Kompatsiaris

Retrieval-Augmented Generation (RAG) systems and large language model (LLM)-powered chatbots have significantly advanced conversational AI by combining generative capabilities with external knowledge retrieval. Despite their success,…

Artificial Intelligence · Computer Science 2025-06-26 Priyaranjan Pattnayak , Amit Agarwal , Hansa Meghwani , Hitesh Laxmichand Patel , Srikant Panda

Retrieval Augmented Generation (RAG) systems have seen huge popularity in augmenting Large-Language Model (LLM) outputs with domain specific and time sensitive data. Very recently a shift is happening from simple RAG setups that query a…

Information Retrieval · Computer Science 2024-03-05 Tristan Kenneweg , Philip Kenneweg , Barbara Hammer

Retrieval-augmented generation (RAG) typically relies on a flat retrieval paradigm that maps queries directly to static, isolated text segments. This approach struggles with more complex tasks that require the conditional retrieval and…

Computation and Language · Computer Science 2026-05-19 Jihao Dai , Dingjun Wu , Yuxuan Chen , Zheni Zeng , Yukun Yan , Zhenghao Liu , Maosong Sun

Biomedical question-answering (QA) systems require effective retrieval and generation components to ensure accuracy, efficiency, and scalability. This study systematically examines a Retrieval-Augmented Generation (RAG) system for…

Information Retrieval · Computer Science 2026-01-14 Linus Stuhlmann , Michael Alexander Saxer , Jonathan Fürst

Large language models (LLMs) with retrieval augmented-generation (RAG) have been the optimal choice for scalable generative AI solutions in the recent past. Although RAG implemented with AI agents (agentic-RAG) has been recently…

Artificial Intelligence · Computer Science 2024-11-19 Sohini Roychowdhury , Marko Krema , Anvar Mahammad , Brian Moore , Arijit Mukherjee , Punit Prakashchandra

With the rapid advancement of Artificial Intelligence, particularly in Natural Language Processing, Large Language Models (LLMs) have become pivotal in educational question-answering systems, especially university admission chatbots.…

Computation and Language · Computer Science 2025-01-29 Long Nguyen , Tho Quan

Retrieval-augmented generation (RAG) is a key means to effectively enhance large language models (LLMs) in many knowledge-based tasks. However, existing RAG methods struggle with knowledge-intensive reasoning tasks, because useful…

Computation and Language · Computer Science 2024-10-28 Zhuoqun Li , Xuanang Chen , Haiyang Yu , Hongyu Lin , Yaojie Lu , Qiaoyu Tang , Fei Huang , Xianpei Han , Le Sun , Yongbin Li

Traditional retrieval-augmented generation (RAG) benchmarks evaluate systems using heuristic-based metrics, but these require human preferences as the ground truth for reference. In contrast, arena-based benchmarks, where systems compete…

Computation and Language · Computer Science 2025-04-01 Nandan Thakur , Suleman Kazi , Ge Luo , Jimmy Lin , Amin Ahmad

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

Retrieval-Augmented Generation (RAG) is a technique that enhances the capabilities of large language models (LLMs) by incorporating external knowledge sources. This method addresses common LLM limitations, including outdated information and…

Computation and Language · Computer Science 2024-07-16 Yuanjie Lyu , Zhiyu Li , Simin Niu , Feiyu Xiong , Bo Tang , Wenjin Wang , Hao Wu , Huanyong Liu , Tong Xu , Enhong Chen

Recent studies have explored graph-based approaches to retrieval-augmented generation, leveraging structured or semi-structured information -- such as entities and their relations extracted from documents -- to enhance retrieval. However,…

Computation and Language · Computer Science 2025-07-24 Zhili Shen , Chenxin Diao , Pascual Merita , Pavlos Vougiouklis , Jeff Z. Pan

With the advent of large language models (LLMs) and multimodal large language models (MLLMs), the potential of retrieval-augmented generation (RAG) has attracted considerable research attention. Various novel algorithms and models have been…

Computation and Language · Computer Science 2025-02-25 Jiajie Jin , Yutao Zhu , Guanting Dong , Yuyao Zhang , Xinyu Yang , Chenghao Zhang , Tong Zhao , Zhao Yang , Zhicheng Dou , Ji-Rong Wen

Retrieval-augmented generation (RAG) has emerged as a leading approach to reducing hallucinations in large language models (LLMs). Current RAG evaluation benchmarks primarily focus on what we call local RAG: retrieving relevant chunks from…

Computation and Language · Computer Science 2025-11-05 Qi Luo , Xiaonan Li , Tingshuo Fan , Xinchi Chen , Xipeng Qiu

Timely and accurate situation awareness is vital for decision-making in humanitarian response, conflict monitoring, and early warning and early action. However, the manual analysis of vast and heterogeneous data sources often results in…

Retrieval-Augmented Generation (RAG) is a critical technique for grounding Large Language Models (LLMs) in factual evidence, yet evaluating RAG systems in specialized, safety-critical domains remains a significant challenge. Existing…

Computation and Language · Computer Science 2025-11-07 Joshua Gao , Quoc Huy Pham , Subin Varghese , Silwal Saurav , Vedhus Hoskere

Retriever-augmented generation (RAG) has become a widely adopted approach for enhancing the factual accuracy of large language models (LLMs). While current benchmarks evaluate the performance of RAG methods from various perspectives, they…

Information Retrieval · Computer Science 2025-04-08 Kepu Zhang , Zhongxiang Sun , Weijie Yu , Xiaoxue Zang , Kai Zheng , Yang Song , Han Li , Jun Xu

Large language models (LLMs) often generate outdated or inaccurate information based on static training datasets. Retrieval-augmented generation (RAG) mitigates this by integrating outside data sources. While previous RAG systems used…