中文
相关论文

相关论文: Generating Diverse Q&A Benchmarks for RAG Evaluati…

200 篇论文

Retrieval-Augmented Generation (RAG) struggles with domain-specific enterprise datasets, often isolated behind firewalls and rich in complex, specialized terminology unseen by LLMs during pre-training. Semantic variability across domains…

计算与语言 · 计算机科学 2025-08-06 Kunal Sawarkar , Shivam R. Solanki , Abhilasha Mangal

Retrieval-augmented generation (RAG) is key to enhancing large language models (LLMs) to systematically access richer factual knowledge. Yet, using RAG brings intrinsic challenges, as LLMs must deal with potentially conflicting knowledge,…

计算与语言 · 计算机科学 2025-04-08 Leonardo Ranaldi , Federico Ranaldi , Fabio Massimo Zanzotto , Barry Haddow , Alexandra Birch

Retrieval Augmented Generation (RAG) has become prevalent in question-answering (QA) tasks due to its ability of utilizing search engine to enhance the quality of long-form question-answering (LFQA). Despite the emergence of various open…

计算与语言 · 计算机科学 2024-07-02 Tianchi Cai , Zhiwen Tan , Xierui Song , Tao Sun , Jiyan Jiang , Yunqi Xu , Yinger Zhang , Jinjie Gu

Retrieval-Augmented Generation (RAG) has become the standard approach for grounding large language models in information that was not available during training. While existing datasets and benchmarks focus on web or other public sources,…

信息检索 · 计算机科学 2026-05-21 Yuhong Sun , Joachim Rahmfeld , Chris Weaver , Weijia Chen , Roshan Desai , Wenxi Huang , Mark H. Butler

Retrieval Augmented Generation (RAG) is an important aspect of conversing with Large Language Models (LLMs) when factually correct information is important. LLMs may provide answers that appear correct, but could contain hallucinated…

计算与语言 · 计算机科学 2025-08-28 Kshitij Fadnis , Sara Rosenthal , Maeda Hanafi , Yannis Katsis , Marina Danilevsky

This paper presents the submission of the UDInfo team to the SIGIR 2025 LiveRAG Challenge. We introduce PreQRAG, a Retrieval Augmented Generation (RAG) architecture designed to improve retrieval and generation quality through targeted…

信息检索 · 计算机科学 2025-06-24 Damian Martinez , Catalina Riano , Hui Fang

Retrieval-Augmented Generation (RAG) systems often face limitations in specialized domains such as fintech, where domain-specific ontologies, dense terminology, and acronyms complicate effective retrieval and synthesis. This paper…

The Retrieval-Augmented Generation (RAG) approach enhances question-answering systems and dialogue generation tasks by integrating information retrieval (IR) technologies with large language models (LLMs). This strategy, which retrieves…

计算与语言 · 计算机科学 2025-09-15 Duolin Sun , Dan Yang , Yue Shen , Yihan Jiao , Zhehao Tan , Jie Feng , Lianzhen Zhong , Jian Wang , Peng Wei , Jinjie Gu

We present a comprehensive study of answer quality evaluation in Retrieval-Augmented Generation (RAG) applications using vRAG-Eval, a novel grading system that is designed to assess correctness, completeness, and honesty. We further map the…

计算与语言 · 计算机科学 2024-11-08 Yang Wang , Alberto Garcia Hernandez , Roman Kyslyi , Nicholas Kersting

Retrieval-augmented generation (RAG) pipelines have become the de-facto approach for building AI assistants with access to external, domain-specific knowledge. Given a user query, RAG pipelines typically first retrieve (R) relevant…

人机交互 · 计算机科学 2025-04-21 Quentin Romero Lauro , Shreya Shankar , Sepanta Zeighami , Aditya Parameswaran

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

Developers spend much time finding information that is relevant to their questions. Stack Overflow has been the leading resource, and with the advent of Large Language Models (LLMs), generative models such as ChatGPT are used frequently.…

人工智能 · 计算机科学 2024-06-21 Davit Abrahamyan , Fatemeh H. Fard

Processing long contexts presents a significant challenge for large language models (LLMs). While recent advancements allow LLMs to handle much longer contexts than before (e.g., 32K or 128K tokens), it is computationally expensive and can…

计算与语言 · 计算机科学 2025-04-10 Hongjin Qian , Zheng Liu , Peitian Zhang , Kelong Mao , Defu Lian , Zhicheng Dou , Tiejun Huang

Retrieval-Augmented Generation (RAG) systems are showing promising potential, and are becoming increasingly relevant in AI-powered legal applications. Existing benchmarks, such as LegalBench, assess the generative capabilities of Large…

人工智能 · 计算机科学 2024-08-21 Nicholas Pipitone , Ghita Houir Alami

Large language models often encounter challenges with static knowledge and hallucinations, which undermine their reliability. Retrieval-augmented generation (RAG) mitigates these issues by incorporating external information. However, user…

Retrieval-augmented generation (RAG) systems have advanced large language models (LLMs) in complex deep search scenarios requiring multi-step reasoning and iterative information retrieval. However, existing approaches face critical…

Despite Retrieval-Augmented Generation (RAG) showing promising capability in leveraging external knowledge, a comprehensive evaluation of RAG systems is still challenging due to the modular nature of RAG, evaluation of long-form responses…

Retrieval Augmented Generation (RAG) is a commonly used approach for enhancing large language models (LLMs) with relevant and up-to-date information. However, the retrieved sources can often contain conflicting information and it remains…

计算与语言 · 计算机科学 2025-06-17 Arie Cattan , Alon Jacovi , Ori Ram , Jonathan Herzig , Roee Aharoni , Sasha Goldshtein , Eran Ofek , Idan Szpektor , Avi Caciularu

Retrieval-augmented generation (RAG) has become a dominant paradigm for mitigating knowledge hallucination and staleness in large language models (LLMs) while preserving data security. By retrieving relevant evidence from private,…

信息检索 · 计算机科学 2025-09-29 Guohang Yan , Yue Zhang , Pinlong Cai , Ding Wang , Song Mao , Hongwei Zhang , Yaoze Zhang , Hairong Zhang , Xinyu Cai , Botian Shi

Retrieval-Augmented Generation (RAG) methods augment the input of Large Language Models (LLMs) with relevant retrieved passages, reducing factual errors in knowledge-intensive tasks. However, contemporary RAG approaches suffer from…

计算与语言 · 计算机科学 2024-05-24 Dian Jiao , Li Cai , Jingsheng Huang , Wenqiao Zhang , Siliang Tang , Yueting Zhuang