English

Evaluating Self-Generated Documents for Enhancing Retrieval-Augmented Generation with Large Language Models

Computation and Language 2025-02-11 v4

Abstract

The integration of documents generated by LLMs themselves (Self-Docs) alongside retrieved documents has emerged as a promising strategy for retrieval-augmented generation systems. However, previous research primarily focuses on optimizing the use of Self-Docs, with their inherent properties remaining underexplored. To bridge this gap, we first investigate the overall effectiveness of Self-Docs, identifying key factors that shape their contribution to RAG performance (RQ1). Building on these insights, we develop a taxonomy grounded in Systemic Functional Linguistics to compare the influence of various Self-Docs categories (RQ2) and explore strategies for combining them with external sources (RQ3). Our findings reveal which types of Self-Docs are most beneficial and offer practical guidelines for leveraging them to achieve significant improvements in knowledge-intensive question answering tasks.

Keywords

Cite

@article{arxiv.2410.13192,
  title  = {Evaluating Self-Generated Documents for Enhancing Retrieval-Augmented Generation with Large Language Models},
  author = {Jiatao Li and Xinyu Hu and Xunjian Yin and Xiaojun Wan},
  journal= {arXiv preprint arXiv:2410.13192},
  year   = {2025}
}

Comments

Accepted by NAACL 2025 (Findings). (Long Paper)

R2 v1 2026-06-28T19:25:16.539Z