English

MiniRAG: Towards Extremely Simple Retrieval-Augmented Generation

Artificial Intelligence 2025-01-28 v3

Abstract

The growing demand for efficient and lightweight Retrieval-Augmented Generation (RAG) systems has highlighted significant challenges when deploying Small Language Models (SLMs) in existing RAG frameworks. Current approaches face severe performance degradation due to SLMs' limited semantic understanding and text processing capabilities, creating barriers for widespread adoption in resource-constrained scenarios. To address these fundamental limitations, we present MiniRAG, a novel RAG system designed for extreme simplicity and efficiency. MiniRAG introduces two key technical innovations: (1) a semantic-aware heterogeneous graph indexing mechanism that combines text chunks and named entities in a unified structure, reducing reliance on complex semantic understanding, and (2) a lightweight topology-enhanced retrieval approach that leverages graph structures for efficient knowledge discovery without requiring advanced language capabilities. Our extensive experiments demonstrate that MiniRAG achieves comparable performance to LLM-based methods even when using SLMs while requiring only 25\% of the storage space. Additionally, we contribute a comprehensive benchmark dataset for evaluating lightweight RAG systems under realistic on-device scenarios with complex queries. We fully open-source our implementation and datasets at: https://github.com/HKUDS/MiniRAG.

Keywords

Cite

@article{arxiv.2501.06713,
  title  = {MiniRAG: Towards Extremely Simple Retrieval-Augmented Generation},
  author = {Tianyu Fan and Jingyuan Wang and Xubin Ren and Chao Huang},
  journal= {arXiv preprint arXiv:2501.06713},
  year   = {2025}
}
R2 v1 2026-06-28T21:03:44.567Z