English

PaperHelper: Knowledge-Based LLM QA Paper Reading Assistant

Computation and Language 2025-02-21 v1

Abstract

In the paper, we introduce a paper reading assistant, PaperHelper, a potent tool designed to enhance the capabilities of researchers in efficiently browsing and understanding scientific literature. Utilizing the Retrieval-Augmented Generation (RAG) framework, PaperHelper effectively minimizes hallucinations commonly encountered in large language models (LLMs), optimizing the extraction of accurate, high-quality knowledge. The implementation of advanced technologies such as RAFT and RAG Fusion significantly boosts the performance, accuracy, and reliability of the LLMs-based literature review process. Additionally, PaperHelper features a user-friendly interface that facilitates the batch downloading of documents and uses the Mermaid format to illustrate structural relationships between documents. Experimental results demonstrate that PaperHelper, based on a fine-tuned GPT-4 API, achieves an F1 Score of 60.04, with a latency of only 5.8 seconds, outperforming the basic RAG model by 7\% in F1 Score.

Keywords

Cite

@article{arxiv.2502.14271,
  title  = {PaperHelper: Knowledge-Based LLM QA Paper Reading Assistant},
  author = {Congrui Yin and Evan Wei and Zhongxing Zhang and Zaifu Zhan},
  journal= {arXiv preprint arXiv:2502.14271},
  year   = {2025}
}
R2 v1 2026-06-28T21:50:54.580Z