In this paper, we propose RAG-Boost (ST-ShinozakiLab Task I system), which enhances the baseline LLM-based ASR system of the MLC-SLM Challenge (task I) with a retrieval-augmented generation (RAG) module on the fly. Each partial ASR hypothesis queries a vector store of audio-text pairs and domain terms, and the retrieved results are fused with the live ASR hypotheses to fix recognition errors. The fused hypotheses are passed to the LLM, yielding improved responses.
@article{arxiv.2508.14048,
title = {RAG-Boost: Retrieval-Augmented Generation Enhanced LLM-based Speech Recognition},
author = {Pengcheng Wang and Sheng Li and Takahiro Shinozaki},
journal= {arXiv preprint arXiv:2508.14048},
year = {2025}
}
Comments
accepted at Interspeech2025 MLC-SLM Challenge workshop (task I system description)