English

All Languages Matter: Understanding and Mitigating Language Bias in Multilingual RAG

Computation and Language 2026-04-23 v1

Abstract

Multilingual Retrieval-Augmented Generation (mRAG) leverages cross-lingual evidence to ground Large Language Models (LLMs) in global knowledge. However, we show that current mRAG systems suffer from a language bias during reranking, systematically favoring English and the query's native language. By introducing an estimated oracle evidence analysis, we quantify a substantial performance gap between existing rerankers and the achievable upper bound. Further analysis reveals a critical distributional mismatch: while optimal predictions require evidence scattered across multiple languages, current systems systematically suppress such ``answer-critical'' documents, thereby limiting downstream generation performance. To bridge this gap, we propose \textit{\textbf{L}anguage-\textbf{A}gnostic \textbf{U}tility-driven \textbf{R}eranker \textbf{A}lignment (LAURA)}, which aligns multilingual evidence ranking with downstream generative utility. Experiments across diverse languages and generation models show that LAURA effectively mitigates language bias and consistently improves mRAG performance.

Keywords

Cite

@article{arxiv.2604.20199,
  title  = {All Languages Matter: Understanding and Mitigating Language Bias in Multilingual RAG},
  author = {Dan Wang and Guozhao Mo and Yafei Shi and Cheng Zhang and Bo Zheng and Boxi Cao and Xuanang Chen and Yaojie Lu and Hongyu Lin and Ben He and Xianpei Han and Le Sun},
  journal= {arXiv preprint arXiv:2604.20199},
  year   = {2026}
}

Comments

ACL 2026 main conference

R2 v1 2026-07-01T12:29:46.621Z