English

Rethinking the Reranker: Boundary-Aware Evidence Selection for Robust Retrieval-Augmented Generation

Computation and Language 2026-02-04 v1 Artificial Intelligence

Abstract

Retrieval-Augmented Generation (RAG) systems remain brittle under realistic retrieval noise, even when the required evidence appears in the top-K results. A key reason is that retrievers and rerankers optimize solely for relevance, often selecting either trivial, answer-revealing passages or evidence that lacks the critical information required to answer the question, without considering whether the evidence is suitable for the generator. We propose BAR-RAG, which reframes the reranker as a boundary-aware evidence selector that targets the generator's Goldilocks Zone -- evidence that is neither trivially easy nor fundamentally unanswerable for the generator, but is challenging yet sufficient for inference and thus provides the strongest learning signal. BAR-RAG trains the selector with reinforcement learning using generator feedback, and adopts a two-stage pipeline that fine-tunes the generator under the induced evidence distribution to mitigate the distribution mismatch between training and inference. Experiments on knowledge-intensive question answering benchmarks show that BAR-RAG consistently improves end-to-end performance under noisy retrieval, achieving an average gain of 10.3 percent over strong RAG and reranking baselines while substantially improving robustness. Code is publicly avaliable at https://github.com/GasolSun36/BAR-RAG.

Keywords

Cite

@article{arxiv.2602.03689,
  title  = {Rethinking the Reranker: Boundary-Aware Evidence Selection for Robust Retrieval-Augmented Generation},
  author = {Jiashuo Sun and Pengcheng Jiang and Saizhuo Wang and Jiajun Fan and Heng Wang and Siru Ouyang and Ming Zhong and Yizhu Jiao and Chengsong Huang and Xueqiang Xu and Pengrui Han and Peiran Li and Jiaxin Huang and Ge Liu and Heng Ji and Jiawei Han},
  journal= {arXiv preprint arXiv:2602.03689},
  year   = {2026}
}

Comments

19 pages, 8 tables, 5 figures

R2 v1 2026-07-01T09:34:33.695Z