English

ConflictRAG: Detecting and Resolving Knowledge Conflicts in Retrieval Augmented Generation

Computation and Language 2026-05-19 v1 Artificial Intelligence

Abstract

Retrieval-Augmented Generation (RAG) systems implicitly assume mutual consistency among retrieved documents -- an assumption that frequently fails in practice. We present ConflictRAG, a conflict-aware RAG framework that detects, classifies, and resolves knowledge conflicts prior to answer generation. The framework introduces three contributions: (1) a two-stage conflict detection module combining a lightweight embedding-based MLP classifier with selective LLM refinement, reducing API costs by 62% while maintaining 90.8% detection accuracy; (2) an Entropy-TOPSIS framework for data-driven source credibility assessment, improving selection accuracy by 7.1% over manual heuristics; and (3) a Conflict-Aware RAG Score (CARS) for diagnostic evaluation of conflict-handling capabilities. Experiments on three benchmarks against six baselines demonstrate 88.7% conflict-detection F1 and consistent 5.3--6.1% correctness gains over the strongest conflict-aware baseline, with the pipeline transferring effectively across backbone LLMs.

Keywords

Cite

@article{arxiv.2605.17301,
  title  = {ConflictRAG: Detecting and Resolving Knowledge Conflicts in Retrieval Augmented Generation},
  author = {Chenyu Wang and Yingmin Liu and Yang Shu},
  journal= {arXiv preprint arXiv:2605.17301},
  year   = {2026}
}

Comments

6 pages, 6 figures, submitted to IEEE SMC 2026