English

DiFaR: Enhancing Multimodal Misinformation Detection with Diverse, Factual, and Relevant Rationales

Computation and Language 2025-08-15 v1

Abstract

Generating textual rationales from large vision-language models (LVLMs) to support trainable multimodal misinformation detectors has emerged as a promising paradigm. However, its effectiveness is fundamentally limited by three core challenges: (i) insufficient diversity in generated rationales, (ii) factual inaccuracies due to hallucinations, and (iii) irrelevant or conflicting content that introduces noise. We introduce DiFaR, a detector-agnostic framework that produces diverse, factual, and relevant rationales to enhance misinformation detection. DiFaR employs five chain-of-thought prompts to elicit varied reasoning traces from LVLMs and incorporates a lightweight post-hoc filtering module to select rationale sentences based on sentence-level factuality and relevance scores. Extensive experiments on four popular benchmarks demonstrate that DiFaR outperforms four baseline categories by up to 5.9% and boosts existing detectors by as much as 8.7%. Both automatic metrics and human evaluations confirm that DiFaR significantly improves rationale quality across all three dimensions.

Keywords

Cite

@article{arxiv.2508.10444,
  title  = {DiFaR: Enhancing Multimodal Misinformation Detection with Diverse, Factual, and Relevant Rationales},
  author = {Herun Wan and Jiaying Wu and Minnan Luo and Xiangzheng Kong and Zihan Ma and Zhi Zeng},
  journal= {arXiv preprint arXiv:2508.10444},
  year   = {2025}
}