English

Towards Self-Explainable Document Visual Question Answering with Chain-of-Explanation Predictions

Machine Learning 2026-05-08 v1 Computer Vision and Pattern Recognition

Abstract

Document Visual Question Answering (DocVQA) requires vision-language models to reason not only about what information in a document is relevant to a question, but also where the answer is grounded on the page. Existing DocVQA models entangle question-relevant evidence and answer localization and operate largely as black boxes, offering limited means to verify how predictions depend on visual evidence. We propose CoExVQA, a self-explainable DocVQA framework with a grounded reasoning process through a chain-of-explanation design. CoExVQA first identifies question-relevant evidence, then explicitly localizes the answer region, and finally decodes the answer exclusively from the grounded region. Prediction via CoExVQA's chain-of-explanation enables direct inspection and verification of the reasoning process across modalities. Empirical results show that restricting decoding to grounded evidence achieves SotA explainable DocVQA performance on PFL-DocVQA, improving ANLS by 12% over the current explainable baselines while providing transparent and verifiable predictions.

Keywords

Cite

@article{arxiv.2605.06058,
  title  = {Towards Self-Explainable Document Visual Question Answering with Chain-of-Explanation Predictions},
  author = {Kjetil Indrehus and Adrian Duric and Changkyu Choi and Ali Ramezani-Kebrya},
  journal= {arXiv preprint arXiv:2605.06058},
  year   = {2026}
}
R2 v1 2026-07-01T12:54:41.940Z