English

Chart Question Answering from Real-World Analytical Narratives

Computation and Language 2025-07-03 v1

Abstract

We present a new dataset for chart question answering (CQA) constructed from visualization notebooks. The dataset features real-world, multi-view charts paired with natural language questions grounded in analytical narratives. Unlike prior benchmarks, our data reflects ecologically valid reasoning workflows. Benchmarking state-of-the-art multimodal large language models reveals a significant performance gap, with GPT-4.1 achieving an accuracy of 69.3%, underscoring the challenges posed by this more authentic CQA setting.

Keywords

Cite

@article{arxiv.2507.01627,
  title  = {Chart Question Answering from Real-World Analytical Narratives},
  author = {Maeve Hutchinson and Radu Jianu and Aidan Slingsby and Jo Wood and Pranava Madhyastha},
  journal= {arXiv preprint arXiv:2507.01627},
  year   = {2025}
}

Comments

This paper has been accepted to the ACL Student Research Workshop (SRW) 2025

R2 v1 2026-07-01T03:43:05.988Z