English
Related papers

Related papers: DomainCQA: Crafting Knowledge-Intensive QA from Do…

200 papers

Information visualizations such as bar charts and line charts are very common for analyzing data and discovering critical insights. Often people analyze charts to answer questions that they have in mind. Answering such questions can be…

Computation and Language · Computer Science 2022-05-24 Enamul Hoque , Parsa Kavehzadeh , Ahmed Masry

We present a new dataset for chart question answering (CQA) constructed from visualization notebooks. The dataset features real-world, multi-view charts paired with natural language questions grounded in analytical narratives. Unlike prior…

Computation and Language · Computer Science 2025-07-03 Maeve Hutchinson , Radu Jianu , Aidan Slingsby , Jo Wood , Pranava Madhyastha

Diagram question answering (DQA) requires models to interpret structured visual representations such as charts, maps, infographics, circuit schematics, and scientific diagrams. Recent vision-language models (VLMs) often achieve high answer…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Anirudh Iyengar Kaniyar Narayana Iyengar , Tampu Ravi Kumar , Gaurav Najpande , Manan Suri , Dinesh Manocha , Puneet Mathur , Vivek Gupta

Open-ended question answering (QA) evaluates a model's ability to perform contextualized reasoning beyond factual recall. This challenge is especially acute in practice-based domains, where knowledge is procedural and grounded in…

Computation and Language · Computer Science 2026-01-29 Si Chen , Le Huy Khiem , Annalisa Szymanski , Ronald Metoyer , Ting Hua , Nitesh V. Chawla

Recently, Vision Language Models (VLMs) have increasingly emphasized document visual grounding to achieve better human-computer interaction, accessibility, and detailed understanding. However, its application to visualizations such as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Alexander Vogel , Omar Moured , Yufan Chen , Jiaming Zhang , Rainer Stiefelhagen

Existing benchmarks for visual question answering lack in visual grounding and complexity, particularly in evaluating spatial reasoning skills. We introduce FlowVQA, a novel benchmark aimed at assessing the capabilities of visual…

Computation and Language · Computer Science 2024-07-01 Shubhankar Singh , Purvi Chaurasia , Yerram Varun , Pranshu Pandya , Vatsal Gupta , Vivek Gupta , Dan Roth

Charts are very popular to analyze data and convey important insights. People often analyze visualizations to answer open-ended questions that require explanatory answers. Answering such questions are often difficult and time-consuming as…

Machine Learning · Computer Science 2022-10-14 Shankar Kantharaj , Xuan Long Do , Rixie Tiffany Ko Leong , Jia Qing Tan , Enamul Hoque , Shafiq Joty

Visual Question Answering (VQA) has become an important benchmark for assessing how large multimodal models (LMMs) interpret images. However, most VQA datasets focus on real-world images or simple diagrammatic analysis, with few focused on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Jill P. Naiman , Daniel J. Evans , JooYoung Seo

With the widespread application of multimodal large language models in scientific intelligence, there is an urgent need for more challenging evaluation benchmarks to assess their ability to understand complex scientific data. Scientific…

Artificial Intelligence · Computer Science 2025-12-12 Yitong Zhou , Mingyue Cheng , Qingyang Mao , Yucong Luo , Qi Liu , Yupeng Li , Xiaohan Zhang , Deguang Liu , Xin Li , Enhong Chen

Chart question-answering (QA) benchmarks aim to pose questions that require visual reasoning to correctly answer, but models can often reach solutions through shortcuts or prior familiarity with a chart based on their own background…

Computation and Language · Computer Science 2026-05-27 Yifan Jiang , Dae Yon Hwang , Jesse C. Cresswell , Freda Shi

In this paper, we establish a benchmark for table visual question answering, referred to as the TableVQA-Bench, derived from pre-existing table question-answering (QA) and table structure recognition datasets. It is important to note that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yoonsik Kim , Moonbin Yim , Ka Yeon Song

The advancement of large language models (LLMs) has enhanced tabular question answering (Tabular QA), yet they struggle with open-domain queries exhibiting underspecified or uncertain expressions. To address this, we introduce the…

Computation and Language · Computer Science 2026-04-21 Zhensheng Wang , ZhanTeng Lin , Wenmian Yang , Kun Zhou , Yiquan Zhang , Weijia Jia

Chart question answering (CQA) is a task used for assessing chart comprehension, which is fundamentally different from understanding natural images. CQA requires analyzing the relationships between the textual and the visual components of a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Matan Levy , Rami Ben-Ari , Dani Lischinski

Recent advances in Vision-Language Models (VLMs) have demonstrated impressive capabilities in perception and reasoning. However, the ability to perform causal inference -- a core aspect of human cognition -- remains underexplored,…

Computation and Language · Computer Science 2025-08-14 Keummin Ka , Junhyeong Park , Jaehyun Jeon , Youngjae Yu

Recent advances in multimodal large language models (MLLMs) highlight the need for benchmarks that rigorously evaluate structured chart comprehension. Chart grounding refers to the bidirectional alignment between a chart's visual appearance…

Artificial Intelligence · Computer Science 2026-02-02 Xinhang Li , Jingbo Zhou , Pengfei Luo , Yixiong Xiao , Tong Xu

With the increasing use of Large Language Models (LLMs) in fields such as e-commerce, domain-specific concept evaluation benchmarks are crucial for assessing their domain capabilities. Existing LLMs may generate factually incorrect…

Computation and Language · Computer Science 2025-02-28 Haibin Chen , Kangtao Lv , Chengwei Hu , Yanshi Li , Yujin Yuan , Yancheng He , Xingyao Zhang , Langming Liu , Shilei Liu , Wenbo Su , Bo Zheng

Large Language Models (LLMs) have shown significant progress in Open-domain question answering (ODQA), yet most evaluations focus on English and assume locale-invariant answers across languages. This assumption neglects the cultural and…

Computation and Language · Computer Science 2025-08-25 Keon-Woo Roh , Yeong-Joon Ju , Seong-Whan Lee

Recently, many versatile Multi-modal Large Language Models (MLLMs) have emerged continuously. However, their capacity to query information depicted in visual charts and engage in reasoning based on the queried contents remains…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Renqiu Xia , Bo Zhang , Hancheng Ye , Xiangchao Yan , Qi Liu , Hongbin Zhou , Zijun Chen , Peng Ye , Min Dou , Botian Shi , Junchi Yan , Yu Qiao

How to better evaluate the capabilities of Large Language Models (LLMs) is the focal point and hot topic in current LLMs research. Previous work has noted that due to the extremely high cost of iterative updates of LLMs, they are often…

Computation and Language · Computer Science 2024-03-05 Zhikun Xu , Yinghui Li , Ruixue Ding , Xinyu Wang , Boli Chen , Yong Jiang , Hai-Tao Zheng , Wenlian Lu , Pengjun Xie , Fei Huang

Despite the strong language understanding abilities of large language models (LLMs), they still struggle with reliable question answering (QA) over long, structured documents, particularly for numerical reasoning. Financial annual reports…

Computation and Language · Computer Science 2026-04-07 Yi-Cheng Wang , Wei-An Wang , Chu-Song Chen