English
Related papers

Related papers: Rethinking Comprehensive Benchmark for Chart Under…

200 papers

Large Language Models (LLMs), while being increasingly dominant on a myriad of knowledge-intensive activities, have only had limited success understanding lengthy table-text mixtures, such as academic papers and financial reports. Recent…

Computation and Language · Computer Science 2024-12-16 Yikang Pan , Yi Zhu , Rand Xie , Yizhi Liu

We introduce MedXpertQA, a highly challenging and comprehensive benchmark to evaluate expert-level medical knowledge and advanced reasoning. MedXpertQA includes 4,460 questions spanning 17 specialties and 11 body systems. It includes two…

Artificial Intelligence · Computer Science 2025-06-09 Yuxin Zuo , Shang Qu , Yifei Li , Zhangren Chen , Xuekai Zhu , Ermo Hua , Kaiyan Zhang , Ning Ding , Bowen Zhou

Chart descriptions are essential for accessibility, cross-modal retrieval, and assisting readers in extracting insights from complex visualizations. As multimodal large language models (MLLMs) are increasingly adopted for automated chart…

Computation and Language · Computer Science 2026-05-25 Fen Wang , Zekai Shao , Qiman Kang , Chunran Hu , Zhixuan Zhang , Lexu Xie , Chao Liu , Siming Chen

Text-to-chart retrieval, enabling users to find relevant charts via natural language queries, has gained significant attention. However, evaluating models in real-world business intelligence (BI) scenarios is challenging, as current…

Information Retrieval · Computer Science 2026-03-18 Yifan Wu , Lutao Yan , Yizhang Zhu , Yenchi Tseng , Yinan Mei , Yong Wang , Jiannan Wang , Nan Tang , Yuyu Luo

Understanding research papers remains challenging for foundation models due to specialized scientific discourse and complex figures and tables, yet existing benchmarks offer limited fine-grained evaluation at scale. To address this gap, we…

Computation and Language · Computer Science 2026-05-01 Yelin Chen , Fanjin Zhang , Suping Sun , Yunhe Pang , Yuanchun Wang , Jian Song , Xiaoyan Li , Lei Hou , Shu Zhao , Jie Tang , Juanzi Li

Chart understanding enables automated data analysis for humans, which requires models to achieve highly accurate visual comprehension. While existing Visual Language Models (VLMs) have shown progress in chart understanding, the lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Muye Huang , Han Lai , Xinyu Zhang , Wenjun Wu , Jie Ma , Lingling Zhang , Jun Liu

Multimodal Large Language Models (MLLMs) have shown remarkable versatility but face challenges in demonstrating true visual understanding, particularly in chart reasoning tasks. Existing benchmarks like ChartQA reveal significant reliance…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Yuyang Ji , Haohan Wang

With the widespread application of multimodal large language models in scientific intelligence, there is an urgent need for more challenging evaluation benchmarks to assess their ability to understand complex scientific data. Scientific…

Artificial Intelligence · Computer Science 2025-12-12 Yitong Zhou , Mingyue Cheng , Qingyang Mao , Yucong Luo , Qi Liu , Yupeng Li , Xiaohan Zhang , Deguang Liu , Xin Li , Enhong Chen

We introduce ScreenQA, a novel benchmarking dataset designed to advance screen content understanding through question answering. The existing screen datasets are focused either on low-level structural and component understanding, or on a…

Computation and Language · Computer Science 2025-02-11 Yu-Chung Hsiao , Fedir Zubach , Gilles Baechler , Srinivas Sunkara , Victor Carbune , Jason Lin , Maria Wang , Yun Zhu , Jindong Chen

Charts are common in literature across various scientific fields, conveying rich information easily accessible to readers. Current chart-related tasks focus on either chart perception that extracts information from the visual charts, or…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Renqiu Xia , Haoyang Peng , Hancheng Ye , Mingsheng Li , Xiangchao Yan , Peng Ye , Botian Shi , Yu Qiao , Junchi Yan , Bo Zhang

The paper introduces SceMQA, a novel benchmark for scientific multimodal question answering at the college entrance level. It addresses a critical educational phase often overlooked in existing benchmarks, spanning high school to…

Artificial Intelligence · Computer Science 2024-02-09 Zhenwen Liang , Kehan Guo , Gang Liu , Taicheng Guo , Yujun Zhou , Tianyu Yang , Jiajun Jiao , Renjie Pi , Jipeng Zhang , Xiangliang Zhang

Multimodal reasoning models often produce fluent answers supported by seemingly coherent rationales. Existing benchmarks evaluate only final-answer correctness. They do not support atomic visual entailment verification of intermediate…

Artificial Intelligence · Computer Science 2026-03-25 Saleem Ahmed , Srirangaraj Setlur , Venu Govindaraju

Evaluating long-form responses to research queries heavily relies on expert annotators, restricting attention to areas like AI where researchers can conveniently enlist colleagues. Yet, research expertise is abundant: survey articles…

Computation and Language · Computer Science 2025-12-22 Li S. Yifei , Allen Chang , Chaitanya Malaviya , Mark Yatskar

Chart question-answering (QA) benchmarks aim to pose questions that require visual reasoning to correctly answer, but models can often reach solutions through shortcuts or prior familiarity with a chart based on their own background…

Computation and Language · Computer Science 2026-05-27 Yifan Jiang , Dae Yon Hwang , Jesse C. Cresswell , Freda Shi

Citation context analysis (CCA) is an important task in natural language processing that studies how and why scholars discuss each others' work. Despite decades of study, traditional frameworks for CCA have largely relied on…

Computation and Language · Computer Science 2021-08-03 Anne Lauscher , Brandon Ko , Bailey Kuehl , Sophie Johnson , David Jurgens , Arman Cohan , Kyle Lo

Scientific figure interpretation is a crucial capability for AI-driven scientific assistants built on advanced Large Vision Language Models. However, current datasets and benchmarks primarily focus on simple charts or other relatively…

Chart Question Answering (CQA) aims at answering questions based on the visual chart content, which plays an important role in chart sumarization, business data analysis, and data report generation. CQA is a challenging multi-modal task…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Lingling Zhang , Muye Huang , QianYing Wang , Yaxian Wang , Wenjun Wu , Jun Liu

Chart comprehension presents significant challenges for machine learning models due to the diverse and intricate shapes of charts. Existing multimodal methods often overlook these visual features or fail to integrate them effectively for…

Computation and Language · Computer Science 2024-08-01 Hanwen Zheng , Sijia Wang , Chris Thomas , Lifu Huang

Scientific papers use schematic diagrams to communicate methods, workflows, and system structure, yet existing scientific-figure corpora often mix them with plots, screenshots, and photographs and rarely preserve document context. We…

Information Retrieval · Computer Science 2026-05-28 Ling Yue , Tingwen Zhang , Jiaying Wang , Zhen Xu , Shaowu Pan

Multimodal Large Language Models (MLLMs) have garnered significant attention for their strong visual-semantic understanding. Most existing chart benchmarks evaluate MLLMs' ability to parse information from charts to answer questions.…

Computation and Language · Computer Science 2025-03-10 Xiangnan Chen , Yuancheng Fang , Qian Xiao , Juncheng Li , Jun Lin , Siliang Tang , Yi Yang , Yueting Zhuang