English
Related papers

Related papers: ChartQAPro: A More Diverse and Challenging Benchma…

200 papers

Visualizations play a pivotal role in daily communication in an increasingly data-driven world. Research on multimodal large language models (MLLMs) for automated chart understanding has accelerated massively, with steady improvements on…

Computation and Language · Computer Science 2026-04-20 Jonathan Tonglet , Tinne Tuytelaars , Marie-Francine Moens , Iryna Gurevych

The evaluation of Large Language Models (LLMs) on mathematical reasoning has largely focused on elementary problems, competition-style questions, or formal theorem proving, leaving graduate-level and computational mathematics relatively…

Computation and Language · Computer Science 2026-03-05 Bianca Raimondi , Francesco Pivi , Davide Evangelista , Maurizio Gabbrielli

Large language models (LLMs) demonstrate remarkable performance across various tasks, prompting researchers to develop diverse evaluation benchmarks. However, most benchmarks typically measure the ability of LLMs to respond to individual…

Computation and Language · Computer Science 2026-01-30 Yutao Hou , Yajing Luo , Zhiwen Ruan , Hongru Wang , Weifeng Ge , Yun Chen , Guanhua Chen

Understanding surveillance video content remains a critical yet underexplored challenge in vision-language research, particularly due to its real-world complexity, irregular event dynamics, and safety-critical implications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Bo Liu , Pengfei Qiao , Minhan Ma , Xuange Zhang , Yinan Tang , Peng Xu , Kun Liu , Tongtong Yuan

Despite significant breakthroughs in video analysis driven by the rapid development of large multimodal models (LMMs), there remains a lack of a versatile evaluation benchmark to comprehensively assess these models' performance in video…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yunxin Li , Xinyu Chen , Baotian Hu , Longyue Wang , Haoyuan Shi , Min Zhang

Chart summarization, which focuses on extracting key information from charts and interpreting it in natural language, is crucial for generating and delivering insights through effective and accessible data analysis. Traditional methods for…

Multimedia · Computer Science 2024-12-31 Peixin Xu , Yujuan Ding , Wenqi Fan

Automated agents, powered by Large language models (LLMs), are emerging as the go-to tool for querying information. However, evaluation benchmarks for LLM agents rarely feature natural questions that are both information-seeking and…

Computation and Language · Computer Science 2025-09-04 Tomer Wolfson , Harsh Trivedi , Mor Geva , Yoav Goldberg , Dan Roth , Tushar Khot , Ashish Sabharwal , Reut Tsarfaty

Despite recent advances in large language models (LLMs), most QA benchmarks are still confined to single-paragraph or single-document settings, failing to capture the complexity of real-world information-seeking tasks. Practical QA often…

Computation and Language · Computer Science 2025-08-25 Jiwon Park , Seohyun Pyeon , Jinwoo Kim , Rina Carines Cabal , Yihao Ding , Soyeon Caren Han

Vision-Language Models (VLMs) have been increasingly applied in real-world scenarios due to their outstanding understanding and reasoning capabilities. Although VLMs have already demonstrated impressive capabilities in common visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Yuechen Xie , Xiaoyan Zhang , Yicheng Shan , Hao Zhu , Rui Tang , Rong Wei , Mingli Song , Yuanyu Wan , Jie Song

Is basic visual understanding really solved in state-of-the-art VLMs? We present VisualOverload, a slightly different visual question answering (VQA) benchmark comprising 2,720 question-answer pairs, with privately held ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Paul Gavrikov , Wei Lin , M. Jehanzeb Mirza , Soumya Jahagirdar , Muhammad Huzaifa , Sivan Doveh , Serena Yeung-Levy , James Glass , Hilde Kuehne

The advent and proliferation of large multi-modal models (LMMs) have introduced new paradigms to computer vision, transforming various tasks into a unified visual question answering framework. Video Quality Assessment (VQA), a classic field…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Ziheng Jia , Zicheng Zhang , Jiaying Qian , Haoning Wu , Wei Sun , Chunyi Li , Xiaohong Liu , Weisi Lin , Guangtao Zhai , Xiongkuo Min

Multimodal reasoning models often produce fluent answers supported by seemingly coherent rationales. Existing benchmarks evaluate only final-answer correctness. They do not support atomic visual entailment verification of intermediate…

Artificial Intelligence · Computer Science 2026-03-25 Saleem Ahmed , Srirangaraj Setlur , Venu Govindaraju

Visual Question Answering (VQA) is a challenging task of natural language processing (NLP) and computer vision (CV), attracting significant attention from researchers. English is a resource-rich language that has witnessed various…

Computation and Language · Computer Science 2024-04-18 Ngan Luu-Thuy Nguyen , Nghia Hieu Nguyen , Duong T. D Vo , Khanh Quoc Tran , Kiet Van Nguyen

Accurate chart comprehension represents a critical challenge in advancing multimodal learning systems, as extensive information is compressed into structured visual representations. However, existing vision-language models (VLMs) frequently…

Machine Learning · Computer Science 2026-03-10 Xin Zhang , Xingyu Li , Rongguang Wang , Ruizhong Miao , Zheng Wang , Dan Roth , Chenyang Li

Image captions serve as efficient surrogates for visual content in multimodal systems such as retrieval, recommendation, and multi-step agentic inference pipelines. Yet current evaluation practices miss a fundamental question: Can captions…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Shijia Yang , Yunong Liu , Bohan Zhai , Ximeng Sun , Zicheng Liu , Emad Barsoum , Manling Li , Chenfeng Xu

Generating high-quality charts with Large Language Models (LLMs) presents significant challenges due to limited data and the high cost of scaling through human curation. $\langle \text{instruction}, \text{data}, \text{code} \rangle$…

Spectra are a prevalent yet highly information-dense form of scientific imagery, presenting substantial challenges to multimodal large language models (MLLMs) due to their unstructured and domain-specific characteristics. Here we introduce…

Artificial Intelligence · Computer Science 2026-05-01 Jialu Shen , Han Lyu , Suyang Zhong , Hanzheng Li , Haoyi Tao , Nan Wang , Changhong Chen , Xi Fang

Recent advancements in large vision-language models (LVLMs) have led to significant progress in generating natural language descriptions for visual content and thus enhancing various applications. One issue with these powerful models is…

Computation and Language · Computer Science 2024-05-31 Kung-Hsiang Huang , Mingyang Zhou , Hou Pong Chan , Yi R. Fung , Zhenhailong Wang , Lingyu Zhang , Shih-Fu Chang , Heng Ji

Charts effectively convey quantitative information, but the underlying data are often locked in image form, hindering reuse and analysis. Manually digitizing charts is time-consuming and error-prone, motivating automatic chart-to-table…

Computation and Language · Computer Science 2026-05-27 Thomas Berkane , Qianyi Wang , Maimuna S. Majumder

Charts are essential to data analysis, transforming raw data into clear visual representations that support human decision-making. Although current vision-language models (VLMs) have made significant progress, they continue to struggle with…