English
Related papers

Related papers: Chartographer: Counterfactual Chart Generation for…

200 papers

Zero-shot visual question answering (ZS-VQA), an emerged critical research area, intends to answer visual questions without providing training samples. Existing research in ZS-VQA has proposed to leverage knowledge graphs or large language…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Qian Tao , Xiaoyang Fan , Yong Xu , Xingquan Zhu , Yufei Tang

Large Language Models (LLMs) can perform chart question-answering tasks but often generate unverified hallucinated responses. Existing answer attribution methods struggle to ground responses in source charts due to limited visual-semantic…

Computation and Language · Computer Science 2025-02-04 Kanika Goswami , Puneet Mathur , Ryan Rossi , Franck Dernoncourt

Vision language models (VLMs) show strong results on chart understanding, yet existing benchmarks assume clean figures and fact based queries. Real world charts often contain distortions and demand reasoning beyond simple matching. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Philip Wootaek Shin , Jack Sampson , Vijaykrishnan Narayanan , Andres Marquez , Mahantesh Halappanavar

Factuality in Large Language Models (LLMs) is a persistent challenge. Current benchmarks often assess short factual answers, overlooking the critical ability to generate structured, multi-record tabular outputs from parametric knowledge. We…

Computation and Language · Computer Science 2025-05-28 Dario Satriani , Enzo Veltri , Donatello Santoro , Paolo Papotti

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in chart understanding tasks. However, interpreting charts with textual descriptions often leads to information loss, as it fails to fully capture the dense…

Artificial Intelligence · Computer Science 2025-07-03 Xuanle Zhao , Xianzhen Luo , Qi Shi , Chi Chen , Shuo Wang , Zhiyuan Liu , Maosong Sun

Recent advances in vision-language models (VLMs) have greatly improved cross-modal semantic understanding, yet significant limitations remain in fine-grained discrimination and deep causal reasoning tasks. Existing VLMs often rely on…

Machine Learning · Computer Science 2025-06-24 Jusheng Zhang , Kaitong Cai , Yijia Fan , Jian Wang , Keze Wang

Charts are the dominant medium for visualizing data, discovering patterns and trends, and communicating data driven insights, yet designing them still requires expensive human effort and expertise, such as selecting appropriate chart types,…

Human-Computer Interaction · Computer Science 2026-05-19 Mohammed Afaan Ansari , Aniruddh Bansal , Tianyi Zhou

Charts are ubiquitous in scientific and financial literature for presenting structured data. However, chart reasoning remains challenging for multimodal large language models (MLLMs) due to the lack of high-quality training data, as well as…

Artificial Intelligence · Computer Science 2026-04-06 Situo Zhang , Yifan Zhang , Zichen Zhu , Da Ma , Lei Pan , Danyang Zhang , Zihan Zhao , Lu Chen , Kai Yu

Charts effectively convey quantitative information, but the underlying data are often locked in image form, hindering reuse and analysis. Manually digitizing charts is time-consuming and error-prone, motivating automatic chart-to-table…

Computation and Language · Computer Science 2026-05-27 Thomas Berkane , Qianyi Wang , Maimuna S. Majumder

Visual Query Answering (VQA) is of great significance in offering people convenience: one can raise a question for details of objects, or high-level understanding about the scene, over an image. This paper proposes a novel method to address…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Peixi Xiong , Huayi Zhan , Xin Wang , Baivab Sinha , Ying Wu

Documents are fundamental to preserving and disseminating information, often incorporating complex layouts, tables, and charts that pose significant challenges for automatic document understanding (DU). While vision-language large models…

Computation and Language · Computer Science 2025-06-19 Negar Foroutan , Angelika Romanou , Matin Ansaripour , Julian Martin Eisenschlos , Karl Aberer , Rémi Lebret

The evaluation of text-generative vision-language models is a challenging yet crucial endeavor. By addressing the limitations of existing Visual Question Answering (VQA) benchmarks and proposing innovative evaluation methodologies, our…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Simon Ging , María A. Bravo , Thomas Brox

Diagram question answering (DQA) requires models to interpret structured visual representations such as charts, maps, infographics, circuit schematics, and scientific diagrams. Recent vision-language models (VLMs) often achieve high answer…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Anirudh Iyengar Kaniyar Narayana Iyengar , Tampu Ravi Kumar , Gaurav Najpande , Manan Suri , Dinesh Manocha , Puneet Mathur , Vivek Gupta

In this paper, we introduce VACA, a novel class of variational graph autoencoders for causal inference in the absence of hidden confounders, when only observational data and the causal graph are available. Without making any parametric…

Machine Learning · Statistics 2021-10-29 Pablo Sanchez-Martin , Miriam Rateike , Isabel Valera

Visual reasoning tasks such as visual question answering (VQA) require an interplay of visual perception with reasoning about the question semantics grounded in perception. However, recent advances in this area are still primarily driven by…

Machine Learning · Computer Science 2020-08-27 Saeed Amizadeh , Hamid Palangi , Oleksandr Polozov , Yichen Huang , Kazuhito Koishida

Existing paper review methods often rely on superficial manuscript features or directly on large language models (LLMs), which are prone to hallucinations, biased scoring, and limited reasoning capabilities. Moreover, these methods often…

Computation and Language · Computer Science 2026-03-11 Shuaimin Li , Liyang Fan , Yufang Lin , Zeyang Li , Xian Wei , Shiwen Ni , Hamid Alinejad-Rokny , Min Yang

Vision-Language Models (VLMs) have shown promise in generating plotting code from chart images, yet achieving structural fidelity remains challenging. Existing approaches largely rely on supervised fine-tuning, encouraging surface-level…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Minggui He , Mingchen Dai , Jian Zhang , Yilun Liu , Shimin Tao , Pufan Zeng , Osamu Yoshie , Yuya Ieiri

Chart reasoning is a critical capability for Vision Language Models (VLMs). However, the development of open-source models is severely hindered by the lack of high-quality training data. Existing datasets suffer from a dual challenge:…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Zheng Liu , Honglin Lin , Chonghan Qin , Xiaoyang Wang , Xin Gao , Yu Li , Mengzhang Cai , Yun Zhu , Zhanping Zhong , Qizhi Pei , Zhuoshi Pan , Xiaoran Shang , Bin Cui , Conghui He , Wentao Zhang , Lijun Wu

In this time when biased information, deep fakes, and propaganda proliferate, the accessibility of reliable data sources is more important than ever. National statistical institutes provide curated data that contain quantitative information…

Information Retrieval · Computer Science 2025-10-03 Gadir Suleymanli , Alexander Rogiers , Lucas Lageweg , Jefrey Lijffijt

Data visualizations like charts are fundamental tools for quantitative analysis and decision-making across fields, requiring accurate interpretation and mathematical reasoning. The emergence of Multimodal Large Language Models (MLLMs)…

Artificial Intelligence · Computer Science 2025-08-26 Anku Rani , Aparna Garimella , Apoorv Saxena , Balaji Vasan Srinivasan , Paul Pu Liang