English
Related papers

Related papers: ChartAgent: A Chart Understanding Framework with T…

200 papers

Recent multimodal LLMs have shown promise in chart-based visual question answering, but their performance declines sharply on unannotated charts-those requiring precise visual interpretation rather than relying on textual shortcuts. To…

Artificial Intelligence · Computer Science 2026-01-08 Rachneet Kaur , Nishan Srishankar , Zhen Zeng , Sumitra Ganesh , Manuela Veloso

Charts are a powerful tool for visually conveying complex data, but their comprehension poses a challenge due to the diverse chart types and intricate components. Existing chart comprehension methods suffer from either heuristic rules or an…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Zhi-Qi Cheng , Qi Dai , Siyao Li , Jingdong Sun , Teruko Mitamura , Alexander G. Hauptmann

Large Language Models (LLMs) can perform chart question-answering tasks but often generate unverified hallucinated responses. Existing answer attribution methods struggle to ground responses in source charts due to limited visual-semantic…

Computation and Language · Computer Science 2025-02-04 Kanika Goswami , Puneet Mathur , Ryan Rossi , Franck Dernoncourt

Charts are ubiquitous in scientific and financial literature for presenting structured data. However, chart reasoning remains challenging for multimodal large language models (MLLMs) due to the lack of high-quality training data, as well as…

Artificial Intelligence · Computer Science 2026-04-06 Situo Zhang , Yifan Zhang , Zichen Zhu , Da Ma , Lei Pan , Danyang Zhang , Zihan Zhao , Lu Chen , Kai Yu

Current Large Language Models (LLMs) exhibit limited ability to understand table structures and to apply precise numerical reasoning, which is crucial for tasks such as table question answering (TQA) and table-based fact verification (TFV).…

Computation and Language · Computer Science 2025-07-11 Xinyuan Lu , Liangming Pan , Yubo Ma , Preslav Nakov , Min-Yen Kan

Chart summarization is crucial for enhancing data accessibility and the efficient consumption of information. However, existing methods, including those with Multimodal Large Language Models (MLLMs), primarily focus on low-level data…

Artificial Intelligence · Computer Science 2026-02-24 Yuhang Bai , Yujuan Ding , Shanru Lin , Wenqi Fan

Data visualizations like charts are fundamental tools for quantitative analysis and decision-making across fields, requiring accurate interpretation and mathematical reasoning. The emergence of Multimodal Large Language Models (MLLMs)…

Artificial Intelligence · Computer Science 2025-08-26 Anku Rani , Aparna Garimella , Apoorv Saxena , Balaji Vasan Srinivasan , Paul Pu Liang

Current Large Language Model (LLM) agents demonstrate strong reasoning and tool use capabilities, but often lack self-awareness, failing to balance these approaches effectively. This imbalance leads to Tool Overuse, where models…

Artificial Intelligence · Computer Science 2025-05-27 Cheng Qian , Emre Can Acikgoz , Hongru Wang , Xiusi Chen , Avirup Sil , Dilek Hakkani-Tür , Gokhan Tur , Heng Ji

Multimodal Large Language Models (MLLMs) have shown remarkable versatility but face challenges in demonstrating true visual understanding, particularly in chart reasoning tasks. Existing benchmarks like ChartQA reveal significant reliance…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Yuyang Ji , Haohan Wang

Chart summarization, which focuses on extracting key information from charts and interpreting it in natural language, is crucial for generating and delivering insights through effective and accessible data analysis. Traditional methods for…

Multimedia · Computer Science 2024-12-31 Peixin Xu , Yujuan Ding , Wenqi Fan

We introduce Agentic Reasoning, a framework that enhances large language model (LLM) reasoning by integrating external tool-using agents. Agentic Reasoning dynamically leverages web search, code execution, and structured memory to address…

Artificial Intelligence · Computer Science 2025-07-16 Junde Wu , Jiayuan Zhu , Yuyuan Liu , Min Xu , Yueming Jin

Charts play a vital role in data visualization, understanding data patterns, and informed decision-making. However, their unique combination of graphical elements (e.g., bars, lines) and textual components (e.g., labels, legends) poses…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Fanqing Meng , Wenqi Shao , Quanfeng Lu , Peng Gao , Kaipeng Zhang , Yu Qiao , Ping Luo

Solving complex chart Q&A tasks requires advanced visual reasoning abilities in multimodal large language models (MLLMs), including recognizing key information from visual inputs and conducting reasoning over it. While fine-tuning MLLMs for…

Computation and Language · Computer Science 2025-09-03 Wei He , Zhiheng Xi , Wanxu Zhao , Xiaoran Fan , Yiwen Ding , Zifei Shan , Tao Gui , Qi Zhang , Xuanjing Huang

Agentic AI has significantly extended the capabilities of large language models (LLMs) by enabling complex reasoning and tool use. However, most existing frameworks are tailored to domains such as mathematics, coding, or web automation, and…

Artificial Intelligence · Computer Science 2025-10-15 Md Hasebul Hasan , Mahir Labib Dihan , Tanzima Hashem , Mohammed Eunus Ali , Md Rizwan Parvez

Vision-language models (VLM) have markedly advanced AI-driven interpretation and reporting of complex medical imaging, such as computed tomography (CT). Yet, existing methods largely relegate clinicians to passive observers of final…

The widespread use of charts and infographics as a means of data visualization in various domains has inspired recent research in automated chart understanding. However, information extraction from chart images is a complex multitasked…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Osama Mustafa , Muhammad Khizer Ali , Momina Moetesum , Imran Siddiqi

Recent advancements in Multi-modal Large Language Models (MLLMs) have significantly improved their performance in tasks combining vision and language. However, challenges persist in detailed multi-modal understanding, comprehension of…

Computation and Language · Computer Science 2024-05-29 Somnath Kumar , Yash Gadhia , Tanuja Ganu , Akshay Nambi

Recent advances in multimodal large language models (MLLMs) highlight the need for benchmarks that rigorously evaluate structured chart comprehension. Chart grounding refers to the bidirectional alignment between a chart's visual appearance…

Artificial Intelligence · Computer Science 2026-02-02 Xinhang Li , Jingbo Zhou , Pengfei Luo , Yixiong Xiao , Tong Xu

Tool learning is increasingly important for large language models (LLMs) to effectively coordinate and utilize a diverse set of tools in order to solve complex real-world tasks. By selecting and integrating appropriate tools, LLMs extend…

Machine Learning · Computer Science 2026-01-21 Zheng Fang , Wolfgang Mayer , Zeyu Zhang , Jian Wang , Hong-Yu Zhang , Wanli Li , Zaiwen Feng

The rapid development of generative artificial intelligence (GenAI) presents new opportunities to advance the cartographic process. Previous studies have either overlooked the artistic aspects of maps or faced challenges in creating both…

Human-Computer Interaction · Computer Science 2025-05-16 Chenglong Wang , Yuhao Kang , Zhaoya Gong , Pengjun Zhao , Yu Feng , Wenjia Zhang , Ge Li
‹ Prev 1 2 3 10 Next ›