English
Related papers

Related papers: Boosting Text-to-Chart Retrieval through Training …

200 papers

Existing retrieval benchmarks primarily consist of text-based queries where keyword or semantic matching is usually sufficient. Many real-world queries contain multimodal elements, particularly, images such as diagrams, charts, and…

Automatic chart to text summarization is an effective tool for the visually impaired people along with providing precise insights of tabular data in natural language to the user. A large and well-structured dataset is always a key part for…

Computation and Language · Computer Science 2023-06-13 Raian Rahman , Rizvi Hasan , Abdullah Al Farhad , Md Tahmid Rahman Laskar , Md. Hamjajul Ashmafee , Abu Raihan Mostofa Kamal

Recent advances in multimodal large language models (MLLMs) highlight the need for benchmarks that rigorously evaluate structured chart comprehension. Chart grounding refers to the bidirectional alignment between a chart's visual appearance…

Artificial Intelligence · Computer Science 2026-02-02 Xinhang Li , Jingbo Zhou , Pengfei Luo , Yixiong Xiao , Tong Xu

Chart editing reduces manual effort in visualization design. Typical benchmarks limited in data diversity and assume access to complete chart code, which is seldom in real-world scenarios. To address this gap, we present ChartEditVista, a…

Multimedia · Computer Science 2025-11-20 Liangyu Chen , Yichen Xu , Jianzhe Ma , Yuqi Liu , Donglu Yang , Liang Zhang , Wenxuan Wang , Qin Jin

Synthesizing clinical evidence largely relies on systematic reviews of clinical trials and retrospective analyses from medical literature. However, the rapid expansion of publications presents challenges in efficiently identifying,…

Computation and Language · Computer Science 2024-10-30 Zifeng Wang , Lang Cao , Benjamin Danek , Qiao Jin , Zhiyong Lu , Jimeng Sun

The data landscape is rich with structured data, often of high value to organizations, driving important applications in data analysis and machine learning. Recent progress in representation learning and generative models for such data has…

Information Retrieval · Computer Science 2025-05-20 Xingyu Ji , Parker Glenn , Aditya G. Parameswaran , Madelon Hulsebos

Recently, there has been an increase in the number of knowledge graphs that can be only queried by experts. However, describing questions using structured queries is not straightforward for non-expert users who need to have sufficient…

Computation and Language · Computer Science 2021-05-04 Abdelghny Orogat , Isabelle Liu , Ahmed El-Roby

AI agents are changing the requirements for document parsing. What matters is semantic correctness: parsed output must preserve the structure and meaning needed for autonomous decisions, including correct table structure, precise chart…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Boyang Zhang , Sebastián G. Acosta , Preston Carlson , Sacha Bron , Pierre-Loïc Doulcet , Daniel B. Ospina , Simon Suo

Charts are a powerful tool for visually conveying complex data, but their comprehension poses a challenge due to the diverse chart types and intricate components. Existing chart comprehension methods suffer from either heuristic rules or an…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Zhi-Qi Cheng , Qi Dai , Siyao Li , Jingdong Sun , Teruko Mitamura , Alexander G. Hauptmann

Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models still struggle with prompts that require rich world knowledge and implicit reasoning: both of which are critical for producing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Daoan Zhang , Che Jiang , Ruoshi Xu , Biaoxiang Chen , Zijian Jin , Yutian Lu , Jianguo Zhang , Liang Yong , Jiebo Luo , Shengda Luo

Whilst fact verification has attracted substantial interest in the natural language processing community, verifying misinforming statements against data visualizations such as charts has so far been overlooked. Charts are commonly used in…

Computation and Language · Computer Science 2024-02-19 Mubashara Akhtar , Nikesh Subedi , Vivek Gupta , Sahar Tahmasebi , Oana Cocarascu , Elena Simperl

With their high information density and intuitive readability, charts have become the de facto medium for data analysis and communication across disciplines. Recent multimodal large language models (MLLMs) have made notable progress in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Boran Wang , Xinming Wang , Yi Chen , Xiang Li , Jian Xu , Jing Yuan , Chenglin Liu

Charts are a universally adopted medium for data communication, yet existing chart understanding benchmarks are overwhelmingly English-centric, limiting their accessibility and relevance to global audiences. To address this limitation, we…

Computation and Language · Computer Science 2026-01-09 Yichen Xu , Liangyu Chen , Liang Zhang , Jianzhe Ma , Wenxuan Wang , Qin Jin

Recent text-to-image (T2I) models have demonstrated impressive capabilities in photorealistic synthesis and instruction following. However, their reliability in knowledge-intensive settings remains largely unexplored. Unlike natural image…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Ran Zhao , Sheng Jin , Size Wu , Kang Liao , Zerui Gong , Zujin Guo , Yang Xiao , Wei Li

Retrieval-Augmented Generation (RAG) has become a standard architectural pattern for incorporating domain-specific knowledge into user-facing chat applications powered by Large Language Models (LLMs). RAG systems are characterized by (1) a…

Computation and Language · Computer Science 2025-01-17 Robert Friel , Masha Belyi , Atindriyo Sanyal

Extracting structured information from visual documents (Visual Information Extraction, VIE) is a cornerstone of business automation. While recent Multimodal Large Language Models (MLLMs) have shown promising capabilities, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Yandi Wang , Libin Zhan , Ziwei Huang , Tiancheng Luo , Yuxuan Jiang , Wang Dong , Leilei Gan , Jun Chen

Large vision-language models (LVLMs) have made significant progress in chart understanding. However, financial charts, characterized by complex temporal structures and domain-specific terminology, remain notably underexplored. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Dong Shu , Haoyang Yuan , Yuchen Wang , Yanguang Liu , Huopu Zhang , Haiyan Zhao , Mengnan Du

While Multimodal Large Language Models (MLLMs) perform strongly on single-turn chart generation, their ability to support real-world exploratory data analysis remains underexplored. In practice, users iteratively refine visualizations…

Computation and Language · Computer Science 2026-02-18 Manav Nitin Kapadnis , Lawanya Baghel , Atharva Naik , Carolyn Rosé

Referring expression grounding is a core problem in visual grounding and is widely used as a diagnostic of spatial grounding and reasoning in vision and language models, yet most prior work focuses on natural images. In contrast, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Tianhao Niu , Ziyu Han , Qingfu Zhu , Wanxiang Che

The field of Multimodal Large Language Models (MLLMs) has made remarkable progress in visual understanding tasks, presenting a vast opportunity to predict the perceptual and emotional impact of charts. However, it also raises concerns, as…

Human-Computer Interaction · Computer Science 2025-05-26 Seon Gyeom Kim , Jae Young Choi , Ryan Rossi , Eunyee Koh , Tak Yeon Lee