English
Related papers

Related papers: ChartText: Linking Text with Charts in Documents

200 papers

Charts are widely used to present complex data for analysis and decision making. Existing chart understanding benchmarks mainly focus on static charts, but real-world charts are often dynamic and interactive. Key information may only appear…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Muye Huang , Lin Wu , Lingling Zhang , Hang Yan , Zhiyuan Wang , Yumeng Fu , Zesheng Yang , Jun Liu

Chart images, such as bar charts, pie charts, and line charts, are explosively produced due to the wide usage of data visualizations. Accordingly, knowledge mining from chart images is becoming increasingly important, which can benefit…

Artificial Intelligence · Computer Science 2024-10-15 Zhiguang Zhou , Haoxuan Wang , Zhengqing Zhao , Fengling Zheng , Yongheng Wang , Wei Chen , Yong Wang

Data charts are prevalent across various fields due to their efficacy in conveying complex data relationships. However, static charts may sometimes struggle to engage readers and efficiently present intricate information, potentially…

Human-Computer Interaction · Computer Science 2024-05-20 Lu Ying , Yun Wang , Haotian Li , Shuguang Dou , Haidong Zhang , Xinyang Jiang , Huamin Qu , Yingcai Wu

Visually-situated languages such as charts and plots are omnipresent in real-world documents. These graphical depictions are human-readable and are often analyzed in visually-rich documents to address a variety of questions that necessitate…

Artificial Intelligence · Computer Science 2023-10-31 Anran Wu , Luwei Xiao , Xingjiao Wu , Shuwen Yang , Junjie Xu , Zisong Zhuang , Nian Xie , Cheng Jin , Liang He

Alternative Texts (Alt-Text) for chart images are essential for making graphics accessible to people with blindness and visual impairments. Traditionally, Alt-Text is manually written by authors but often encounters issues such as…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Omar Moured , Shahid Ali Farooqui , Karin Muller , Sharifeh Fadaeijouybari , Thorsten Schwarz , Mohammed Javed , Rainer Stiefelhagen

The widespread use of charts and infographics as a means of data visualization in various domains has inspired recent research in automated chart understanding. However, information extraction from chart images is a complex multitasked…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Osama Mustafa , Muhammad Khizer Ali , Momina Moetesum , Imran Siddiqi

Understanding charts requires models to jointly reason over geometric visual patterns, structured numerical data, and natural language -- a capability where current vision-language models (VLMs) remain limited. We introduce ChartNet, a…

Large Language Models (LLMs) have demonstrated strong capabilities in transforming text descriptions or tables to data visualizations via instruction-tuning methods. However, it is not straightforward to apply these methods directly for a…

Computation and Language · Computer Science 2025-08-28 Akriti Jain , Pritika Ramu , Aparna Garimella , Apoorv Saxena

Chart understanding tasks such as ChartQA and Chart-to-Text involve automatically extracting and interpreting key information from charts, enabling users to query or convert visual data into structured formats. State-of-the-art approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Xudong Yang , Yifan Wu , Yizhang Zhu , Nan Tang , Yuyu Luo

Infographics are often an integral component of scientific documents for reporting qualitative or quantitative findings as they make it much simpler to comprehend the underlying complex information. However, their interpretation continues…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Anukriti Kumar , Tanuja Ganu , Saikat Guha

Web-based data visualizations have become very popular for exploring data and communicating insights. Newspapers, journals, and reports regularly publish visualizations to tell compelling stories with data. Unfortunately, most…

Human-Computer Interaction · Computer Science 2023-02-16 Md Zubair Ibne Alam , Shehnaz Islam , Enamul Hoque

Document-level relation extraction requires integrating information within and across multiple sentences of a document and capturing complex interactions between inter-sentence entities. However, effective aggregation of relevant…

Computation and Language · Computer Science 2020-07-29 Guoshun Nan , Zhijiang Guo , Ivan Sekulić , Wei Lu

Textual content (including titles, annotations, and captions) plays a central role in helping readers understand a visualization by emphasizing, contextualizing, or summarizing the depicted data. Yet, existing visualization tools provide…

Human-Computer Interaction · Computer Science 2025-02-12 Arjun Srinivasan , Vidya Setlur , Arvind Satyanarayan

Charts are common in literature across various scientific fields, conveying rich information easily accessible to readers. Current chart-related tasks focus on either chart perception that extracts information from the visual charts, or…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Renqiu Xia , Haoyang Peng , Hancheng Ye , Mingsheng Li , Xiangchao Yan , Peng Ye , Botian Shi , Yu Qiao , Junchi Yan , Bo Zhang

Charts are very popular for analyzing data, visualizing key insights and answering complex reasoning questions about data. To facilitate chart-based data analysis using natural language, several downstream tasks have been introduced…

Computation and Language · Computer Science 2023-10-12 Ahmed Masry , Parsa Kavehzadeh , Xuan Long Do , Enamul Hoque , Shafiq Joty

Charts are very popular to analyze data and convey important insights. People often analyze visualizations to answer open-ended questions that require explanatory answers. Answering such questions are often difficult and time-consuming as…

Machine Learning · Computer Science 2022-10-14 Shankar Kantharaj , Xuan Long Do , Rixie Tiffany Ko Leong , Jia Qing Tan , Enamul Hoque , Shafiq Joty

Infographic charts are a powerful medium for communicating abstract data by combining visual elements (e.g., charts, images) with textual information. However, their visual and structural richness poses challenges for large vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Zhen Li , Duan Li , Yukai Guo , Xinyuan Guo , Bowen Li , Lanxi Xiao , Shenyu Qiao , Jiashu Chen , Zijian Wu , Hui Zhang , Xinhuan Shu , Shixia Liu

This paper investigates the role of text in visualizations, specifically the impact of text position, semantic content, and biased wording. Two empirical studies were conducted based on two tasks (predicting data trends and appraising bias)…

Human-Computer Interaction · Computer Science 2024-01-09 Chase Stokes , Cindy Xiong Bearfield , Marti A. Hearst

The digital conversion of information stored in documents is a great source of knowledge. In contrast to the documents text, the conversion of the embedded documents graphics, such as charts and plots, has been much less explored. We…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Joseph Shtok , Sivan Harary , Ophir Azulai , Adi Raz Goldfarb , Assaf Arbelle , Leonid Karlinsky

While a plethora of research has been devoted to extoling the power and importance of data visualization, research on the effectiveness of data visualization methods from a human perceptual, and more generally, a cognitive standpoint…

Applications · Statistics 2019-10-28 Ronaldo Vigo