English
Related papers

Related papers: ChartAct: A Benchmark for Dynamic Chart Understand…

200 papers

In this study, we address the growing issue of misleading charts, a prevalent problem that undermines the integrity of information dissemination. Misleading charts can distort the viewer's perception of data, leading to misinterpretations…

Human-Computer Interaction · Computer Science 2024-07-25 Leo Yu-Ho Lo , Huamin Qu

Interactive machine reading comprehension (iMRC) is machine comprehension tasks where knowledge sources are partially observable. An agent must interact with an environment sequentially to gather necessary knowledge in order to answer a…

Computation and Language · Computer Science 2021-09-02 Xingdi Yuan

As mobile devices are becoming ubiquitous, regularly interacting with a variety of user interfaces (UIs) is a common aspect of daily life for many people. To improve the accessibility of these devices and to enable their usage in a variety…

Computation and Language · Computer Science 2021-01-27 Zecheng He , Srinivas Sunkara , Xiaoxue Zang , Ying Xu , Lijuan Liu , Nevan Wichers , Gabriel Schubiner , Ruby Lee , Jindong Chen , Blaise Agüera y Arcas

Charts are an excellent way to convey patterns and trends in data, but they do not facilitate further modeling of the data or close inspection of individual data points. We present a fully automated system for extracting the numerical…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Mathieu Cliche , David Rosenberg , Dhruv Madeka , Connie Yee

Pictorial visualization seamlessly integrates data and semantic context into visual representation, conveying complex information in a manner that is both engaging and informative. Extensive studies have been devoted to developing authoring…

Artificial Intelligence · Computer Science 2023-07-04 Shishi Xiao , Suizi Huang , Yue Lin , Yilin Ye , Wei Zeng

Behavior-related research areas such as motion prediction/planning, representation/imitation learning, behavior modeling/generation, and algorithm testing, require support from high-quality motion datasets containing interactive driving…

This paper proposes a web-based visual graph analytics platform for interactive graph mining, visualization, and real-time exploration of networks. GraphVis is fast, intuitive, and flexible, combining interactive visualizations with…

Social and Information Networks · Computer Science 2015-02-03 Nesreen K. Ahmed , Ryan A. Rossi

We introduce CHARTOM, a visual theory-of-mind benchmark designed to evaluate multimodal large language models' capability to understand and reason about misleading data visualizations though charts. CHARTOM consists of carefully designed…

Artificial Intelligence · Computer Science 2025-07-01 Shubham Bharti , Shiyun Cheng , Jihyun Rho , Jianrui Zhang , Mu Cai , Yong Jae Lee , Martina Rau , Xiaojin Zhu

Diagrams are common tools for representing complex concepts, relationships and events, often when it would be difficult to portray the same information with natural images. Understanding natural images has been extensively studied in…

Computer Vision and Pattern Recognition · Computer Science 2016-03-25 Aniruddha Kembhavi , Mike Salvato , Eric Kolve , Minjoon Seo , Hannaneh Hajishirzi , Ali Farhadi

Charts are used to communicate data visually, but often, we do not know whether a chart's intended message aligns with the message readers perceive. In this mixed-methods study, we investigate how data journalists encode data and how…

Human-Computer Interaction · Computer Science 2025-02-24 Christian Knoll , Torsten Möller , Kathleen Gregory , Laura Koesten

Well-designed data visualizations can lead to more powerful and intuitive processing by a viewer. To help a viewer intuitively compare values to quickly generate key takeaways, visualization designers can manipulate how data values are…

Human-Computer Interaction · Computer Science 2021-08-17 Cindy Xiong , Vidya Setlur , Benjamin Bach , Kylie Lin , Eunyee Koh , Steven Franconeri

Although visualization tools are widely available and accessible, not everyone knows the best practices and guidelines for creating accurate and honest visual representations of data. Numerous books and articles have been written to expose…

Human-Computer Interaction · Computer Science 2023-09-06 Leo Yu-Ho Lo , Yifan Cao , Leni Yang , Huamin Qu

We introduce DABstep, a novel benchmark for evaluating AI agents on realistic multi-step data analysis tasks. DABstep comprises over 450 real-world challenges derived from a financial analytics platform, requiring models to combine…

Machine Learning · Computer Science 2025-07-01 Alex Egg , Martin Iglesias Goyanes , Friso Kingma , Andreu Mora , Leandro von Werra , Thomas Wolf

Tabular data plays a pivotal role in various fields, making it a popular format for data manipulation and exchange, particularly on the web. The interpretation, extraction, and processing of tabular information are invaluable for…

Artificial Intelligence · Computer Science 2024-11-20 Marco Cremaschi , Blerina Spahiu , Matteo Palmonari , Ernesto Jimenez-Ruiz

Embedding static graphs in low-dimensional vector spaces plays a key role in network analytics and inference, supporting applications like node classification, link prediction, and graph visualization. However, many real-world networks…

Machine Learning · Computer Science 2021-07-23 Claudio D. T. Barros , Matheus R. F. Mendonça , Alex B. Vieira , Artur Ziviani

Given the ubiquity of charts as a data analysis, visualization, and decision-making tool across industries and sciences, there has been a growing interest in developing pre-trained foundation models as well as general purpose…

Artificial Intelligence · Computer Science 2024-11-05 Ahmed Masry , Megh Thakkar , Aayush Bajaj , Aaryaman Kartha , Enamul Hoque , Shafiq Joty

This paper introduces a method and application for automatically detecting behavioral interactions between grazing cattle from a single image, which is essential for smart livestock management in the cattle industry, such as for detecting…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Ren Nakagawa , Yang Yang , Risa Shinoda , Hiroaki Santo , Kenji Oyama , Fumio Okura , Takenao Ohkawa

Many real-world systems exhibit temporal, dynamic behaviors, which are captured as time series of complex agent interactions. To perform temporal reasoning, current methods primarily encode temporal dynamics through simple sequence-based…

Machine Learning · Computer Science 2024-01-09 Paridhi Maheshwari , Hongyu Ren , Yanan Wang , Rok Sosic , Jure Leskovec

In recent years, the prevalent online services generate a sheer volume of user activity data. Service providers collect these data in order to perform client behavior analysis, and offer better and more customized services. Majority of…

Machine Learning · Computer Science 2022-03-29 Yuecai Zhu , Fuyuan Lyu , Chengming Hu , Xi Chen , Xue Liu

Vision-Language Models (VLMs) have demonstrated impressive capabilities in code generation across various domains. However, their ability to replicate complex, multi-panel visualizations from real-world data remains largely unassessed. To…