English
Related papers

Related papers: Pluto: Authoring Semantically Aligned Text and Cha…

200 papers

With the rise of mobile-first consumption, users increasingly engage with data visualizations on mobile devices. However, the vast majority of existing visualizations are originally authored for desktop environments. Due to significant…

Human-Computer Interaction · Computer Science 2026-04-28 Can Liu , Sizhe Cheng , Feng Liang , Zhibang Jiang , Lingru Huang , Kavinda Athapaththu , Yong Wang

Data charts are prevalent across various fields due to their efficacy in conveying complex data relationships. However, static charts may sometimes struggle to engage readers and efficiently present intricate information, potentially…

Human-Computer Interaction · Computer Science 2024-05-20 Lu Ying , Yun Wang , Haotian Li , Shuguang Dou , Haidong Zhang , Xinyang Jiang , Huamin Qu , Yingcai Wu

Interfaces for creating visualizations typically embrace one of several common forms. Textual specification enables fine-grained control, shelf building facilitates rapid exploration, while chart choosing promotes immediacy and simplicity.…

Human-Computer Interaction · Computer Science 2021-01-27 Andrew McNutt , Ravi Chugh

Storytelling algorithms aim to 'connect the dots' between disparate documents by linking starting and ending documents through a series of intermediate documents. Existing storytelling algorithms are based on notions of coherence and…

Artificial Intelligence · Computer Science 2016-02-23 Dipayan Maiti , Mohammad Raihanul Islam , Scotland Leman , Naren Ramakrishnan

GRAFT is a structured multimodal benchmark designed to probe how well LLMs handle instruction following, visual reasoning, and tasks requiring tight visual textual alignment. The dataset is built around programmatically generated charts and…

Artificial Intelligence · Computer Science 2025-12-03 Abhigya Verma , Sriram Puttagunta , Seganrasan Subramanian , Sravan Ramachandran

Ontologies are formal representations of concepts and complex relationships among them. They have been widely used to capture comprehensive domain knowledge in areas such as biology and medicine, where large and complex ontologies can…

Human-Computer Interaction · Computer Science 2019-10-24 Ying Yang , Michael Wybrow , Yuan-Fang Li , Tobias Czauderna , Yongqun He

Visual language such as charts and plots is ubiquitous in the human world. Comprehending plots and charts requires strong reasoning skills. Prior state-of-the-art (SOTA) models require at least tens of thousands of training examples and…

Knowledge-intensive text usually contains fruitful entities and complex relationships, such as academic articles and scientific exposition. Reading and comprehending such texts often demands considerable time and mental effort to track the…

Human-Computer Interaction · Computer Science 2026-04-15 Xin Qian , Dazhen Deng , Zhaoping He , Xingbo Wang , Yuchen He , Yingcai Wu

Visualization onboarding supports users in reading, interpreting, and extracting information from visual data representations. General-purpose onboarding tools and libraries are applicable for explaining a wide range of graphical user…

Visualizing NLP annotation is useful for the collection of training data for the statistical NLP approaches. Existing toolkits either provide limited visual aid, or introduce comprehensive operators to realize sophisticated linguistic…

Computation and Language · Computer Science 2015-08-26 Hanchuan Li , Haichen Shen , Shengliang Xu , Congle Zhang

We present drillboards, a technique for adaptive visualization dashboards consisting of a hierarchy of coordinated charts that the user can drill down to reach a desired level of detail depending on their expertise, interest, and desired…

Human-Computer Interaction · Computer Science 2025-02-18 Sungbok Shin , Inyoup Na , Niklas Elmqvist

We introduce CHARTOM, a visual theory-of-mind benchmark designed to evaluate multimodal large language models' capability to understand and reason about misleading data visualizations though charts. CHARTOM consists of carefully designed…

Artificial Intelligence · Computer Science 2025-07-01 Shubham Bharti , Shiyun Cheng , Jihyun Rho , Jianrui Zhang , Mu Cai , Yong Jae Lee , Martina Rau , Xiaojin Zhu

Vision-Language Models (VLMs) have shown promise in generating plotting code from chart images, yet achieving structural fidelity remains challenging. Existing approaches largely rely on supervised fine-tuning, encouraging surface-level…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Minggui He , Mingchen Dai , Jian Zhang , Yilun Liu , Shimin Tao , Pufan Zeng , Osamu Yoshie , Yuya Ieiri

The message a designer wants to convey plays a pivotal role in directing the design of an infographic, yet most authoring workflows start with creating the visualizations or graphics first without gauging whether they fit the message. To…

Human-Computer Interaction · Computer Science 2024-04-17 Tongyu Zhou , Jeff Huang , Gromit Yeuk-Yin Chan

University timetabling (UTT) is a complex problem due to its combinatorial nature but also the type of constraints involved. The holy grail of (constraint) programming: "the user states the problem the program solves it" remains a challenge…

Artificial Intelligence · Computer Science 2015-03-19 Islam Abdelraouf , Slim Abdennadher , Carmen Gervet

Constructive approaches to visualization authoring have been shown to offer advantages such as providing options for flexible outputs, scaffolding and ideation of new data mappings, personalized exploration of data, as well as supporting…

Human-Computer Interaction · Computer Science 2019-08-05 Gonzalo Gabriel Méndez , Jagoda Walny , Søren Knudsen , Charles Perin , Samuel Huron , Jo Vermeulen , Richard Pusch , Sheelagh Carpendale

Keyphrase annotation is the task of identifying textual units that represent the main content of a document. Keyphrase annotation is either carried out by extracting the most important phrases from a document, keyphrase extraction, or by…

Computation and Language · Computer Science 2016-11-08 Adrien Bougouin , Florian Boudin , Béatrice Daille

Despite the ubiquity of visualization examples published on the web, retargeting existing custom chart implementations to new datasets remains difficult, time-intensive, and tedious. The adaptation process assumes author familiarity with…

Human-Computer Interaction · Computer Science 2026-01-21 Luke S. Snyder , Chenglong Wang , Steven M. Drucker

Visual captioning aims to generate textual descriptions given images or videos. Traditionally, image captioning models are trained on human annotated datasets such as Flickr30k and MS-COCO, which are limited in size and diversity. This…

Computer Vision and Pattern Recognition · Computer Science 2021-03-01 Marimuthu Kalimuthu , Aditya Mogadala , Marius Mosbach , Dietrich Klakow

Recently, interpreting complex charts with logical reasoning has emerged as challenges due to the development of vision-language models. A prior state-of-the-art (SOTA) model has presented an end-to-end method that leverages the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Wonjoong Kim , Sangwu Park , Yeonjun In , Seokwon Han , Chanyoung Park