English
Related papers

Related papers: Pluto: Authoring Semantically Aligned Text and Cha…

200 papers

We define "visual story-writing" as using visual representations of story elements to support writing and revising narrative texts. To demonstrate this approach, we developed a text editor that automatically visualizes a graph of entity…

Human-Computer Interaction · Computer Science 2025-08-01 Damien Masson , Zixin Zhao , Fanny Chevalier

Annotations play a vital role in highlighting critical aspects of visualizations, aiding in data externalization and exploration, collaborative sensemaking, and visual storytelling. However, despite their widespread use, we identified a…

Human-Computer Interaction · Computer Science 2026-04-10 Md Dilshadur Rahman , Ghulam Jilani Quadri , Bhavana Doppalapudi , Danielle Albers Szafir , Paul Rosen

Images greatly help in understanding, interpreting and visualizing data. Adding textual description to images is the first and foremost principle of web accessibility. Visually impaired users using screen readers will use these textual…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Abhijit Balaji , Thuvaarakkesh Ramanathan , Venkateshwarlu Sonathi

Constructive visualization uses physical data units - tokens - to enable non-experts to create personalized visualizations engagingly. However, its physical nature limits efficiency and scalability. One potential solution to address this…

Human-Computer Interaction · Computer Science 2023-08-09 Wei Wei , Samuel Huron , Yvonne Jansen

We present PLUTO, a powerful framework that pushes the limit of imitation learning-based planning for autonomous driving. Our improvements stem from three pivotal aspects: a longitudinal-lateral aware model architecture that enables…

Robotics · Computer Science 2024-04-23 Jie Cheng , Yingbing Chen , Qifeng Chen

Scientific charts are essential tools for effectively communicating research findings, serving as a vital medium for conveying information and revealing data patterns. With the rapid advancement of science and technology, coupled with the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Mateo Alejandro Rojas , Rafael Carranza

The application of semantic technologies to content on the web is, in many regards, important and urgent. Search engines, chatbots, intelligent personal assistants and other technologies increasingly rely on content published as semantic…

Information Retrieval · Computer Science 2017-10-03 Elias Kärle , Umutcan Şimşek , Dieter Fensel

This paper focuses on creating synthetic data to improve the quality of image captions. Existing works typically have two shortcomings. First, they caption images from scratch, ignoring existing alt-text metadata, and second, lack…

Automatic summarization plays an important role in the exponential document growth on the Web. On content websites such as CNN.com and WikiHow.com, there often exist various kinds of side information along with the main document for…

Computation and Language · Computer Science 2023-05-22 Xiuying Chen , Mingzhe Li , Shen Gao , Xin Cheng , Qiang Yang , Qishen Zhang , Xin Gao , Xiangliang Zhang

A key challenge to visualization authoring is the process of getting familiar with the complex user interfaces of authoring tools. Natural Language Interface (NLI) presents promising benefits due to its learnability and usability. However,…

Human-Computer Interaction · Computer Science 2022-10-25 Yun Wang , Zhitao Hou , Leixian Shen , Tongshuang Wu , Jiaqi Wang , He Huang , Haidong Zhang , Dongmei Zhang

As an effective form of narrative visualization, visual data stories are widely used in data-driven storytelling to communicate complex insights and support data understanding. Although important, they are difficult to create, as a variety…

Human-Computer Interaction · Computer Science 2022-10-12 Mengdi Sun , Ligan Cai , Weiwei Cui , Yanqiu Wu , Yang Shi , Nan Cao

There is increased interest in the interplay between text and visuals in the field of data visualization. However, this attention has predominantly been on the use of text in standalone visualizations or augmenting text stories supported by…

Human-Computer Interaction · Computer Science 2024-08-08 Nicole Sultanum , Vidya Setlur

Entity-aware image captioning aims to describe named entities and events related to the image by utilizing the background knowledge in the associated article. This task remains challenging as it is difficult to learn the association between…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Wentian Zhao , Yao Hu , Heda Wang , Xinxiao Wu , Jiebo Luo

Data Visualization has become an important aspect of big data analytics and has grown in sophistication and variety. We specifically identify the need for an analytical framework for data visualization with textual information. Data…

Social and Information Networks · Computer Science 2020-05-19 Cherilyn Conner , Jim Samuel , Andrey Kretinin , Yana Samuel , Lee Nadeau

Chart annotations enhance visualization accessibility but suffer from fragmented, non-standardized representations that limit cross-platform reuse. We propose ChartMark, a structured grammar that separates annotation semantics from…

Computation and Language · Computer Science 2025-07-30 Yiyu Chen , Yifan Wu , Shuyu Shen , Yupeng Xie , Leixian Shen , Hui Xiong , Yuyu Luo

Alternative Texts (Alt-Text) for chart images are essential for making graphics accessible to people with blindness and visual impairments. Traditionally, Alt-Text is manually written by authors but often encounters issues such as…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Omar Moured , Shahid Ali Farooqui , Karin Muller , Sharifeh Fadaeijouybari , Thorsten Schwarz , Mohammed Javed , Rainer Stiefelhagen

Text is an integral but understudied component of visualization design. Although recent studies have examined how text elements (e.g., titles and annotations) influence comprehension, preferences, and predictions, many questions remain…

Human-Computer Interaction · Computer Science 2025-07-17 Chase Stokes , Anjana Arunkumar , Marti A. Hearst , Lace Padilla

Visual stories are an effective and powerful tool to convey specific information to a diverse public. Scrollytelling is a recent visual storytelling technique extensively used on the web, where content appears or changes as users scroll up…

Human-Computer Interaction · Computer Science 2022-07-11 Eric Mörth , Stefan Bruckner , Noeska N. Smit

Visualizations are powerful tools for conveying information but often rely on accompanying text for essential context and guidance. This study investigates the impact of annotation patterns on reader preferences and comprehension accuracy…

Human-Computer Interaction · Computer Science 2025-03-20 Anjana Arunkumar , Lace Padilla , Chris Bryan

Charts are commonly used for exploring data and communicating insights. Generating natural language summaries from charts can be very helpful for people in inferring key insights that would otherwise require a lot of cognitive and…

Computation and Language · Computer Science 2022-04-15 Shankar Kantharaj , Rixie Tiffany Ko Leong , Xiang Lin , Ahmed Masry , Megh Thakkar , Enamul Hoque , Shafiq Joty