English
Related papers

Related papers: Fidyll: A Compiler for Cross-Format Data Stories &…

200 papers

Data-driven storytelling has gained prominence in journalism and other data reporting fields. However, the process of creating these stories remains challenging, often requiring the integration of effective visualizations with compelling…

Human-Computer Interaction · Computer Science 2025-04-01 Yu Fu , Dennis Bromley , Vidya Setlur

Visual Storytelling is a challenging multimodal task between Vision & Language, where the purpose is to generate a story for a stream of images. Its difficulty lies on the fact that the story should be both grounded to the image sequence…

Computation and Language · Computer Science 2025-08-21 Admitos Passadakis , Yingjin Song , Albert Gatt

With most modern visualization tools, authors need to transform their data into tidy formats to create visualizations they want. Because this requires experience with programming or separate data processing tools, data transformation…

Human-Computer Interaction · Computer Science 2023-10-31 Chenglong Wang , John Thompson , Bongshin Lee

Many creative writing tasks (e.g., fiction writing) require authors to write complex narrative components (e.g., characterization, events, dialogue) over the course of a long story. Similarly, literary scholars need to manually annotate and…

Human-Computer Interaction · Computer Science 2023-08-09 Md Naimul Hoque , Bhavya Ghai , Kari Kraus , Niklas Elmqvist

A key challenge to visualization authoring is the process of getting familiar with the complex user interfaces of authoring tools. Natural Language Interface (NLI) presents promising benefits due to its learnability and usability. However,…

Human-Computer Interaction · Computer Science 2022-10-25 Yun Wang , Zhitao Hou , Leixian Shen , Tongshuang Wu , Jiaqi Wang , He Huang , Haidong Zhang , Dongmei Zhang

Analyzing literature involves tracking interactions between characters, locations, and themes. Visualization has the potential to facilitate the mapping and analysis of these complex relationships, but capturing structured information from…

Human-Computer Interaction · Computer Science 2025-08-12 Catherine Yeh , Tara Menon , Robin Singh Arya , Helen He , Moira Weigel , Fernanda Viégas , Martin Wattenberg

Storyline visualization has emerged as an innovative method for illustrating the development and changes in stories across various domains. Traditional approaches typically represent stories with one line per character, progressing from…

Human-Computer Interaction · Computer Science 2024-08-06 Haonan Yao , Lixiang Zhao , Boyuan Chen , Kaiwen Li , Hai-Ning Liang , Lingyun Yu

Visualizing narratives is useful to writers to reflect on unfinished drafts and identify unintentional biases and inconsistencies. Literary scholars can use the visualizations to identify nuanced patterns and literary styles from written…

Human-Computer Interaction · Computer Science 2026-04-17 S M Raihanul Alam , Md Dilshadur Rahman , Md Naimul Hoque

Authoring data-driven articles is a complex process requiring authors to not only analyze data for insights but also craft a cohesive narrative that effectively communicates the insights. Text generation capabilities of contemporary large…

Human-Computer Interaction · Computer Science 2023-08-09 Nicole Sultanum , Arjun Srinivasan

Research on storytelling over the last 100 years has distinguished at least two levels of narrative representation (1) story, or fabula; and (2) discourse, or sujhet. We use this distinction to create Fabula Tales, a computational framework…

Computation and Language · Computer Science 2017-08-30 Stephanie M. Lukin , Marilyn A. Walker

Existing methods in the Visual Storytelling field often suffer from the problem of generating general descriptions, while the image contains a lot of meaningful contents remaining unnoticed. The failure of informative story generation can…

Multimedia · Computer Science 2019-08-06 Jiacheng Li , Haizhou Shi , Siliang Tang , Fei Wu , Yueting Zhuang

In this paper, we build a visual dialogue dataset, named InfoVisDial, which provides rich informative answers in each round even with external knowledge related to the visual content. Different from existing datasets where the answer is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Bingbing Wen , Zhengyuan Yang , Jianfeng Wang , Zhe Gan , Bill Howe , Lijuan Wang

An emerging generation of visualization authoring systems support expressive information visualization without textual programming. As they vary in their visualization models, system architectures, and user interfaces, it is challenging to…

Human-Computer Interaction · Computer Science 2023-07-19 Arvind Satyanarayan , Bongshin Lee , Donghao Ren , Jeffrey Heer , John Stasko , John Thompson , Matthew Brehmer , Zhicheng Liu

Data-driven storytelling is a powerful method for conveying insights by combining narrative techniques with visualizations and text. These stories integrate visual aids, such as highlighted bars and lines in charts, along with textual…

Computation and Language · Computer Science 2024-10-07 Mohammed Saidul Islam , Md Tahmid Rahman Laskar , Md Rizwan Parvez , Enamul Hoque , Shafiq Joty

We put forth Physiologically Driven Storytelling, a new approach to interactive storytelling where narratives adaptively unfold based on the reader's physiological state. We first describe a taxonomy framing how physiological signals can be…

Human-Computer Interaction · Computer Science 2020-03-23 Jérémy Frey , Gilad Ostrin , May Grabli , Jessica Cauchard

Storytelling aims to generate reasonable and vivid narratives based on an ordered image stream. The fidelity to the image story theme and the divergence of story plots attract readers to keep reading. Previous works iteratively improved the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Chuanqi Zang , Jiji Tang , Rongsheng Zhang , Zeng Zhao , Tangjie Lv , Mingtao Pei , Wei Liang

Writing a coherent and engaging story is not easy. Creative writers use their knowledge and worldview to put disjointed elements together to form a coherent storyline, and work and rework iteratively toward perfection. Automated visual…

Computation and Language · Computer Science 2021-07-08 Chi-Yang Hsu , Yun-Wei Chu , Ting-Hao 'Kenneth' Huang , Lun-Wei Ku

Interactive fiction is a literary genre that is rapidly gaining popularity. In this genre, readers are able to explicitly take actions in order to guide the course of the story. With the recent popularity of narrative focused games, we…

Human-Computer Interaction · Computer Science 2019-01-09 Gilad Ostrin , Jérémy Frey , Jessica Cauchard

Individuals with Intellectual and Developmental Disabilities (IDD) have unique needs and challenges when working with data. While visualization aims to make data more accessible to a broad audience, our understanding of how to design…

Human-Computer Interaction · Computer Science 2024-08-30 Keke Wu , Ghulam Jilani Quadri , Arran Zeyu Wang , David Kwame Osei-Tutu , Emma Petersen , Varsha Koushik , Danielle Albers Szafir

The present study proposes LitStoryTeller, an interactive system for visually exploring the semantic structure of a scientific article. We demonstrate how LitStoryTeller could be used to answer some of the most fundamental research…

Human-Computer Interaction · Computer Science 2017-09-13 Qing Ping , Chaomei Chen