English
Related papers

Related papers: Calliope: Automatic Visual Data Story Generation f…

200 papers

Visual storytelling is the task of generating stories based on a sequence of images. Inspired by the recent works in neural generation focusing on controlling the form of text, this paper explores the idea of generating these stories in…

Computation and Language · Computer Science 2019-06-18 Shrimai Prabhumoye , Khyathi Raghavi Chandu , Ruslan Salakhutdinov , Alan W Black

One of the most important assets of any company is being able to easily access information on itself and on its business. In this line, it has been observed that this important information is often stored in one of the millions of…

Software Engineering · Computer Science 2015-03-02 Jácome Cunha , João Paulo Fernandes , Rui Pereira , João Saraiva

Story visualization is an under-explored task that falls at the intersection of many important research directions in both computer vision and natural language processing. In this task, given a series of natural language captions which…

Computation and Language · Computer Science 2021-05-24 Adyasha Maharana , Darryl Hannan , Mohit Bansal

Data storytelling (DS) is rapidly gaining attention as an approach that integrates data, visuals, and narratives to create data stories that can help a particular audience to comprehend the key messages underscored by the data with enhanced…

Human-Computer Interaction · Computer Science 2024-05-21 Honbo Shao , Roberto Martinez-Maldonado , Vanessa Echeverria , Lixiang Yan , Dragan Gasevic

Visual storytelling aims to generate a narrative based on a sequence of images, necessitating both vision-language alignment and coherent story generation. Most existing solutions predominantly depend on paired image-text training data,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yuechen Wang , Wengang Zhou , Zhenbo Lu , Houqiang Li

Visual storytelling aims to generate compelling narratives from image sequences. Existing models often focus on enhancing the representation of the image sequence, e.g., with external knowledge sources or advanced graph structures. Despite…

Computation and Language · Computer Science 2023-10-19 Danyang Liu , Mirella Lapata , Frank Keller

With most modern visualization tools, authors need to transform their data into tidy formats to create visualizations they want. Because this requires experience with programming or separate data processing tools, data transformation…

Human-Computer Interaction · Computer Science 2023-10-31 Chenglong Wang , John Thompson , Bongshin Lee

Generating videos for visual storytelling can be a tedious and complex process that typically requires either live-action filming or graphics animation rendering. To bypass these challenges, our key idea is to utilize the abundance of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Yingqing He , Menghan Xia , Haoxin Chen , Xiaodong Cun , Yuan Gong , Jinbo Xing , Yong Zhang , Xintao Wang , Chao Weng , Ying Shan , Qifeng Chen

This paper explores the use of scenario-based visualisation examples as a pedagogical strategy for teaching students the complexities of data insight, representation, and interpretation. Teaching data visualisation often involves explaining…

Human-Computer Interaction · Computer Science 2025-08-13 Jonathan C. Roberts , Peter Butcher , Panagiotis D. Ritsos

Feature concepts and data leaves have been invented using datasets to foster creative thoughts for creating well-being in daily life. The idea, simply put, is to attach selected and collected data leaves that are summaries of event flows to…

Machine Learning · Computer Science 2023-12-19 Yukio Ohsawa , Tomohide Maekawa , Hiroki Yamaguchi , Hiro Yoshida , Kaira Sekiguchi

We present an assistive system for clipart design by providing visual scaffolds from the unseen viewpoints. Inspired by the artists' creation process, our system constructs the visual scaffold by first synthesizing the reference 3D shape of…

Graphics · Computer Science 2020-12-08 I-Chao Shen , Kuan-Hung Liu , Li-Wen Su , Yu-Ting Wu , Bing-Yu Chen

Data tables play a central role in scientific papers. However, their meaning is often co-constructed with surrounding text through narrative interplay, making comprehension cognitively demanding for readers. In this work, we explore how…

Human-Computer Interaction · Computer Science 2026-02-27 Liangwei Wang , Zhengxuan Zhang , Yifan Cao , Fugee Tsung , Yuyu Luo

When telling a data story, an author has an intention they seek to convey to an audience. This intention can be of many forms such as to persuade, to educate, to inform, or even to entertain. In addition to expressing their intention, the…

Human-Computer Interaction · Computer Science 2023-08-16 Keshav Dasu , Yun-Hsin Kuo , Kwan-Liu Ma

The proliferation of creative video content has driven demand for textual descriptions or summaries that allow users to recall key plot points or get an overview without watching. The volume of movie content and speed of turnover motivates…

Artificial Intelligence · Computer Science 2024-10-29 Louis Mahon , Mirella Lapata

Historical maps provide valuable information and knowledge about the past. However, as they often feature non-standard projections, hand-drawn styles, and artistic elements, it is challenging for non-experts to identify and interpret them.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ziyi Liu , Claudio Affolter , Sidi Wu , Yizi Chen , Lorenz Hurni

Data videos -- motion graphics that incorporate visualizations -- have been recognized as an effective way to communicate ideas, but creating such video requires both time and expertise, precluding them from being created and streamed live.…

Human-Computer Interaction · Computer Science 2022-10-18 Zhenpeng Zhao , Niklas Elmqvist

Computational visual storytelling produces a textual description of events and interpretations depicted in a sequence of images. These texts are made possible by advances and cross-disciplinary approaches in natural language processing,…

Computation and Language · Computer Science 2018-07-24 Stephanie M. Lukin , Reginald Hobbs , Clare R. Voss

Story Visualization aims to generate images aligned with story prompts, reflecting the coherence of storybooks through visual consistency among characters and scenes.Whereas current approaches exclusively concentrate on characters and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Sitong Su , Litao Guo , Lianli Gao , Heng Tao Shen , Jingkuan Song

Can visual artworks created using generative visual algorithms inspire human creativity in storytelling? We asked writers to write creative stories from a starting prompt, and provided them with visuals created by generative AI models from…

Human-Computer Interaction · Computer Science 2021-10-29 Safinah Ali , Devi Parikh

The availability of labeled image datasets has been shown critical for high-level image understanding, which continuously drives the progress of feature designing and models developing. However, constructing labeled image datasets is…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Yazhou Yao , Jian Zhang , Fumin Shen , Li Liu , Fan Zhu , Dongxiang Zhang , Heng-Tao Shen