English
Related papers

Related papers: A Pipeline for Creative Visual Storytelling

200 papers

In this paper, we collect an anthology of 100 visual stories from authors who participated in our systematic creative process of improvised story-building based on image sequences. Following close reading and thematic analysis of our…

Computation and Language · Computer Science 2023-10-10 Brett A. Halperin , Stephanie M. Lukin

Automated visual story generation aims to produce stories with corresponding illustrations that exhibit coherence, progression, and adherence to characters' emotional development. This work proposes a story generation pipeline to co-create…

Artificial Intelligence · Computer Science 2023-01-10 Yuetian Chen , Ruohua Li , Bowen Shi , Peiru Liu , Mei Si

Visual Storytelling is a challenging multimodal task between Vision & Language, where the purpose is to generate a story for a stream of images. Its difficulty lies on the fact that the story should be both grounded to the image sequence…

Computation and Language · Computer Science 2025-08-21 Admitos Passadakis , Yingjin Song , Albert Gatt

We define "visual story-writing" as using visual representations of story elements to support writing and revising narrative texts. To demonstrate this approach, we developed a text editor that automatically visualizes a graph of entity…

Human-Computer Interaction · Computer Science 2025-08-01 Damien Masson , Zixin Zhao , Fanny Chevalier

Image description task has been invariably examined in a static manner with qualitative presumptions held to be universally applicable, regardless of the scope or target of the description. In practice, however, different viewers may pay…

Computation and Language · Computer Science 2018-05-02 Andrew Shin , Yoshitaka Ushiku , Tatsuya Harada

Visual storytelling aims to generate a narrative paragraph from a sequence of images automatically. Existing approaches construct text description independently for each image and roughly concatenate them as a story, which leads to the…

Computation and Language · Computer Science 2020-11-02 Ruize Wang , Zhongyu Wei , Ying Cheng , Piji Li , Haijun Shan , Ji Zhang , Qi Zhang , Xuanjing Huang

A storyboard is a sequence of images to illustrate a story containing multiple sentences, which has been a key process to create different story products. In this paper, we tackle a new multimedia task of automatic storyboard creation to…

Machine Learning · Computer Science 2019-12-02 Shizhe Chen , Bei Liu , Jianlong Fu , Ruihua Song , Qin Jin , Pingping Lin , Xiaoyu Qi , Chunting Wang , Jin Zhou

Visual storytelling aims to generate compelling narratives from image sequences. Existing models often focus on enhancing the representation of the image sequence, e.g., with external knowledge sources or advanced graph structures. Despite…

Computation and Language · Computer Science 2023-10-19 Danyang Liu , Mirella Lapata , Frank Keller

In recent years, narrative visualization has gained much attention. Researchers have proposed different design spaces for various narrative visualization genres and scenarios to facilitate the creation process. As users' needs grow and…

Human-Computer Interaction · Computer Science 2023-03-23 Qing Chen , Shixiong Cao , Jiazhe Wang , Nan Cao

Storyline visualization has emerged as an innovative method for illustrating the development and changes in stories across various domains. Traditional approaches typically represent stories with one line per character, progressing from…

Human-Computer Interaction · Computer Science 2024-08-06 Haonan Yao , Lixiang Zhao , Boyuan Chen , Kaiwen Li , Hai-Ning Liang , Lingyun Yu

Visual Story-Telling is the process of forming a multi-sentence story from a set of images. Appropriately including visual variation and contextual information captured inside the input images is one of the most challenging aspects of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Zainy M. Malakan , Ghulam Mubashar Hassan , Ajmal Mian

As a technically challenging topic, visual storytelling aims at generating an imaginary and coherent story with narrative multi-sentences from a group of relevant images. Existing methods often generate direct and rigid descriptions of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Tengpeng Li , Hanli Wang , Bin He , Chang Wen Chen

Visual storytelling is a task of generating relevant and interesting stories for given image sequences. In this work we aim at increasing the diversity of the generated stories while preserving the informative content from the images. We…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Hong Chen , Yifei Huang , Hiroya Takamura , Hideki Nakayama

Story Visualization is an advanced task of computed vision that targets sequential image synthesis, where the generated samples need to be realistic, faithful to their conditioning and sequentially consistent. Our work proposes a novel…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Nikolaos Tsakas , Maria Lymperaiou , Giorgos Filandrianos , Giorgos Stamou

Multimodal story customization aims to generate coherent story flows conditioned on textual descriptions, reference identity images, and shot types. While recent progress in story generation has shown promising results, most approaches rely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Wei-Hua Li , Cheng Sun , Chu-Song Chen

Story visualization advances the traditional text-to-image generation by enabling multiple image generation based on a complete story. This task requires machines to 1) understand long text inputs and 2) produce a globally consistent image…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Hong Chen , Rujun Han , Te-Lin Wu , Hideki Nakayama , Nanyun Peng

Story visualization aims to generate a sequence of images to narrate each sentence in a multi-sentence story with a global consistency across dynamic scenes and characters. Current works still struggle with output images' quality and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Bowen Li , Thomas Lukasiewicz

Visual storytelling aims to generate a narrative based on a sequence of images, necessitating both vision-language alignment and coherent story generation. Most existing solutions predominantly depend on paired image-text training data,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yuechen Wang , Wengang Zhou , Zhenbo Lu , Houqiang Li

Bridging vision and natural language is a longstanding goal in computer vision and multimedia research. While earlier works focus on generating a single-sentence description for visual content, recent works have studied paragraph…

Multimedia · Computer Science 2020-05-15 Junnan Li , Yongkang Wong , Qi Zhao , Mohan S. Kankanhalli

Visual storytelling systems generate multi-sentence stories from image sequences. In this task, capturing contextual information and bridging visual variation bring additional challenges. We propose a simple yet effective framework that…

Computation and Language · Computer Science 2024-08-13 Yingjin Song , Denis Paperno , Albert Gatt
‹ Prev 1 2 3 10 Next ›