English
Related papers

Related papers: Story Generation from Visual Inputs: Techniques, R…

200 papers

Video storytelling is often constrained by available material, limiting creative expression and leaving undesired narrative gaps. Generative video offers a new way to address these limitations by augmenting captured media with tailored…

Human-Computer Interaction · Computer Science 2026-02-10 Catherine Yeh , Anh Truong , Mira Dontcheva , Bryan Wang

Generating diverse questions for given images is an important task for computational education, entertainment and AI assistants. Different from many conventional prediction techniques is the need for algorithms to generate a diverse set of…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Unnat Jain , Ziyu Zhang , Alexander Schwing

A significant body of research in Artificial Intelligence (AI) has focused on generating stories automatically, either based on prior story plots or input images. However, literature has little to say about how users would receive and use…

Human-Computer Interaction · Computer Science 2019-03-12 Ting-Yao Hsu , Yen-Chia Hsu , Ting-Hao 'Kenneth' Huang

Storytelling plays a central role in human socializing and entertainment. However, much of the research on automatic storytelling generation assumes that stories will be generated by an agent without any human interaction. In this paper, we…

Computation and Language · Computer Science 2020-11-23 Eric Nichols , Leo Gao , Randy Gomez

AI ethics narratives have the potential to shape the public accurate understanding of AI technologies and promote communication among different stakeholders. However, AI ethics narratives are largely lacking. Existing limited narratives…

Human-Computer Interaction · Computer Science 2025-02-04 Mengyi Wei , Chenjing Jiao , Chenyu Zuo , Lorenz Hurni , Liqiu Meng

In the current field of computer vision, automatically generating texts from given images has been a fully worked technique. Up till now, most works of this area focus on image content describing, namely image-captioning. However, rare…

Computation and Language · Computer Science 2019-01-15 Xuehui Sun , Zihan Zhou , Yuda Fan

The advent of large pre-trained generative language models has provided a common framework for AI story generation via sampling the model to create sequences that continue the story. However, sampling alone is insufficient for story…

Computation and Language · Computer Science 2021-12-17 Amal Alabdulkarim , Winston Li , Lara J. Martin , Mark O. Riedl

Visual storytelling is an interdisciplinary field combining computer vision and natural language processing to generate cohesive narratives from sequences of images. This paper presents a novel approach that leverages recent advancements in…

Computation and Language · Computer Science 2025-06-11 Mohamed Gado , Towhid Taliee , Muhammad Memon , Dmitry Ignatov , Radu Timofte

Generating natural, diverse, and meaningful questions from images is an essential task for multimodal assistants as it confirms whether they have understood the object and scene in the images properly. The research in visual question…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Alkesh Patel , Akanksha Bindal , Hadas Kotek , Christopher Klein , Jason Williams

Recent advancements in generative artificial intelligence (generative AI) technologies have transformed the computer science discipline of natural language processing. However, generative AI retains the anthropomorphic model of simulating…

Computers and Society · Computer Science 2026-03-03 Dejan Grba , Vladimir Todorović

Story visualization aims to generate a sequence of images to narrate each sentence in a multi-sentence story with a global consistency across dynamic scenes and characters. Current works still struggle with output images' quality and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Bowen Li , Thomas Lukasiewicz

Recent research in AI is focusing towards generating narrative stories about visual scenes. It has the potential to achieve more human-like understanding than just basic description generation of images- in-sequence. In this work, we…

Artificial Intelligence · Computer Science 2018-09-25 Marko Smilevski , Ilija Lalkovski , Gjorgji Madjarov

Characters are important in narratives. They move the plot forward, create emotional connections, and embody the story's themes. Visual storytelling methods focus more on the plot and events relating to it, without building the narrative…

Computation and Language · Computer Science 2025-03-04 Danyang Liu , Mirella Lapata , Frank Keller

Scenario generation is one of the essential steps in scenario-based testing and, therefore, a significant part of the verification and validation of driver assistance functions and autonomous driving systems. However, the term scenario…

Robotics · Computer Science 2023-07-25 Barbara Schütt , Joshua Ransiek , Thilo Braun , Eric Sax

Story generation is a task that aims to automatically produce multiple sentences to make up a meaningful story. This task is challenging because it requires high-level understanding of semantic meaning of sentences and causality of story…

Computation and Language · Computer Science 2021-02-08 Hong Chen , Raphael Shu , Hiroya Takamura , Hideki Nakayama

The rise of non-linear and interactive media such as video games has increased the need for automatic movement animation generation. In this survey, we review and analyze different aspects of building automatic movement generation systems…

Machine Learning · Computer Science 2019-03-21 Omid Alemi , Philippe Pasquier

The emerging practice of data-driven storytelling is framing data using familiar narrative mechanisms such as slideshows, videos, and comics to make even highly complex phenomena understandable. However, current data stories are still not…

Human-Computer Interaction · Computer Science 2025-11-18 Zhenpeng Zhao , Niklas Elmqvist

We introduce the first dataset for human edits of machine-generated visual stories and explore how these collected edits may be used for the visual story post-editing task. The dataset, VIST-Edit, includes 14,905 human edited versions of…

Computation and Language · Computer Science 2019-06-06 Ting-Yao Hsu , Chieh-Yang Huang , Yen-Chia Hsu , Ting-Hao 'Kenneth' Huang

We propose a learning model for the task of visual storytelling. The main idea is to predict anchor word embeddings from the images and use the embeddings and the image features jointly to generate narrative sentences. We use the embeddings…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Bowen Zhang , Hexiang Hu , Fei Sha

Image narrative generation is a task to create a story from an image with a subjective viewpoint. Given the importance of the subjective feelings of writers, readers, and characters in storytelling, an image narrative generation method…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Kohei Uehara , Yusuke Mori , Yusuke Mukuta , Tatsuya Harada