English
Related papers

Related papers: Generating Visual Stories with Grounded and Corefe…

200 papers

Visual storytelling includes two important parts: coherence between the story and images as well as the story structure. For image to text neural network models, similar images in the sequence would provide close information for story…

Computation and Language · Computer Science 2018-05-31 Chao-Chun Hsu , Szu-Min Chen , Ming-Hsun Hsieh , Lun-Wei Ku

Current image generation models struggle to reliably produce well-formed visual text. In this paper, we investigate a key contributing factor: popular text-to-image models lack character-level input features, making it much harder to…

Computation and Language · Computer Science 2023-05-04 Rosanne Liu , Dan Garrette , Chitwan Saharia , William Chan , Adam Roberts , Sharan Narang , Irina Blok , RJ Mical , Mohammad Norouzi , Noah Constant

This study presents a theory-inspired visual narrative generative system that integrates conceptual principles-comic authoring idioms-with generative and language models to enhance the comic creation process. Our system combines human…

Artificial Intelligence · Computer Science 2024-09-27 Yi-Chun Chen , Arnav Jhala

Story visualization requires generating sequential imagery that aligns semantically with evolving narratives while maintaining rigorous consistency in character identity and visual style. However, existing methodologies often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Jianzhang Zhang , Yijing Tian , Jiwang Qu , Chuang Liu

Narrative inquiry has been one of the prominent application domains for the analysis of human experience, aiming to know more about the complexity of human society. However, researchers are often required to transform various forms of data…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Runtong Wu , Jiayao Song , Fei Teng , Xianhao Ren , Yuyan Gao , Kailun Yang

Character description generation is an important capability for narrative-focused applications such as summarization, story analysis, and character-driven simulations. However, generating accurate character descriptions from long-form…

Computation and Language · Computer Science 2026-04-15 Argyrios Papoudakis , Mirella Lapata , Frank Keller

Story visualization aims to generate a series of images that match the story described in texts, and it requires the generated images to satisfy high quality, alignment with the text description, and consistency in character identities.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Wen Wang , Canyu Zhao , Hao Chen , Zhekai Chen , Kecheng Zheng , Chunhua Shen

One of the primary challenges of visual storytelling is developing techniques that can maintain the context of the story over long event sequences to generate human-like stories. In this paper, we propose a hierarchical deep learning…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Md Sultan Al Nahian , Tasmia Tasrin , Sagar Gandhi , Ryan Gaines , Brent Harrison

Storytelling is an integral part of human culture and significantly impacts cognitive and socio-emotional development and connection. Despite the importance of interactive visual storytelling, the process of creating such content requires…

Human-Computer Interaction · Computer Science 2024-06-04 Victor Nikhil Antony , Chien-Ming Huang

Generative models have recently exhibited exceptional capabilities in text-to-image generation, but still struggle to generate image sequences coherently. In this work, we focus on a novel, yet challenging task of generating a coherent…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Chang Liu , Haoning Wu , Yujie Zhong , Xiaoyun Zhang , Yanfeng Wang , Weidi Xie

Existing visual explanation generating agents learn to fluently justify a class prediction. However, they may mention visual attributes which reflect a strong class prior, although the evidence may not actually be in the image. This is…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Lisa Anne Hendricks , Ronghang Hu , Trevor Darrell , Zeynep Akata

Narrative visualization transforms data into engaging stories, making complex information accessible to a broad audience. Foundation models, with their advanced capabilities such as natural language processing, content generation, and…

Human-Computer Interaction · Computer Science 2025-02-14 Yi He , Ke Xu , Shixiong Cao , Yang Shi , Qing Chen , Nan Cao

In text-to-image generation, producing a series of consistent contents that preserve the same identity is highly valuable for real-world applications. Although a few works have explored training-free methods to enhance the consistency of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Mengyu Wang , Henghui Ding , Jianing Peng , Yao Zhao , Yunpeng Chen , Yunchao Wei

Automated plot generation is the challenge of generating a sequence of events that will be perceived by readers as the plot of a coherent story. Traditional symbolic planners plan a story from a goal state and guarantee logical causal plot…

Computation and Language · Computer Science 2022-12-20 Anbang Ye , Christopher Cui , Taiwei Shi , Mark O. Riedl

Image description task has been invariably examined in a static manner with qualitative presumptions held to be universally applicable, regardless of the scope or target of the description. In practice, however, different viewers may pay…

Computation and Language · Computer Science 2018-05-02 Andrew Shin , Yoshitaka Ushiku , Tatsuya Harada

Computational visual storytelling produces a textual description of events and interpretations depicted in a sequence of images. These texts are made possible by advances and cross-disciplinary approaches in natural language processing,…

Computation and Language · Computer Science 2018-07-24 Stephanie M. Lukin , Reginald Hobbs , Clare R. Voss

Tracking characters and locations throughout a story can help improve the understanding of its plot structure. Prior research has analyzed characters and locations from text independently without grounding characters to their locations in…

Computation and Language · Computer Science 2023-05-30 Sandeep Soni , Amanpreet Sihra , Elizabeth F. Evans , Matthew Wilkens , David Bamman

This paper introduces Story-Iter, a new training-free iterative paradigm to enhance long-story generation. Unlike existing methods that rely on fixed reference images to construct a complete story, our approach features a novel external…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Jiawei Mao , Xiaoke Huang , Yunfei Xie , Yuanqi Chang , Mude Hui , Bingjie Xu , Zeyu Zheng , Zirui Wang , Cihang Xie , Yuyin Zhou

The improved generative capabilities of large language models have made them a powerful tool for creative writing and storytelling. It is therefore important to quantitatively understand the nature of generated stories, and how they differ…

Computation and Language · Computer Science 2024-11-26 Xi Yu Huang , Krishnapriya Vishnubhotla , Frank Rudzicz

We present a literature survey on non-interactive computational story generation. The article starts with the presentation of requirements for creative systems, three types of models of creativity (computational, socio-cultural, and…

Computation and Language · Computer Science 2021-10-22 Luis Miguel Botelho