中文
相关论文

相关论文: Generating Visual Stories with Grounded and Corefe…

200 篇论文

Visual storytelling includes two important parts: coherence between the story and images as well as the story structure. For image to text neural network models, similar images in the sequence would provide close information for story…

计算与语言 · 计算机科学 2018-05-31 Chao-Chun Hsu , Szu-Min Chen , Ming-Hsun Hsieh , Lun-Wei Ku

Current image generation models struggle to reliably produce well-formed visual text. In this paper, we investigate a key contributing factor: popular text-to-image models lack character-level input features, making it much harder to…

This study presents a theory-inspired visual narrative generative system that integrates conceptual principles-comic authoring idioms-with generative and language models to enhance the comic creation process. Our system combines human…

人工智能 · 计算机科学 2024-09-27 Yi-Chun Chen , Arnav Jhala

Story visualization requires generating sequential imagery that aligns semantically with evolving narratives while maintaining rigorous consistency in character identity and visual style. However, existing methodologies often struggle with…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Jianzhang Zhang , Yijing Tian , Jiwang Qu , Chuang Liu

Narrative inquiry has been one of the prominent application domains for the analysis of human experience, aiming to know more about the complexity of human society. However, researchers are often required to transform various forms of data…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Runtong Wu , Jiayao Song , Fei Teng , Xianhao Ren , Yuyan Gao , Kailun Yang

Character description generation is an important capability for narrative-focused applications such as summarization, story analysis, and character-driven simulations. However, generating accurate character descriptions from long-form…

计算与语言 · 计算机科学 2026-04-15 Argyrios Papoudakis , Mirella Lapata , Frank Keller

Story visualization aims to generate a series of images that match the story described in texts, and it requires the generated images to satisfy high quality, alignment with the text description, and consistency in character identities.…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Wen Wang , Canyu Zhao , Hao Chen , Zhekai Chen , Kecheng Zheng , Chunhua Shen

One of the primary challenges of visual storytelling is developing techniques that can maintain the context of the story over long event sequences to generate human-like stories. In this paper, we propose a hierarchical deep learning…

计算机视觉与模式识别 · 计算机科学 2019-09-30 Md Sultan Al Nahian , Tasmia Tasrin , Sagar Gandhi , Ryan Gaines , Brent Harrison

Storytelling is an integral part of human culture and significantly impacts cognitive and socio-emotional development and connection. Despite the importance of interactive visual storytelling, the process of creating such content requires…

人机交互 · 计算机科学 2024-06-04 Victor Nikhil Antony , Chien-Ming Huang

Generative models have recently exhibited exceptional capabilities in text-to-image generation, but still struggle to generate image sequences coherently. In this work, we focus on a novel, yet challenging task of generating a coherent…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Chang Liu , Haoning Wu , Yujie Zhong , Xiaoyun Zhang , Yanfeng Wang , Weidi Xie

Existing visual explanation generating agents learn to fluently justify a class prediction. However, they may mention visual attributes which reflect a strong class prior, although the evidence may not actually be in the image. This is…

计算机视觉与模式识别 · 计算机科学 2018-08-03 Lisa Anne Hendricks , Ronghang Hu , Trevor Darrell , Zeynep Akata

Narrative visualization transforms data into engaging stories, making complex information accessible to a broad audience. Foundation models, with their advanced capabilities such as natural language processing, content generation, and…

人机交互 · 计算机科学 2025-02-14 Yi He , Ke Xu , Shixiong Cao , Yang Shi , Qing Chen , Nan Cao

In text-to-image generation, producing a series of consistent contents that preserve the same identity is highly valuable for real-world applications. Although a few works have explored training-free methods to enhance the consistency of…

计算机视觉与模式识别 · 计算机科学 2025-07-16 Mengyu Wang , Henghui Ding , Jianing Peng , Yao Zhao , Yunpeng Chen , Yunchao Wei

Automated plot generation is the challenge of generating a sequence of events that will be perceived by readers as the plot of a coherent story. Traditional symbolic planners plan a story from a goal state and guarantee logical causal plot…

计算与语言 · 计算机科学 2022-12-20 Anbang Ye , Christopher Cui , Taiwei Shi , Mark O. Riedl

Image description task has been invariably examined in a static manner with qualitative presumptions held to be universally applicable, regardless of the scope or target of the description. In practice, however, different viewers may pay…

计算与语言 · 计算机科学 2018-05-02 Andrew Shin , Yoshitaka Ushiku , Tatsuya Harada

Computational visual storytelling produces a textual description of events and interpretations depicted in a sequence of images. These texts are made possible by advances and cross-disciplinary approaches in natural language processing,…

计算与语言 · 计算机科学 2018-07-24 Stephanie M. Lukin , Reginald Hobbs , Clare R. Voss

Tracking characters and locations throughout a story can help improve the understanding of its plot structure. Prior research has analyzed characters and locations from text independently without grounding characters to their locations in…

计算与语言 · 计算机科学 2023-05-30 Sandeep Soni , Amanpreet Sihra , Elizabeth F. Evans , Matthew Wilkens , David Bamman

This paper introduces Story-Iter, a new training-free iterative paradigm to enhance long-story generation. Unlike existing methods that rely on fixed reference images to construct a complete story, our approach features a novel external…

计算机视觉与模式识别 · 计算机科学 2026-02-17 Jiawei Mao , Xiaoke Huang , Yunfei Xie , Yuanqi Chang , Mude Hui , Bingjie Xu , Zeyu Zheng , Zirui Wang , Cihang Xie , Yuyin Zhou

The improved generative capabilities of large language models have made them a powerful tool for creative writing and storytelling. It is therefore important to quantitatively understand the nature of generated stories, and how they differ…

计算与语言 · 计算机科学 2024-11-26 Xi Yu Huang , Krishnapriya Vishnubhotla , Frank Rudzicz

We present a literature survey on non-interactive computational story generation. The article starts with the presentation of requirements for creative systems, three types of models of creativity (computational, socio-cultural, and…

计算与语言 · 计算机科学 2021-10-22 Luis Miguel Botelho