English
Related papers

Related papers: ID.8: Co-Creating Visual Stories with Generative A…

200 papers

Generative design, an AI-assisted technology for optimizing design through algorithmic processes, is propelling advancements across numerous fields. As the use of immersive environments such as Augmented Reality (AR) continues to rise,…

Human-Computer Interaction · Computer Science 2025-03-28 Sora Kang , Kaiwen Yu , Xinyi Zhou , Joonhwan Lee

Automatically generating stories is a challenging problem that requires producing causally related and logical sequences of events about a topic. Previous approaches in this domain have focused largely on one-shot generation, where a…

Computation and Language · Computer Science 2020-10-21 Faeze Brahman , Alexandru Petrusca , Snigdha Chaturvedi

Empowering blind and low vision (BLV) users to explore visual media improves content comprehension, strengthens user agency, and fulfills diverse information needs. However, most existing tools separate exploration from the main narration,…

Human-Computer Interaction · Computer Science 2025-08-08 Shuchang Xu

Immersive authoring provides an intuitive medium for users to create 3D scenes via direct manipulation in Virtual Reality (VR). Recent advances in generative AI have enabled the automatic creation of realistic 3D layouts. However, it is…

Human-Computer Interaction · Computer Science 2024-08-20 Lei Zhang , Jin Pan , Jacob Gettig , Steve Oney , Anhong Guo

New systems employ Machine Learning to sift through large knowledge sources, creating flexible Large Language Models. These models discern context and predict sequential information in various communication forms. Generative AI, leveraging…

Artificial Intelligence · Computer Science 2023-07-19 Ted Selker

Automated visual story generation aims to produce stories with corresponding illustrations that exhibit coherence, progression, and adherence to characters' emotional development. This work proposes a story generation pipeline to co-create…

Artificial Intelligence · Computer Science 2023-01-10 Yuetian Chen , Ruohua Li , Bowen Shi , Peiru Liu , Mei Si

We define "visual story-writing" as using visual representations of story elements to support writing and revising narrative texts. To demonstrate this approach, we developed a text editor that automatically visualizes a graph of entity…

Human-Computer Interaction · Computer Science 2025-08-01 Damien Masson , Zixin Zhao , Fanny Chevalier

Storytelling infographics are a powerful medium for communicating data-driven stories through visual presentation. However, existing authoring tools lack support for maintaining story consistency and aligning with users' story goals…

Human-Computer Interaction · Computer Science 2026-02-27 Jielin Feng , Xinwu Ye , Qianhui Li , Verena Ingrid Prantl , Jun-Hsiang Yao , Yuheng Zhao , Yun Wang , Siming Chen

Digital storytelling, as an art form, has struggled with cost-quality balance. The emergence of AI-generated Content (AIGC) is considered as a potential solution for efficient digital storytelling production. However, the specific form,…

Human-Computer Interaction · Computer Science 2023-09-29 Rongzhang Gu , Hui Li , Changyue Su , Wayne Wu

Intergenerational co-creation using technology between grandparents and grandchildren can be challenging due to differences in technological familiarity. AI has emerged as a promising tool to support co-creative activities, offering…

Human-Computer Interaction · Computer Science 2025-03-04 Callie Y. Kim , Arissa J. Sato , Nathan Thomas White , Hui-Ru Ho , Christine P. Lee , Yuna Hwang , Bilge Mutlu

Generative, ML-driven interactive systems have the potential to change how people interact with computers in creative processes - turning tools into co-creators. However, it is still unclear how we might achieve effective human-AI…

Human-Computer Interaction · Computer Science 2022-07-08 Frederic Gmeiner , Kenneth Holstein , Nikolas Martelaro

Storytelling is an ancient and precious human ability that has been rejuvenated in the digital age. Over the last decade, there has been a notable surge in the recognition and application of data storytelling, both in academia and industry.…

Human-Computer Interaction · Computer Science 2024-04-09 Xingyu Lan , Leni Yang , Zezhong Wang , Yun Wang , Danqing Shi , Sheelagh Carpendale

Voice, the discursive construction of the writer's identity, has been extensively studied and theorized in composition studies. In multimodal writing, students are able to mobilize both linguistic and non linguistic resources to express…

Computers and Society · Computer Science 2024-03-29 Xiao Tan , Wei Xu , Chaoran Wang

The rapid adoption of generative AI in software development has impacted the industry, yet its effects on developers with visual impairments remain largely unexplored. To address this gap, we used an Activity Theory framework to examine how…

Human-Computer Interaction · Computer Science 2025-03-24 Claudia Flores-Saviaga , Benjamin V. Hanrahan , Kashif Imteyaz , Steven Clarke , Saiph Savage

Stories are central to human culture, serving to share ideas, preserve traditions, and foster connections. Automatic story generation, a key advancement in artificial intelligence (AI), offers new possibilities for creating personalized…

Computation and Language · Computer Science 2025-06-04 Jiaming Li , Yukun Chen , Ziqiang Liu , Minghuan Tan , Lei Zhang , Yunshui Li , Run Luo , Longze Chen , Jing Luo , Ahmadreza Argha , Hamid Alinejad-Rokny , Wei Zhou , Min Yang

Story composition is a challenging problem for machines and even for humans. We present a neural narrative generation system that interacts with humans to generate stories. Our system has different levels of human interaction, which enables…

Computation and Language · Computer Science 2019-06-04 Seraphina Goldfarb-Tarrant , Haining Feng , Nanyun Peng

This paper introduces Kahaani, a multimodal, co-creative storytelling system that leverages Generative Artificial Intelligence, designed for children to address the challenge of sustaining engagement to foster educational narrative…

Computation and Language · Computer Science 2026-02-10 Samee Arif , Muhammad Saad Haroon , Aamina Jamal Khan , Taimoor Arif , Agha Ali Raza , Awais Athar

Generative AI, i.e., the group of technologies that automatically generate visual or written content based on text prompts, has undergone a leap in complexity and become widely available within just a few years. Such technologies…

Human-Computer Interaction · Computer Science 2023-03-17 Nanna Inie , Jeanette Falk , Steven Tanimoto

This paper explores interaction designs for generative AI interfaces that necessitate human involvement throughout the generation process. We argue that such interfaces can promote cognitive engagement, agency, and thoughtful…

Human-Computer Interaction · Computer Science 2025-04-14 Kenneth C. Arnold , Jiho Kim

Video storytelling is often constrained by available material, limiting creative expression and leaving undesired narrative gaps. Generative video offers a new way to address these limitations by augmenting captured media with tailored…

Human-Computer Interaction · Computer Science 2026-02-10 Catherine Yeh , Anh Truong , Mira Dontcheva , Bryan Wang