English
Related papers

Related papers: ID.8: Co-Creating Visual Stories with Generative A…

200 papers

People with visual impairments often struggle to create content that relies heavily on visual elements, particularly when conveying spatial and structural information. Existing accessible drawing tools, which construct images line by line,…

Human-Computer Interaction · Computer Science 2025-04-30 Seonghee Lee , Maho Kohga , Steve Landau , Sile O'Modhrain , Hari Subramonyam

Story visualization aims to generate a series of images that match the story described in texts, and it requires the generated images to satisfy high quality, alignment with the text description, and consistency in character identities.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Wen Wang , Canyu Zhao , Hao Chen , Zhekai Chen , Kecheng Zheng , Chunhua Shen

This paper delves into the transformative power of Generative AI-driven storytelling in the realm of marketing. Generative AI, distinct from traditional machine learning, offers the capability to craft narratives that resonate with…

Human-Computer Interaction · Computer Science 2023-09-19 Marko Vidrih , Shiva Mayahi

A method for generating narratives by analyzing single images or image sequences is presented, inspired by the time immemorial tradition of Narrative Art. The proposed method explores the multimodal capabilities of GPT-4o to interpret…

Computation and Language · Computer Science 2024-08-22 Edirlei Soares de Lima , Marco A. Casanova , Antonio L. Furtado

Storytelling is an open-ended task that entails creative thinking and requires a constant flow of ideas. Natural language generation (NLG) for storytelling is especially challenging because it requires the generated text to follow an…

Computation and Language · Computer Science 2021-09-17 Eden Bensaid , Mauro Martino , Benjamin Hoover , Hendrik Strobelt

We explore the potential for combining generative AI with grammar-based visualizations for biomedical data discovery. In our prototype, we use a multi-agent system to generate visualization specifications and apply filters. These…

Human-Computer Interaction · Computer Science 2025-09-23 Devin Lange , Shanghua Gao , Pengwei Sui , Austen Money , Priya Misner , Marinka Zitnik , Nils Gehlenborg

Human-AI co-creativity involves humans and AI collaborating on a shared creative product as partners. In a creative collaboration, communication is an essential component among collaborators. In many existing co-creative systems users can…

Human-Computer Interaction · Computer Science 2022-06-07 Jeba Rezwana , Mary Lou Maher

Intelligent Tutoring Systems (ITSs) have shown great potential in delivering personalized and adaptive education, but their widespread adoption has been hindered by the need for specialized programming and design skills. Existing approaches…

Human-Computer Interaction · Computer Science 2024-05-24 Tommaso Calo , Christopher J. MacLellan

Despite its benefits for children's skill development and parent-child bonding, many parents do not often engage in interactive storytelling by having story-related dialogues with their child due to limited availability or challenges in…

Human-Computer Interaction · Computer Science 2022-03-16 Zheng Zhang , Ying Xu , Yanhao Wang , Bingsheng Yao , Daniel Ritchie , Tongshuang Wu , Mo Yu , Dakuo Wang , Toby Jia-Jun Li

At its core, information access and seeking is an interactive process. In existing search engines, interactions are limited to a few pre-defined actions, such as "requery", "click on a document", "scrolling up/down", "going to the next…

Information Retrieval · Computer Science 2024-07-17 Mohammad Aliannejadi , Jacek Gwizdka , Hamed Zamani

AI fairy tale companions play an important role in early childhood education as an augmentation for parents' efforts to close the participation gap and boost kids' mental and language development. Existing systems are generally designed to…

Multimedia · Computer Science 2021-12-02 Ruiyang Liu , Predrag K. Nikolic

A storyboard is a sequence of images to illustrate a story containing multiple sentences, which has been a key process to create different story products. In this paper, we tackle a new multimedia task of automatic storyboard creation to…

Machine Learning · Computer Science 2019-12-02 Shizhe Chen , Bei Liu , Jianlong Fu , Ruihua Song , Qin Jin , Pingping Lin , Xiaoyu Qi , Chunting Wang , Jin Zhou

A new class of tools, colloquially called generative AI, can produce high-quality artistic media for visual arts, concept art, music, fiction, literature, video, and animation. The generative capabilities of these tools are likely to…

Visual storytelling aims to generate a narrative paragraph from a sequence of images automatically. Existing approaches construct text description independently for each image and roughly concatenate them as a story, which leads to the…

Computation and Language · Computer Science 2020-11-02 Ruize Wang , Zhongyu Wei , Ying Cheng , Piji Li , Haijun Shan , Ji Zhang , Qi Zhang , Xuanjing Huang

The landscape of interactive systems is shifting toward dynamic, generative experiences that empower users to explore and construct knowledge in real time. Yet, timelines -- a fundamental tool for representing historical and conceptual…

Human-Computer Interaction · Computer Science 2025-10-22 Sangho Suh , Rahul Hingorani , Bryan Wang , Tovi Grossman

Many blind and low vision (BLV) people are excluded from professional roles that may involve visual tasks due to access barriers and persisting stigmas. Advancing generative AI systems can support BLV people through providing contextual and…

Human-Computer Interaction · Computer Science 2025-10-13 Lucy Jiang , Lotus Zhang , Leah Findlater

We introduce Toyteller, an AI-powered storytelling system where users generate a mix of story text and visuals by directly manipulating character symbols like they are toy-playing. Anthropomorphized symbol motions can convey rich and…

Human-Computer Interaction · Computer Science 2025-01-24 John Joon Young Chung , Melissa Roemmele , Max Kreminski

Complex data analysis inherently seeks unexpected insights through exploratory visual analysis methods, transcending logical, step-by-step processing. However, existing interfaces such as notebooks and dashboards have limitations in…

Human-Computer Interaction · Computer Science 2024-03-22 Zijian Ding , Joel Chan

An interactive vignette is a popular and immersive visual storytelling approach that invites viewers to role-play a character and influences the narrative in an interactive environment. However, it has not been widely used by everyday…

Human-Computer Interaction · Computer Science 2026-02-05 Jiangnan Xu , Haeseul Cha , Gosu Choi , Gyu-cheol Lee , Yeo-Jin Yoon , Zucheul Lee , Konstantinos Papangelis , Dae Hyun Kim , Juho Kim

Generative AI brings novel and impressive abilities to help people in everyday tasks. There are many AI workflows that solve real and complex problems by chaining AI outputs together with human interaction. Although there is an undeniable…

Human-Computer Interaction · Computer Science 2024-06-03 Tao Long , Katy Ilonka Gero , Lydia B. Chilton